-- Logs begin at Mon 2022-09-19 14:11:26 UTC, end at Mon 2022-09-19 15:12:32 UTC. -- Sep 19 14:40:26.027740 dv-cinder-756709-7-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 19 14:40:26.038738 dv-cinder-756709-7-smb devstack@keystone.service[81458]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 19 14:40:26.040762 dv-cinder-756709-7-smb devstack@keystone.service[81458]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Sep 19 14:40:26 2022] *** Sep 19 14:40:26.040762 dv-cinder-756709-7-smb devstack@keystone.service[81458]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 19 14:40:26.040762 dv-cinder-756709-7-smb devstack@keystone.service[81458]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 19 14:40:26.040762 dv-cinder-756709-7-smb devstack@keystone.service[81458]: nodename: dv-cinder-756709-7-smb Sep 19 14:40:26.040762 dv-cinder-756709-7-smb devstack@keystone.service[81458]: machine: x86_64 Sep 19 14:40:26.040762 dv-cinder-756709-7-smb devstack@keystone.service[81458]: clock source: unix Sep 19 14:40:26.040762 dv-cinder-756709-7-smb devstack@keystone.service[81458]: pcre jit disabled Sep 19 14:40:26.040762 dv-cinder-756709-7-smb devstack@keystone.service[81458]: detected number of CPU cores: 4 Sep 19 14:40:26.040762 dv-cinder-756709-7-smb devstack@keystone.service[81458]: current working directory: / Sep 19 14:40:26.040762 dv-cinder-756709-7-smb devstack@keystone.service[81458]: detected binary path: /usr/bin/uwsgi-core Sep 19 14:40:26.040762 dv-cinder-756709-7-smb devstack@keystone.service[81458]: your processes number limit is 47680 Sep 19 14:40:26.041344 dv-cinder-756709-7-smb devstack@keystone.service[81458]: your memory page size is 4096 bytes Sep 19 14:40:26.041344 dv-cinder-756709-7-smb devstack@keystone.service[81458]: detected max file descriptor number: 2048 Sep 19 14:40:26.041344 dv-cinder-756709-7-smb devstack@keystone.service[81458]: lock engine: pthread robust mutexes Sep 19 14:40:26.041344 dv-cinder-756709-7-smb devstack@keystone.service[81458]: thunder lock: enabled Sep 19 14:40:26.041344 dv-cinder-756709-7-smb devstack@keystone.service[81458]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 19 14:40:26.041344 dv-cinder-756709-7-smb devstack@keystone.service[81458]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 19 14:40:26.079841 dv-cinder-756709-7-smb devstack@keystone.service[81458]: Python main interpreter initialized at 0x56248ba189c0 Sep 19 14:40:26.079841 dv-cinder-756709-7-smb devstack@keystone.service[81458]: python threads support enabled Sep 19 14:40:26.079841 dv-cinder-756709-7-smb devstack@keystone.service[81458]: your server socket listen backlog is limited to 100 connections Sep 19 14:40:26.079841 dv-cinder-756709-7-smb devstack@keystone.service[81458]: your mercy for graceful operations on workers is 90 seconds Sep 19 14:40:26.080371 dv-cinder-756709-7-smb devstack@keystone.service[81458]: mapped 403077 bytes (393 KB) for 2 cores Sep 19 14:40:26.080371 dv-cinder-756709-7-smb devstack@keystone.service[81458]: *** Operational MODE: preforking *** Sep 19 14:40:26.080484 dv-cinder-756709-7-smb devstack@keystone.service[81458]: *** uWSGI is running in multiple interpreter mode *** Sep 19 14:40:26.080484 dv-cinder-756709-7-smb devstack@keystone.service[81458]: spawned uWSGI master process (pid: 81458) Sep 19 14:40:26.080753 dv-cinder-756709-7-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 19 14:40:26.083890 dv-cinder-756709-7-smb devstack@keystone.service[81458]: spawned uWSGI worker 1 (pid: 81471, cores: 1) Sep 19 14:40:26.083890 dv-cinder-756709-7-smb devstack@keystone.service[81458]: spawned uWSGI worker 2 (pid: 81472, cores: 1) Sep 19 14:40:26.083890 dv-cinder-756709-7-smb devstack@keystone.service[81458]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 19 14:40:30.415624 dv-cinder-756709-7-smb devstack@keystone.service[81472]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 14:40:30.415624 dv-cinder-756709-7-smb devstack@keystone.service[81472]: from cryptography.utils import int_from_bytes Sep 19 14:40:30.416464 dv-cinder-756709-7-smb devstack@keystone.service[81471]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 14:40:30.416464 dv-cinder-756709-7-smb devstack@keystone.service[81471]: from cryptography.utils import int_from_bytes Sep 19 14:40:30.416876 dv-cinder-756709-7-smb devstack@keystone.service[81472]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 14:40:30.416876 dv-cinder-756709-7-smb devstack@keystone.service[81472]: from cryptography.utils import int_from_bytes Sep 19 14:40:30.416982 dv-cinder-756709-7-smb devstack@keystone.service[81471]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 14:40:30.416982 dv-cinder-756709-7-smb devstack@keystone.service[81471]: from cryptography.utils import int_from_bytes Sep 19 14:40:30.466882 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 19 14:40:30.467124 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 19 14:40:30.467213 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 19 14:40:30.467296 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 19 14:40:30.467367 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] command line args: [] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 19 14:40:30.467438 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] command line args: [] {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 19 14:40:30.467507 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 19 14:40:30.467570 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 19 14:40:30.467632 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ================================================================================ {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 19 14:40:30.467694 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ================================================================================ {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 19 14:40:30.467886 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] admin_token = **** {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:40:30.467984 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] admin_token = **** {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:40:30.468151 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] config_dir = [] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:40:30.468281 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] config_dir = [] {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:40:30.468364 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:40:30.468442 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:40:30.468511 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] config_source = [] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:40:30.468588 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] config_source = [] {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:40:30.468664 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] debug = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:40:30.468739 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] debug = True {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:40:30.468809 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:40:30.469102 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:40:30.469205 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:40:30.469267 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:40:30.469480 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:40:30.469583 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:40:30.469679 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:40:30.469781 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:40:30.469891 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:40:30.469986 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:40:30.470085 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] list_limit = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:40:30.470212 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] list_limit = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:40:30.470322 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] log_config_append = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:40:30.470432 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] log_config_append = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:40:30.470533 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:40:30.470627 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:40:30.470721 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] log_dir = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:40:30.470824 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] log_dir = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:40:30.471321 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] log_file = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:40:30.471462 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] log_file = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:40:30.471550 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:40:30.471702 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:40:30.471788 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:40:30.471902 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:40:30.471982 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:40:30.472052 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:40:30.472115 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:40:30.472246 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:40:30.472318 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:40:30.472404 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:40:30.472496 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:40:30.472619 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:40:30.472700 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:40:30.472820 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:40:30.472900 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:40:30.473062 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:40:30.473187 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:40:30.473302 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:40:30.473393 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:40:30.473555 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:40:30.473687 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:40:30.473766 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:40:30.473849 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:40:30.473975 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:40:30.474061 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:40:30.474248 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:40:30.474369 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:40:30.474500 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:40:30.474604 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:40:30.474775 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:40:30.475076 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.26/identity {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:40:30.475237 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] publish_errors = False {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:40:30.475344 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.26/identity {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:40:30.475425 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] publish_errors = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:40:30.475495 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:40:30.475617 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:40:30.475702 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:40:30.475874 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:40:30.476006 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:40:30.476083 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:40:30.476209 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:40:30.476310 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:40:30.476390 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:40:30.476460 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:40:30.476532 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] standard_threads = False {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:40:30.476730 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] standard_threads = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:40:30.476865 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:40:30.476944 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:40:30.477040 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:40:30.477204 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:40:30.477341 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:40:30.477421 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] use_journal = False {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:40:30.477547 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:40:30.477628 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] use_json = False {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:40:30.477698 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] use_journal = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:40:30.477766 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] use_stderr = False {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:40:30.477896 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] use_json = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:40:30.477972 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] use_syslog = False {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:40:30.478057 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] use_stderr = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:40:30.478057 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] use_syslog = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:40:30.478196 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:40:30.478265 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:40:30.478338 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.478488 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.478630 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.478710 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.478780 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.478973 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.479096 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.479182 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.479265 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.479450 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.479572 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.479649 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.479719 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.479926 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.480061 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.480142 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.480220 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.480399 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.480521 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.480597 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.480825 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.480967 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.481084 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.481157 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.481305 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.481437 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.481538 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.481622 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.481768 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.481849 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.482020 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.482100 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.482263 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.482344 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.482517 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.482601 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.482773 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.482853 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.483064 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.483141 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.483217 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.483287 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.483483 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.483571 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.483745 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.483824 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.483997 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.484076 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.484247 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.484336 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.484480 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.484561 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.484709 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.484789 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.484937 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.485050 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.485197 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.485275 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.485448 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.485527 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.485692 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.485782 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.485997 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.486109 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.486373 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.486462 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.486522 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.486589 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.486787 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.486868 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.487026 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.487106 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.487275 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.487365 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.487506 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.487585 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.487727 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.487807 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.487961 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.488043 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.488193 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.488268 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.488422 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.488496 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.488650 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.488804 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.488878 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.488946 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.489124 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.489203 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.489374 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.489464 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.489609 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.489685 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.489847 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.489922 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.490078 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.490164 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.490313 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.490389 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.490548 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.490624 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.490795 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.490878 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.491025 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.491100 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.491261 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.491337 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.491497 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.491586 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.491733 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.491809 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.492008 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.492132 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.492241 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.492339 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.492433 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.492536 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.492630 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.492724 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.492867 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.492971 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.493110 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.493187 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.493346 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.493436 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.493612 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.493700 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.493847 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.493923 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.494079 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.494159 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.494320 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.494404 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.494557 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.494635 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.494829 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.494909 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.495068 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.495145 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.495315 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.495394 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.495559 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.495673 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.495798 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.495881 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.496030 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.496119 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.496265 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.496341 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.496511 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.496628 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.496751 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.496829 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.497062 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.497150 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.497249 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.497325 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.497486 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.497565 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.497734 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.497811 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.497972 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.498051 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.498208 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.498286 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.498443 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.498523 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.498678 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.498755 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.498912 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.498991 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.499172 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.499252 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.499410 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.499487 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.499659 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.499737 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.499898 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.499972 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.500138 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.500221 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.500373 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.500447 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.500603 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.500686 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.500839 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.500924 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.501101 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.501193 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.501332 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.501414 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.501610 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.501717 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.501841 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.501969 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.502091 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.502211 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.502280 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.502449 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.502574 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.502697 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.502775 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.502939 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.503015 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.503193 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.503271 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.503438 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.503522 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.503700 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.503779 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.503940 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.504018 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.504161 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] auth.external = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.504250 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.504387 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.504466 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] auth.external = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.504639 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.504721 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.504903 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.504982 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.505170 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] auth.password = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.505252 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.505403 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] auth.token = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.505483 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] auth.password = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.505634 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] auth.token = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.505720 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.505869 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.505949 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.506113 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.506198 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.506344 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.506423 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.506588 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.506796 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.506883 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.506997 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.507078 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.507150 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.507271 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] credential.caching = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.507348 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.507508 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.507601 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] credential.caching = True {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.507758 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.507835 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.508005 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.508087 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.508251 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.508331 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.508495 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.508575 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.508728 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.508815 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.508967 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.509062 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.509241 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.509321 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.509499 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.509581 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.509743 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.509824 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.510000 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.510080 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.510289 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.510371 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.510540 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.510621 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.510780 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.510860 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.511038 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.511120 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.511275 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] federation.caching = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.511355 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.511515 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.511596 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] federation.caching = True {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.511755 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.511835 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.512001 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.512079 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.512232 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.512312 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.512469 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.512564 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.512959 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.513170 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.513248 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.513373 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.513450 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.513550 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.513627 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.513734 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.513811 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.513931 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.514014 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.514128 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.514203 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] identity.caching = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.514330 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.514405 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.514593 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] identity.caching = True {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.514674 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.514782 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.514859 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.514958 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.515036 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.515158 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.515276 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.515355 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.515513 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.515594 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.515754 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.515846 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.515999 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.516092 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.516252 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.516331 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.516486 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.516575 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.516734 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.516837 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.516937 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.517180 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.517257 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.517330 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.517465 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.517566 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.517749 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.517856 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.517953 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.518096 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.518242 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.518323 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.518516 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.518594 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.518759 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.518848 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.519000 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.519080 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.519233 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.519314 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.519474 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.519563 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.519706 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.519786 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.519942 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.520023 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.520180 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.520267 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.520419 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.520495 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.520660 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.520738 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.520890 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.520978 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.521159 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.521236 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.521406 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.521485 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.521642 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.521736 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.521881 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.521958 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.522125 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.522210 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.522356 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.522445 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.522595 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.522673 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.522824 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.522903 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.523057 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.523138 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.523292 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.523371 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.523531 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.523610 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.523770 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.523850 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.524008 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.524087 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.524246 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.524325 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.524501 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.524637 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.524878 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.524954 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.525149 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.525226 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.525350 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.525426 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.525605 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.525685 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.525847 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.525925 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.526087 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.526168 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.526324 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.526402 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.526554 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.user = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.526633 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.526789 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.user = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.526869 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.527033 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.527113 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.527268 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.527347 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.527516 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.527595 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.527764 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.527844 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.528013 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.528093 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.528248 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.528357 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.528478 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.528602 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.528713 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.528837 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.528948 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.529105 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.529212 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.529345 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.529445 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.529586 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.529676 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.529821 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.529927 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.530073 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.530173 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.530326 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.530411 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.530578 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.530657 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.530828 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.530908 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.531077 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.531166 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.531311 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.531391 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.531554 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.531633 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.531792 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.531881 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.532029 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.532107 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.532265 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.532344 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.532505 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.532595 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.532796 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.532880 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.533072 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.533145 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.533317 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.533398 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.533563 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.533635 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.533798 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.533877 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.534032 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.534119 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.534270 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.534348 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.534507 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.534585 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.534746 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.534835 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.534976 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.535052 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.535215 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.535296 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.535449 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.535536 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] resource.caching = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.535690 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.535767 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.535936 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] resource.caching = True {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.536016 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.536174 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.536261 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.536425 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.536542 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.536661 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.536738 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.536899 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.536984 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.537171 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.537250 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.537406 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.537482 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.537644 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.537803 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.537879 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.537948 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] role.caching = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.538107 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.538185 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] role.driver = sql {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.538337 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.538414 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] role.caching = True {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.538584 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] role.driver = sql {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.538660 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.538821 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.538899 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.539071 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.539150 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.539317 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.539394 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.539564 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.539648 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.539810 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.539890 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.540055 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.540131 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.540300 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.540379 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.540534 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.540613 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.540781 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.540858 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.541056 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.541138 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.541289 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.541368 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.541536 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.541612 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.541783 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.541984 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.542078 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.542219 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.542454 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.542531 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.542697 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.542777 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.542944 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.543021 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.543192 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.543270 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.543428 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.543514 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.543667 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.543747 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.543911 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.543992 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.544207 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.544306 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.544382 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.544453 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.544605 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.544683 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.544835 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.544921 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.545113 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.545194 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.545348 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.545425 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.545615 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.545704 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.545843 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.545919 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.546075 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.546152 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.546305 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.546395 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.546545 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] token.caching = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.546622 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.546780 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.546857 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.547026 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] token.caching = True {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.547117 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.547259 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.547336 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.547514 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.547654 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.547739 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.547826 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.547979 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.548069 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.548222 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.548314 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.548490 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.548632 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.548734 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.548803 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.548982 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.549120 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.549242 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.549333 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.549476 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.549583 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.549721 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.549828 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.550001 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.550087 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.550232 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.550318 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.550474 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.550574 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.550739 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.550817 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.550999 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.connection = **** {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.551085 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.551246 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.551324 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.551495 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.551572 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] database.connection = **** {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.551734 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.551810 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.551974 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.552052 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.552480 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.552620 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.552742 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.552819 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.552941 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.553040 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.553144 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.553260 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.553337 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.553451 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.553540 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.553614 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.553761 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.553840 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.553953 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.554032 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.554158 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.554236 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.554348 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.554424 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.554535 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.554610 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.555030 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.555107 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.555223 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.555300 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.555412 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.555412 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 19 14:40:30.555597 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.555597 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.555819 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:40:30.555997 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 19 14:40:30.585588 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:40:30.585776 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81471) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:40:30.585909 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81471) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:40:30.585985 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:40:30.586047 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:40:30.586163 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81471) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:40:30.594490 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:40:30.594598 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81471) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:40:30.624049 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:40:30.624306 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81471) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:40:30.624451 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:40:30.624535 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81471) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:40:30.678881 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:40:30.679785 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81471) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:40:30.729463 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:40:30.729683 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:40:30.730352 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81471) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:40:30.730594 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81471) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:40:30.890363 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81471) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:40:30.890573 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:40:30.890717 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81471) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:40:30.890801 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:40:30.890901 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81471) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:40:30.890978 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:40:30.891050 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81471) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:40:30.891165 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:40:30.891255 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81471) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:40:30.891410 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81471) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:40:30.891533 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:40:30.891614 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:40:30.915441 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81471) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:40:30.915635 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:40:30.915769 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81471) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:40:30.915879 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:40:30.915988 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81471) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:40:30.916075 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:40:30.916140 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81471) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:40:30.916204 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:40:30.916284 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81471) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:40:30.916353 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:40:30.916553 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81471) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:40:30.916947 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:40:30.917057 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81471) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:40:30.917203 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:40:30.928401 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:40:30.928557 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81471) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:40:30.941759 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:40:30.941933 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81471) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:40:30.942067 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:40:30.942170 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81471) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:40:30.942289 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:40:30.942370 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81471) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:40:30.942485 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:40:30.942562 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81471) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:40:30.942686 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:40:30.942765 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81471) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:40:30.942838 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:40:30.942909 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81471) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:40:30.942980 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:40:30.943059 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81471) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 14:40:30.959961 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:30.960140 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 19 14:40:30.960501 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:30.960701 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 19 14:40:30.960823 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:30.960977 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 19 14:40:30.961146 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:30.961238 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:30.961343 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:30.961552 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:30.961696 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 19 14:40:30.961830 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:30.961909 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:30.962012 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:30.962302 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:30.962560 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:30.971887 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:30.972172 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:30.972443 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:30.972725 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:30.973134 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:30.973421 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:30.973682 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:30.973971 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:30.979738 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:40:30.981089 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81471) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:40:30.982639 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:40:30.982927 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:30.983209 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:30.983493 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:30.983777 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:30.983989 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81471) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:40:30.984136 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:30.984262 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:30.984351 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:30.984545 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:30.984630 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:30.984820 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:30.984897 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:30.987796 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:30.987903 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:30.987903 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:30.988039 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:30.988106 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:30.988106 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:30.988106 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:30.988106 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:30.988106 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.008362 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.009883 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:40:31.010012 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.010187 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.011383 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81471) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:40:31.011680 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.014856 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:40:31.015140 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.015418 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.016524 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81471) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:40:31.016814 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.017193 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.022060 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:40:31.022353 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.023560 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81471) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:40:31.023854 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.028192 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:40:31.028496 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.028785 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.029103 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.029332 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.029651 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.029845 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81471) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:40:31.029970 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.030187 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.030361 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.030450 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.030708 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.030988 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.031268 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.031549 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.031802 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.045765 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.046049 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.047668 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.047943 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.050043 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:40:31.051986 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81471) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:40:31.053288 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.053588 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.055265 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.055566 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.057778 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:40:31.059792 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81471) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:40:31.061051 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:40:31.062926 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81471) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:40:31.064426 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.064724 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.065032 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.065321 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.065609 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.065895 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.066144 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.066449 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.066748 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.067026 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.067310 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.067594 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.081719 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:40:31.082015 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.082285 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.082549 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.083490 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81471) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:40:31.083784 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.084053 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.084318 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.089410 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.090933 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.091102 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.092463 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.092613 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.092739 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.094168 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.094447 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.095451 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:40:31.095745 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.096340 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.096625 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.097041 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.097525 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81471) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:40:31.097817 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.098109 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.098393 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.098780 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.108103 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:40:31.108389 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.108673 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.108956 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.109368 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.109647 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.109932 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.110045 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81471) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:40:31.110337 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.110621 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.110981 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.111366 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.111729 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.112049 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.125352 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:40:31.127528 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81471) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:40:31.128347 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:40:31.130467 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81471) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:40:31.131238 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.132694 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.133380 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.134174 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:40:31.134476 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.134866 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.134993 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.136336 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81471) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:40:31.136620 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.137141 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.141257 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.142827 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:40:31.143772 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.145241 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81471) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:40:31.145695 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.146086 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.146371 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.146646 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.148115 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.148573 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.148833 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.149141 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.154505 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:40:31.154793 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.155074 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.156948 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81471) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:40:31.157266 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.157547 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.161990 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:40:31.162272 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.162557 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.162833 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.163089 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.163381 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.163747 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.163946 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.164190 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.164473 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.164572 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81471) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 14:40:31.164745 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.164840 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.165015 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.165165 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.165298 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.165382 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.165569 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.165653 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.165941 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.166219 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.166489 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.166759 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.167036 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.167311 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.167589 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.167855 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.168137 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81471) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 14:40:31.199906 dv-cinder-756709-7-smb devstack@keystone.service[81472]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56248ba189c0 pid: 81472 (default app) Sep 19 14:40:31.202925 dv-cinder-756709-7-smb devstack@keystone.service[81471]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56248ba189c0 pid: 81471 (default app) Sep 19 14:40:31.203282 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d5fb7-b163-4ab3-b2c9-39c810d1f7ef None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:40:31.203572 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d5fb7-b163-4ab3-b2c9-39c810d1f7ef None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:40:31.203840 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d5fb7-b163-4ab3-b2c9-39c810d1f7ef None None] PATH_INFO: `/v3` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:40:31.208254 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1/1] 10.222.0.26 () {50 vars in 791 bytes} [Mon Sep 19 14:40:31 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:40:38.155401 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6df9e97-d390-47ba-a4f6-bc036a4470b7 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:40:38.156017 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6df9e97-d390-47ba-a4f6-bc036a4470b7 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:40:38.156017 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6df9e97-d390-47ba-a4f6-bc036a4470b7 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:40:38.161383 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1/2] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:40:38 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:40:38.167710 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b3781-1d9c-47be-9a74-13a67a587784 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:40:38.168445 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b3781-1d9c-47be-9a74-13a67a587784 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:40:38.168445 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b3781-1d9c-47be-9a74-13a67a587784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:40:38.240394 dv-cinder-756709-7-smb devstack@keystone.service[81472]: INFO dbcounter [None req-6c5b3781-1d9c-47be-9a74-13a67a587784 None None] Registered counter for database keystone Sep 19 14:40:38.261043 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG oslo_db.sqlalchemy.engines [None req-6c5b3781-1d9c-47be-9a74-13a67a587784 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81472) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 14:40:38.268297 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writer thread running {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 14:40:38.472286 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG passlib.handlers.bcrypt [None req-6c5b3781-1d9c-47be-9a74-13a67a587784 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81472) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 19 14:40:38.472700 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG passlib.handlers.bcrypt [None req-6c5b3781-1d9c-47be-9a74-13a67a587784 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81472) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 19 14:40:38.532224 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-6c5b3781-1d9c-47be-9a74-13a67a587784 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:40:38.534456 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-6c5b3781-1d9c-47be-9a74-13a67a587784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:40:38.672306 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 2/3] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:40:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 506 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 19 14:40:39.158305 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6df9e97-d390-47ba-a4f6-bc036a4470b7 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:40:39.228922 dv-cinder-756709-7-smb devstack@keystone.service[81471]: INFO dbcounter [None req-f6df9e97-d390-47ba-a4f6-bc036a4470b7 None None] Registered counter for database keystone Sep 19 14:40:39.251407 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG oslo_db.sqlalchemy.engines [None req-f6df9e97-d390-47ba-a4f6-bc036a4470b7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81471) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 14:40:39.258401 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writer thread running {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 14:40:39.377782 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6df9e97-d390-47ba-a4f6-bc036a4470b7 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:40:39.382557 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6c1e93-5c19-4194-ad3a-6b23fb8f4f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:40:39.383196 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c1e93-5c19-4194-ad3a-6b23fb8f4f25 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:40:39.383466 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c1e93-5c19-4194-ad3a-6b23fb8f4f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:40:39.383733 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c1e93-5c19-4194-ad3a-6b23fb8f4f25 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:40:39.392798 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6c1e93-5c19-4194-ad3a-6b23fb8f4f25 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:40:39.444062 dv-cinder-756709-7-smb devstack@keystone.service[81471]: WARNING keystone.common.rbac_enforcer.enforcer [None req-5a6c1e93-5c19-4194-ad3a-6b23fb8f4f25 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 19 14:40:39.444396 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6c1e93-5c19-4194-ad3a-6b23fb8f4f25 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:40:39.455626 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 2/4] 10.222.0.26 () {58 vars in 1324 bytes} [Mon Sep 19 14:40:39 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 19 14:40:39.462272 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5b3781-1d9c-47be-9a74-13a67a587784 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:40:39.489953 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5b3781-1d9c-47be-9a74-13a67a587784 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:40:39.496062 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef18bc6-253d-4fee-9ea7-f13de010104f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:40:39.497238 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef18bc6-253d-4fee-9ea7-f13de010104f admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:40:39.497516 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef18bc6-253d-4fee-9ea7-f13de010104f admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:40:39.497783 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef18bc6-253d-4fee-9ea7-f13de010104f admin admin] PATH_INFO: `/v3/projects/d638629494b04280b2ba0fc11da818cf` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:40:39.499534 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef18bc6-253d-4fee-9ea7-f13de010104f admin admin] RBAC: Authorizing `identity:get_project(project_id=d638629494b04280b2ba0fc11da818cf)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:40:39.552639 dv-cinder-756709-7-smb devstack@keystone.service[81472]: WARNING keystone.common.rbac_enforcer.enforcer [None req-eef18bc6-253d-4fee-9ea7-f13de010104f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 19 14:40:39.552851 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef18bc6-253d-4fee-9ea7-f13de010104f admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:40:39.557559 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 3/5] 10.222.0.26 () {56 vars in 1207 bytes} [Mon Sep 19 14:40:39 2022] GET /identity/v3/projects/d638629494b04280b2ba0fc11da818cf => generated 344 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:40:41.733996 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99595658-7858-4087-9951-1372b69c86be None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:40:41.734615 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99595658-7858-4087-9951-1372b69c86be None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:40:41.734615 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99595658-7858-4087-9951-1372b69c86be None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:40:41.739062 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 3/6] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:40:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:40:41.754155 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aa39cc-21bc-4139-b56e-932401e18597 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:40:41.754694 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aa39cc-21bc-4139-b56e-932401e18597 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:40:41.754694 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aa39cc-21bc-4139-b56e-932401e18597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:40:41.775787 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-66aa39cc-21bc-4139-b56e-932401e18597 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:40:41.777349 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-66aa39cc-21bc-4139-b56e-932401e18597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:40:41.785638 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 4/7] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:40:41 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 19 14:40:42.055037 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99595658-7858-4087-9951-1372b69c86be None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:40:42.069618 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99595658-7858-4087-9951-1372b69c86be None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:40:42.074487 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0578cffe-bc31-4ce4-94a7-821d47812067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:40:42.075132 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0578cffe-bc31-4ce4-94a7-821d47812067 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:40:42.075414 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0578cffe-bc31-4ce4-94a7-821d47812067 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:40:42.075667 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0578cffe-bc31-4ce4-94a7-821d47812067 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:40:42.083749 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0578cffe-bc31-4ce4-94a7-821d47812067 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:40:42.085569 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0578cffe-bc31-4ce4-94a7-821d47812067 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:40:42.094937 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 4/8] 10.222.0.26 () {58 vars in 1324 bytes} [Mon Sep 19 14:40:42 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 14:40:42.101512 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aa39cc-21bc-4139-b56e-932401e18597 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:40:42.111118 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aa39cc-21bc-4139-b56e-932401e18597 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:40:42.115979 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec422de-7b0a-4748-95f6-d04b046b9285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:40:42.116605 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec422de-7b0a-4748-95f6-d04b046b9285 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:40:42.116887 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec422de-7b0a-4748-95f6-d04b046b9285 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:40:42.117185 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec422de-7b0a-4748-95f6-d04b046b9285 admin admin] PATH_INFO: `/v3/users/cc650418ff744a178289e14fefc617d5` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:40:42.118550 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec422de-7b0a-4748-95f6-d04b046b9285 admin admin] RBAC: Authorizing `identity:get_user(user_id=cc650418ff744a178289e14fefc617d5)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:40:42.120383 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec422de-7b0a-4748-95f6-d04b046b9285 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:40:42.121951 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 5/9] 10.222.0.26 () {56 vars in 1198 bytes} [Mon Sep 19 14:40:42 2022] GET /identity/v3/users/cc650418ff744a178289e14fefc617d5 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:40:44.350231 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4820a00-8a36-4900-bad1-29eb7a792090 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:40:44.350829 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4820a00-8a36-4900-bad1-29eb7a792090 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:40:44.350958 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4820a00-8a36-4900-bad1-29eb7a792090 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:40:44.353377 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 5/10] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:40:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:40:44.361264 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae05a654-a457-4ab6-97fd-57330de2361a None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:40:44.361770 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae05a654-a457-4ab6-97fd-57330de2361a None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:40:44.361770 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae05a654-a457-4ab6-97fd-57330de2361a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:40:44.381199 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-ae05a654-a457-4ab6-97fd-57330de2361a None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:40:44.382379 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ae05a654-a457-4ab6-97fd-57330de2361a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:40:44.401540 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f25140-0cd5-40f1-835b-8a099dffd102 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:40:44.401775 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f25140-0cd5-40f1-835b-8a099dffd102 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:40:44.402074 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f25140-0cd5-40f1-835b-8a099dffd102 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:40:44.403458 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 6/11] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:40:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:40:44.410100 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559bda15-2039-44ed-ac02-dc93d11e77fb None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:40:44.410525 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559bda15-2039-44ed-ac02-dc93d11e77fb None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:40:44.412772 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559bda15-2039-44ed-ac02-dc93d11e77fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:40:44.456300 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG passlib.handlers.bcrypt [None req-559bda15-2039-44ed-ac02-dc93d11e77fb None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81471) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 19 14:40:44.456717 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG passlib.handlers.bcrypt [None req-559bda15-2039-44ed-ac02-dc93d11e77fb None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81471) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 19 14:40:44.473407 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 6/12] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:40:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:40:44.505783 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-559bda15-2039-44ed-ac02-dc93d11e77fb None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:40:44.507453 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-559bda15-2039-44ed-ac02-dc93d11e77fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:40:44.612433 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 7/13] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:40:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 14:40:44.741364 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae05a654-a457-4ab6-97fd-57330de2361a None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:40:44.766104 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:40:44.863014 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae05a654-a457-4ab6-97fd-57330de2361a None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:40:44.883098 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559bda15-2039-44ed-ac02-dc93d11e77fb None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:40:44.898092 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b422a2-9090-4ccc-8661-60feef7c2327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:40:44.898736 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b422a2-9090-4ccc-8661-60feef7c2327 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:40:44.899021 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b422a2-9090-4ccc-8661-60feef7c2327 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:40:44.899289 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b422a2-9090-4ccc-8661-60feef7c2327 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:40:44.913582 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b422a2-9090-4ccc-8661-60feef7c2327 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:40:44.922474 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-67b422a2-9090-4ccc-8661-60feef7c2327 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:40:44.922474 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:40:44.922474 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:40:44.922474 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:40:44.922474 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:40:44.922474 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:40:44.922474 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:40:44.922474 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:40:44.922474 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:40:44.922474 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:40:44.922474 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:40:44.922474 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:40:44.922474 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:40:44.922474 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:40:44.922474 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:40:44.922474 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:40:44.923494 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:40:44.923494 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:40:44.923494 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:40:44.923494 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:40:44.923494 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:40:44.923494 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:40:44.923494 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:40:44.923494 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:40:44.923494 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:40:44.923494 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:40:44.923494 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:40:44.923494 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:40:44.923494 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:40:44.923494 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:40:44.923494 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:40:44.923494 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:40:44.924313 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:40:44.924313 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:40:44.924313 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:40:44.924313 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:40:44.924313 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:40:44.924313 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:40:44.924313 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:40:44.924313 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:40:44.924313 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:40:44.924313 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:40:44.924313 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:40:44.924313 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:40:44.924313 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 7/14] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 19 14:40:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:40:44.930120 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b422a2-9090-4ccc-8661-60feef7c2327 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:40:44.988483 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559bda15-2039-44ed-ac02-dc93d11e77fb None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:40:44.990996 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:40:45.015555 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:40:45.027837 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a21efba-18af-49fa-910c-8fce2163961c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:40:45.028738 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21efba-18af-49fa-910c-8fce2163961c None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:40:45.029027 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21efba-18af-49fa-910c-8fce2163961c None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:40:45.029305 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21efba-18af-49fa-910c-8fce2163961c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:40:45.035012 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b422a2-9090-4ccc-8661-60feef7c2327 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:40:45.070465 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74bc9cd-46ae-4124-96a0-f234cb744064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:40:45.071079 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74bc9cd-46ae-4124-96a0-f234cb744064 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:40:45.071370 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74bc9cd-46ae-4124-96a0-f234cb744064 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:40:45.071627 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74bc9cd-46ae-4124-96a0-f234cb744064 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:40:45.072289 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74bc9cd-46ae-4124-96a0-f234cb744064 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:40:45.072567 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74bc9cd-46ae-4124-96a0-f234cb744064 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:40:45.074024 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74bc9cd-46ae-4124-96a0-f234cb744064 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:40:45.086883 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 8/15] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 19 14:40:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:40:45.092700 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74bc9cd-46ae-4124-96a0-f234cb744064 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:40:45.097811 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a21efba-18af-49fa-910c-8fce2163961c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:40:45.099352 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a21efba-18af-49fa-910c-8fce2163961c None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:40:45.200933 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74bc9cd-46ae-4124-96a0-f234cb744064 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:40:45.209459 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 8/16] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 19 14:40:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:40:45.215521 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a21efba-18af-49fa-910c-8fce2163961c None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:40:45.218890 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:40:45.242761 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130d0f8d-2af6-43e2-8a8d-070dce74caa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:40:45.243512 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d0f8d-2af6-43e2-8a8d-070dce74caa0 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:40:45.243720 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d0f8d-2af6-43e2-8a8d-070dce74caa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:40:45.243995 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d0f8d-2af6-43e2-8a8d-070dce74caa0 None admin] PATH_INFO: `/v3/users/cc650418ff744a178289e14fefc617d5` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:40:45.245177 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130d0f8d-2af6-43e2-8a8d-070dce74caa0 None admin] RBAC: Authorizing `identity:get_user(user_id=cc650418ff744a178289e14fefc617d5)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:40:45.246665 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130d0f8d-2af6-43e2-8a8d-070dce74caa0 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:40:45.248294 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 9/17] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 19 14:40:45 2022] GET /identity/v3/users/cc650418ff744a178289e14fefc617d5 => generated 247 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:40:45.254392 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130d0f8d-2af6-43e2-8a8d-070dce74caa0 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:40:45.271926 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:40:45.328790 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a21efba-18af-49fa-910c-8fce2163961c None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:40:45.365956 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130d0f8d-2af6-43e2-8a8d-070dce74caa0 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:40:45.366538 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025732c1-9a31-4ca8-b703-0f9f80f1f152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:40:45.367192 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025732c1-9a31-4ca8-b703-0f9f80f1f152 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:40:45.367530 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025732c1-9a31-4ca8-b703-0f9f80f1f152 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:40:45.367801 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025732c1-9a31-4ca8-b703-0f9f80f1f152 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:40:45.393967 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025732c1-9a31-4ca8-b703-0f9f80f1f152 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:40:45.395473 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025732c1-9a31-4ca8-b703-0f9f80f1f152 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:40:45.412055 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10abaf2d-c590-41e2-9c3c-cf4a28bd1555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:40:45.412691 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10abaf2d-c590-41e2-9c3c-cf4a28bd1555 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:40:45.412967 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10abaf2d-c590-41e2-9c3c-cf4a28bd1555 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:40:45.413270 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10abaf2d-c590-41e2-9c3c-cf4a28bd1555 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:40:45.414425 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10abaf2d-c590-41e2-9c3c-cf4a28bd1555 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:40:45.415739 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-025732c1-9a31-4ca8-b703-0f9f80f1f152 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:40:45.415739 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:40:45.415739 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:40:45.415739 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:40:45.415739 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:40:45.415739 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:40:45.415739 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:40:45.415739 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:40:45.415739 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:40:45.415739 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:40:45.415739 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:40:45.415739 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:40:45.415739 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:40:45.415739 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:40:45.415739 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:40:45.415739 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:40:45.416654 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:40:45.416654 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:40:45.416654 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:40:45.416654 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:40:45.416654 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:40:45.416654 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:40:45.416654 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:40:45.416654 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:40:45.416654 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:40:45.416654 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:40:45.416654 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:40:45.416654 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:40:45.416654 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:40:45.416654 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:40:45.416654 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:40:45.416654 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:40:45.416654 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:40:45.417470 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:40:45.417470 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:40:45.417470 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:40:45.417637 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10abaf2d-c590-41e2-9c3c-cf4a28bd1555 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:40:45.417702 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 9/18] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:40:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:40:45.417762 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 10/19] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:40:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:40:45.424477 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10abaf2d-c590-41e2-9c3c-cf4a28bd1555 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:40:45.424655 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025732c1-9a31-4ca8-b703-0f9f80f1f152 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:40:45.491618 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:40:45.515151 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:40:45.535582 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10abaf2d-c590-41e2-9c3c-cf4a28bd1555 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:40:45.542700 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025732c1-9a31-4ca8-b703-0f9f80f1f152 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:40:45.576657 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7e4386-3740-40f9-8a82-af39540e0f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:40:45.577472 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7e4386-3740-40f9-8a82-af39540e0f06 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:40:45.577852 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7e4386-3740-40f9-8a82-af39540e0f06 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:40:45.578227 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7e4386-3740-40f9-8a82-af39540e0f06 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:40:45.579651 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7e4386-3740-40f9-8a82-af39540e0f06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:40:45.579966 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7e4386-3740-40f9-8a82-af39540e0f06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:40:45.581377 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d90bf22-c3cd-4177-b60e-4facc3b33474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:40:45.581506 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7e4386-3740-40f9-8a82-af39540e0f06 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:40:45.581992 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d90bf22-c3cd-4177-b60e-4facc3b33474 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:40:45.582272 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d90bf22-c3cd-4177-b60e-4facc3b33474 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:40:45.582555 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d90bf22-c3cd-4177-b60e-4facc3b33474 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:40:45.583275 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d90bf22-c3cd-4177-b60e-4facc3b33474 None admin] RBAC: Adding query filter params (role.id=019bde1756cb40de8ce06cef6b261f79, scope.domain.id=default, user.id=cc650418ff744a178289e14fefc617d5) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:40:45.583581 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d90bf22-c3cd-4177-b60e-4facc3b33474 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:40:45.585085 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d90bf22-c3cd-4177-b60e-4facc3b33474 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:40:45.594682 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 10/20] 10.222.0.26 () {56 vars in 1322 bytes} [Mon Sep 19 14:40:45 2022] GET /identity/v3/role_assignments?user.id=cc650418ff744a178289e14fefc617d5&scope.domain.id=default&role.id=019bde1756cb40de8ce06cef6b261f79 => generated 233 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:40:45.601357 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 11/21] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 19 14:40:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:40:48.145815 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a857a66-b58c-46db-b365-45922366ada1 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:40:48.146853 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a857a66-b58c-46db-b365-45922366ada1 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:40:48.147333 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a857a66-b58c-46db-b365-45922366ada1 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:40:48.148890 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 11/22] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:40:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:40:48.154761 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff1459b-c4f6-4468-904d-beb896415004 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:40:48.155623 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff1459b-c4f6-4468-904d-beb896415004 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:40:48.156079 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff1459b-c4f6-4468-904d-beb896415004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:40:48.186058 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-9ff1459b-c4f6-4468-904d-beb896415004 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:40:48.187638 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-9ff1459b-c4f6-4468-904d-beb896415004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:40:48.278058 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 12/23] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:40:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:40:48.303509 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b861f6a-4989-41f7-ad44-2832f4e8bb1c None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:40:48.304158 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b861f6a-4989-41f7-ad44-2832f4e8bb1c None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:40:48.304617 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b861f6a-4989-41f7-ad44-2832f4e8bb1c None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:40:48.306234 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 12/24] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:40:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:40:48.312016 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db16290b-2381-41bf-8b41-456d3d3ed4a4 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:40:48.312575 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db16290b-2381-41bf-8b41-456d3d3ed4a4 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:40:48.313150 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db16290b-2381-41bf-8b41-456d3d3ed4a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:40:48.341889 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-db16290b-2381-41bf-8b41-456d3d3ed4a4 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:40:48.343435 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-db16290b-2381-41bf-8b41-456d3d3ed4a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:40:48.451675 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:40:48.457143 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 13/25] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:40:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:40:48.745934 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506fcb02-0919-4408-8f75-1ef6e80fbd96 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:40:48.746637 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506fcb02-0919-4408-8f75-1ef6e80fbd96 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:40:48.747102 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506fcb02-0919-4408-8f75-1ef6e80fbd96 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:40:48.748877 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 13/26] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:40:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:40:48.754805 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da826b-0f91-4e2d-b297-73a14cf083af None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:40:48.755329 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da826b-0f91-4e2d-b297-73a14cf083af None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:40:48.755787 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da826b-0f91-4e2d-b297-73a14cf083af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:40:48.760075 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506fcb02-0919-4408-8f75-1ef6e80fbd96 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:40:48.793503 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-d6da826b-0f91-4e2d-b297-73a14cf083af None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:40:48.796062 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d6da826b-0f91-4e2d-b297-73a14cf083af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:40:48.929429 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506fcb02-0919-4408-8f75-1ef6e80fbd96 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:40:48.938251 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 14/27] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:40:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:40:48.940104 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b101a-3e89-4a60-a4ba-096228774a53 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:40:48.940560 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b101a-3e89-4a60-a4ba-096228774a53 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:40:48.941049 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b101a-3e89-4a60-a4ba-096228774a53 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:40:48.942485 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 15/28] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:40:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:40:48.943339 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37b101a-3e89-4a60-a4ba-096228774a53 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:40:48.952800 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:40:48.970021 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc060ef4-f058-46df-848c-7751a4cc2ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:40:48.971288 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc060ef4-f058-46df-848c-7751a4cc2ec7 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:40:48.971724 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc060ef4-f058-46df-848c-7751a4cc2ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:40:48.978109 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc060ef4-f058-46df-848c-7751a4cc2ec7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:40:49.005690 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc060ef4-f058-46df-848c-7751a4cc2ec7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:40:49.012494 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-fc060ef4-f058-46df-848c-7751a4cc2ec7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:40:49.012494 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:40:49.012494 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:40:49.012494 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:40:49.012494 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:40:49.012494 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:40:49.012494 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:40:49.012494 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:40:49.012494 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:40:49.012494 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:40:49.012494 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:40:49.012494 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:40:49.012494 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:40:49.012494 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:40:49.012494 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:40:49.012494 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:40:49.013368 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:40:49.013368 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:40:49.013368 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:40:49.013368 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:40:49.013368 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:40:49.013368 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:40:49.013368 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:40:49.013368 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:40:49.013368 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:40:49.013368 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:40:49.013368 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:40:49.013368 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:40:49.013368 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:40:49.013368 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:40:49.013368 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:40:49.013368 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:40:49.014110 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:40:49.014110 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:40:49.014110 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:40:49.014110 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:40:49.014110 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:40:49.014110 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:40:49.014110 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:40:49.014110 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:40:49.014110 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:40:49.014110 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:40:49.014110 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:40:49.014110 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:40:49.014110 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 14/29] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 19 14:40:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:40:49.021060 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c7e03-cf37-4196-a180-932252a48531 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:40:49.021060 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c7e03-cf37-4196-a180-932252a48531 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:40:49.021060 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c7e03-cf37-4196-a180-932252a48531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:40:49.057123 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-3d1c7e03-cf37-4196-a180-932252a48531 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:40:49.058346 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-3d1c7e03-cf37-4196-a180-932252a48531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:40:49.101963 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37b101a-3e89-4a60-a4ba-096228774a53 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:40:49.161395 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:40:49.170606 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8692a49-b501-446c-baa7-56d838d47e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:40:49.171253 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8692a49-b501-446c-baa7-56d838d47e04 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:40:49.171528 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8692a49-b501-446c-baa7-56d838d47e04 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:40:49.171795 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8692a49-b501-446c-baa7-56d838d47e04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:40:49.186944 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 15/30] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:40:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:40:49.188566 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1c7e03-cf37-4196-a180-932252a48531 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:40:49.199980 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8692a49-b501-446c-baa7-56d838d47e04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:40:49.201536 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8692a49-b501-446c-baa7-56d838d47e04 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:40:49.243554 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-e8692a49-b501-446c-baa7-56d838d47e04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:40:49.243554 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:40:49.243554 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:40:49.243554 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:40:49.243554 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:40:49.243554 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:40:49.243554 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:40:49.243554 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:40:49.243554 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:40:49.243554 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:40:49.243554 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:40:49.243554 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:40:49.243554 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:40:49.243554 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:40:49.243554 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:40:49.243554 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:40:49.244545 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:40:49.244545 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:40:49.244545 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:40:49.244545 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:40:49.244545 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:40:49.244545 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:40:49.244545 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:40:49.244545 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:40:49.244545 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:40:49.244545 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:40:49.244545 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:40:49.244545 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:40:49.244545 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:40:49.244545 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:40:49.244545 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:40:49.244545 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:40:49.244545 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:40:49.245352 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:40:49.245352 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:40:49.245352 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:40:49.253078 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 16/31] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:40:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:40:49.254000 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8692a49-b501-446c-baa7-56d838d47e04 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:40:49.355525 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1c7e03-cf37-4196-a180-932252a48531 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:40:49.368048 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:40:49.372420 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8692a49-b501-446c-baa7-56d838d47e04 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:40:49.394506 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7b81d1-767e-467d-9fda-a9db5be66238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:40:49.395553 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7b81d1-767e-467d-9fda-a9db5be66238 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:40:49.396063 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7b81d1-767e-467d-9fda-a9db5be66238 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:40:49.396542 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7b81d1-767e-467d-9fda-a9db5be66238 None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:40:49.397497 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7b81d1-767e-467d-9fda-a9db5be66238 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:40:49.398030 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7b81d1-767e-467d-9fda-a9db5be66238 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:40:49.399619 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7b81d1-767e-467d-9fda-a9db5be66238 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:40:49.413318 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 16/32] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 19 14:40:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:40:49.414565 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7b81d1-767e-467d-9fda-a9db5be66238 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:40:49.471926 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f154e7-7973-4ccc-83a2-29793660fb96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:40:49.472554 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f154e7-7973-4ccc-83a2-29793660fb96 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:40:49.472834 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f154e7-7973-4ccc-83a2-29793660fb96 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:40:49.473129 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f154e7-7973-4ccc-83a2-29793660fb96 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:40:49.473793 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f154e7-7973-4ccc-83a2-29793660fb96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:40:49.474096 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f154e7-7973-4ccc-83a2-29793660fb96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:40:49.475605 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f154e7-7973-4ccc-83a2-29793660fb96 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:40:49.503278 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 17/33] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 19 14:40:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:40:49.504164 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f154e7-7973-4ccc-83a2-29793660fb96 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:40:49.529525 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7b81d1-767e-467d-9fda-a9db5be66238 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:40:49.566671 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2935b923-74e9-4df1-bb88-0f27e3e5766e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:40:49.567672 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935b923-74e9-4df1-bb88-0f27e3e5766e None admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:40:49.568171 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935b923-74e9-4df1-bb88-0f27e3e5766e None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:40:49.568626 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935b923-74e9-4df1-bb88-0f27e3e5766e None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:40:49.569523 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2935b923-74e9-4df1-bb88-0f27e3e5766e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:40:49.571394 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2935b923-74e9-4df1-bb88-0f27e3e5766e None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:40:49.597550 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:40:49.667453 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f154e7-7973-4ccc-83a2-29793660fb96 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:40:49.703075 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e93f1bc-9271-4136-b159-8c7e3ec17e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:40:49.703771 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e93f1bc-9271-4136-b159-8c7e3ec17e94 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:40:49.704050 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e93f1bc-9271-4136-b159-8c7e3ec17e94 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:40:49.704336 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e93f1bc-9271-4136-b159-8c7e3ec17e94 None admin] PATH_INFO: `/v3/users/cc650418ff744a178289e14fefc617d5` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:40:49.705499 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e93f1bc-9271-4136-b159-8c7e3ec17e94 None admin] RBAC: Authorizing `identity:get_user(user_id=cc650418ff744a178289e14fefc617d5)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:40:49.706972 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e93f1bc-9271-4136-b159-8c7e3ec17e94 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:40:49.713157 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 18/34] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 19 14:40:49 2022] GET /identity/v3/users/cc650418ff744a178289e14fefc617d5 => generated 247 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:40:49.713157 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e93f1bc-9271-4136-b159-8c7e3ec17e94 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:40:49.723982 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 17/35] 10.222.0.26 () {60 vars in 1131 bytes} [Mon Sep 19 14:40:49 2022] POST /identity/v3/roles => generated 219 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:40:49.725646 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2133aa2f-d264-41c5-9412-0fb13a995423 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:40:49.725934 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2133aa2f-d264-41c5-9412-0fb13a995423 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:40:49.726213 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2133aa2f-d264-41c5-9412-0fb13a995423 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:40:49.727633 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 18/36] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:40:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:40:49.728244 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2133aa2f-d264-41c5-9412-0fb13a995423 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:40:49.769098 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:40:49.855828 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2133aa2f-d264-41c5-9412-0fb13a995423 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:40:49.876040 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e93f1bc-9271-4136-b159-8c7e3ec17e94 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:40:49.889181 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:40:49.900644 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376cf2b3-9f3b-464d-ae88-fcb0d2a6493c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:40:49.901338 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376cf2b3-9f3b-464d-ae88-fcb0d2a6493c None admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:40:49.901724 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376cf2b3-9f3b-464d-ae88-fcb0d2a6493c None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:40:49.902737 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376cf2b3-9f3b-464d-ae88-fcb0d2a6493c None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:40:49.903526 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376cf2b3-9f3b-464d-ae88-fcb0d2a6493c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:40:49.905638 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376cf2b3-9f3b-464d-ae88-fcb0d2a6493c None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:40:49.918646 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19a4c9b-a00c-421b-8d61-f7928df743ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:40:49.919266 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19a4c9b-a00c-421b-8d61-f7928df743ba None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:40:49.919550 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19a4c9b-a00c-421b-8d61-f7928df743ba None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:40:49.919828 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19a4c9b-a00c-421b-8d61-f7928df743ba None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:40:49.920487 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19a4c9b-a00c-421b-8d61-f7928df743ba None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:40:49.922005 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19a4c9b-a00c-421b-8d61-f7928df743ba None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:40:49.929417 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 19/37] 10.222.0.26 () {60 vars in 1131 bytes} [Mon Sep 19 14:40:49 2022] POST /identity/v3/roles => generated 225 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:40:49.930257 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376cf2b3-9f3b-464d-ae88-fcb0d2a6493c None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:40:50.072157 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:40:50.089475 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376cf2b3-9f3b-464d-ae88-fcb0d2a6493c None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:40:50.114983 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 19/38] 10.222.0.26 () {60 vars in 1141 bytes} [Mon Sep 19 14:40:49 2022] POST /identity/v3/projects => generated 301 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:40:50.116655 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d971d9-74e2-4470-a8db-0b8230fcd490 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:40:50.117368 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d971d9-74e2-4470-a8db-0b8230fcd490 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:40:50.117368 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d971d9-74e2-4470-a8db-0b8230fcd490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:40:50.155913 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e0b518-826c-4d98-a3aa-70eebb0f32c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:40:50.157863 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e0b518-826c-4d98-a3aa-70eebb0f32c1 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:40:50.158781 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e0b518-826c-4d98-a3aa-70eebb0f32c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:40:50.159245 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e0b518-826c-4d98-a3aa-70eebb0f32c1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:40:50.162338 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e0b518-826c-4d98-a3aa-70eebb0f32c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:40:50.164321 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e0b518-826c-4d98-a3aa-70eebb0f32c1 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:40:50.166687 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 20/39] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:40:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:40:50.168725 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bea964-6760-4799-9f76-03d31eaf7371 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:40:50.169731 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bea964-6760-4799-9f76-03d31eaf7371 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:40:50.170512 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bea964-6760-4799-9f76-03d31eaf7371 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:40:50.173769 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 21/40] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:40:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:40:50.175902 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bea964-6760-4799-9f76-03d31eaf7371 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:40:50.259583 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-e1d971d9-74e2-4470-a8db-0b8230fcd490 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:40:50.261239 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e1d971d9-74e2-4470-a8db-0b8230fcd490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:40:50.307881 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bea964-6760-4799-9f76-03d31eaf7371 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:40:50.338391 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 20/41] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:40:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:40:50.339629 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bc135a-8d4a-4426-99ba-1662b31344d9 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:40:50.340024 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bc135a-8d4a-4426-99ba-1662b31344d9 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:40:50.340298 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bc135a-8d4a-4426-99ba-1662b31344d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:40:50.350727 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffccdb6-f7c6-406b-8670-084f61845d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:40:50.351390 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffccdb6-f7c6-406b-8670-084f61845d29 None admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:40:50.351666 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffccdb6-f7c6-406b-8670-084f61845d29 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:40:50.351938 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffccdb6-f7c6-406b-8670-084f61845d29 None admin] PATH_INFO: `/v3/domains/default/users/cc650418ff744a178289e14fefc617d5/roles/019bde1756cb40de8ce06cef6b261f79` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:40:50.354140 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffccdb6-f7c6-406b-8670-084f61845d29 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=cc650418ff744a178289e14fefc617d5, role_id=019bde1756cb40de8ce06cef6b261f79)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:40:50.356356 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffccdb6-f7c6-406b-8670-084f61845d29 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:40:50.364947 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-63bc135a-8d4a-4426-99ba-1662b31344d9 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:40:50.366195 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-63bc135a-8d4a-4426-99ba-1662b31344d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:40:50.372305 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 22/42] 10.222.0.26 () {58 vars in 1361 bytes} [Mon Sep 19 14:40:50 2022] PUT /identity/v3/domains/default/users/cc650418ff744a178289e14fefc617d5/roles/019bde1756cb40de8ce06cef6b261f79 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:40:50.451609 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 21/43] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:40:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:40:50.628663 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffccdb6-f7c6-406b-8670-084f61845d29 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:40:50.651768 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:40:50.717618 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bc135a-8d4a-4426-99ba-1662b31344d9 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:40:50.737524 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffccdb6-f7c6-406b-8670-084f61845d29 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:40:50.746673 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:40:50.773303 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0421f8d2-3756-4049-a3d6-0e46b686b2cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:40:50.773922 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421f8d2-3756-4049-a3d6-0e46b686b2cd None admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:40:50.774205 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421f8d2-3756-4049-a3d6-0e46b686b2cd None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:40:50.774479 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421f8d2-3756-4049-a3d6-0e46b686b2cd None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:40:50.775169 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0421f8d2-3756-4049-a3d6-0e46b686b2cd None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:40:50.776563 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0421f8d2-3756-4049-a3d6-0e46b686b2cd None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:40:50.798347 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 23/44] 10.222.0.26 () {60 vars in 1131 bytes} [Mon Sep 19 14:40:50 2022] POST /identity/v3/roles => generated 223 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:40:50.844362 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bc135a-8d4a-4426-99ba-1662b31344d9 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:40:50.886287 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ffb396-b865-4d7b-aad3-092bd98e3c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:40:50.886972 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ffb396-b865-4d7b-aad3-092bd98e3c49 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:40:50.887250 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ffb396-b865-4d7b-aad3-092bd98e3c49 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:40:50.887518 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ffb396-b865-4d7b-aad3-092bd98e3c49 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:40:50.888716 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ffb396-b865-4d7b-aad3-092bd98e3c49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:40:50.890393 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ffb396-b865-4d7b-aad3-092bd98e3c49 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:40:50.892488 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 22/45] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:40:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:40:50.898472 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0421f8d2-3756-4049-a3d6-0e46b686b2cd None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:40:50.996855 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:40:51.018029 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0421f8d2-3756-4049-a3d6-0e46b686b2cd None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:40:51.053393 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d90838e-1fa8-4cff-ac67-b9396e4b81d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:40:51.054019 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d90838e-1fa8-4cff-ac67-b9396e4b81d0 None admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:40:51.054296 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d90838e-1fa8-4cff-ac67-b9396e4b81d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:40:51.054565 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d90838e-1fa8-4cff-ac67-b9396e4b81d0 None admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:40:51.055232 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d90838e-1fa8-4cff-ac67-b9396e4b81d0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:40:51.056682 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d90838e-1fa8-4cff-ac67-b9396e4b81d0 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:40:51.087356 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 24/46] 10.222.0.26 () {60 vars in 1141 bytes} [Mon Sep 19 14:40:50 2022] POST /identity/v3/projects => generated 312 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:40:52.563622 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47320488-3762-4e69-a673-506806bf6fb0 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:40:52.564147 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47320488-3762-4e69-a673-506806bf6fb0 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:40:52.564147 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47320488-3762-4e69-a673-506806bf6fb0 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:40:52.565605 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 23/47] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:40:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:40:52.572063 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c928d797-ba03-4244-a693-84de17822180 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:40:52.572501 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c928d797-ba03-4244-a693-84de17822180 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:40:52.572611 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c928d797-ba03-4244-a693-84de17822180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:40:52.592055 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-c928d797-ba03-4244-a693-84de17822180 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:40:52.593616 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-c928d797-ba03-4244-a693-84de17822180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:40:52.664568 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 25/48] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:40:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:40:52.927134 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47320488-3762-4e69-a673-506806bf6fb0 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:40:53.030653 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:40:53.042930 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47320488-3762-4e69-a673-506806bf6fb0 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:40:53.079040 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9210eb46-9331-461e-8060-698a75655d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:40:53.079665 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9210eb46-9331-461e-8060-698a75655d4e None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:40:53.079939 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9210eb46-9331-461e-8060-698a75655d4e None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:40:53.080209 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9210eb46-9331-461e-8060-698a75655d4e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:40:53.091462 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9210eb46-9331-461e-8060-698a75655d4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:40:53.096693 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-9210eb46-9331-461e-8060-698a75655d4e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:40:53.096693 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:40:53.096693 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:40:53.096693 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:40:53.096693 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:40:53.096693 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:40:53.096693 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:40:53.096693 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:40:53.096693 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:40:53.096693 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:40:53.096693 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:40:53.096693 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:40:53.096693 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:40:53.096693 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:40:53.096693 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:40:53.096693 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:40:53.097783 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:40:53.097783 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:40:53.097783 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:40:53.097783 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:40:53.097783 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:40:53.097783 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:40:53.097783 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:40:53.097783 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:40:53.097783 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:40:53.097783 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:40:53.097783 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:40:53.097783 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:40:53.097783 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:40:53.097783 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:40:53.097783 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:40:53.097783 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:40:53.101950 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:40:53.101950 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:40:53.101950 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:40:53.101950 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:40:53.101950 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:40:53.101950 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:40:53.101950 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:40:53.101950 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:40:53.101950 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:40:53.101950 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:40:53.101950 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:40:53.101950 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:40:53.101950 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 24/49] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 19 14:40:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:40:53.103950 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c928d797-ba03-4244-a693-84de17822180 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:40:53.173054 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:40:53.213842 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c928d797-ba03-4244-a693-84de17822180 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:40:53.242985 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d02145-98c4-499d-9756-7e52f8d45bed None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:40:53.243216 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d02145-98c4-499d-9756-7e52f8d45bed None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:40:53.243484 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d02145-98c4-499d-9756-7e52f8d45bed None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:40:53.244838 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 25/50] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:40:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:40:53.249261 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a802b3a-0d9f-464a-b7b0-406d5dc6fcad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:40:53.249879 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acca6bab-345a-40cb-9023-77f956c549a2 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:40:53.249988 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a802b3a-0d9f-464a-b7b0-406d5dc6fcad None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:40:53.250248 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a802b3a-0d9f-464a-b7b0-406d5dc6fcad None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:40:53.250343 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acca6bab-345a-40cb-9023-77f956c549a2 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:40:53.250541 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acca6bab-345a-40cb-9023-77f956c549a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:40:53.251098 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a802b3a-0d9f-464a-b7b0-406d5dc6fcad None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:40:53.251790 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a802b3a-0d9f-464a-b7b0-406d5dc6fcad None admin] RBAC: Adding query filter params (name=admin) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:40:53.252101 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a802b3a-0d9f-464a-b7b0-406d5dc6fcad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:40:53.253517 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a802b3a-0d9f-464a-b7b0-406d5dc6fcad None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:40:53.261875 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 26/51] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 19 14:40:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:40:53.267718 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a802b3a-0d9f-464a-b7b0-406d5dc6fcad None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:40:53.268857 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-acca6bab-345a-40cb-9023-77f956c549a2 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:40:53.270070 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-acca6bab-345a-40cb-9023-77f956c549a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:40:53.336872 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 26/52] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:40:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:40:53.367554 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a802b3a-0d9f-464a-b7b0-406d5dc6fcad None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:40:53.389612 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:40:53.400741 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e55d855-519b-413b-b0aa-f85824c511cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:40:53.401412 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55d855-519b-413b-b0aa-f85824c511cd None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:40:53.401694 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55d855-519b-413b-b0aa-f85824c511cd None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:40:53.401966 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55d855-519b-413b-b0aa-f85824c511cd None admin] PATH_INFO: `/v3/users/cc650418ff744a178289e14fefc617d5` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:40:53.403163 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e55d855-519b-413b-b0aa-f85824c511cd None admin] RBAC: Authorizing `identity:get_user(user_id=cc650418ff744a178289e14fefc617d5)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:40:53.404617 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e55d855-519b-413b-b0aa-f85824c511cd None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:40:53.410858 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 27/53] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 19 14:40:53 2022] GET /identity/v3/users/cc650418ff744a178289e14fefc617d5 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:40:53.412167 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acca6bab-345a-40cb-9023-77f956c549a2 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:40:53.495874 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:40:53.515732 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acca6bab-345a-40cb-9023-77f956c549a2 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:40:53.551144 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6e56a2-90d8-4467-9682-3c60a66f26a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:40:53.551776 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6e56a2-90d8-4467-9682-3c60a66f26a7 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:40:53.552053 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6e56a2-90d8-4467-9682-3c60a66f26a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:40:53.552322 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6e56a2-90d8-4467-9682-3c60a66f26a7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:40:53.553493 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6e56a2-90d8-4467-9682-3c60a66f26a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:40:53.554956 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6e56a2-90d8-4467-9682-3c60a66f26a7 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:40:53.556524 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 27/54] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:40:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:40:53.562711 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e55d855-519b-413b-b0aa-f85824c511cd None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:40:53.602196 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6e56a2-90d8-4467-9682-3c60a66f26a7 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:40:53.670119 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e55d855-519b-413b-b0aa-f85824c511cd None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:40:53.704641 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6e56a2-90d8-4467-9682-3c60a66f26a7 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:40:53.705538 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba38d49-d1e5-4578-9ec3-da7f65e15647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:40:53.706145 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba38d49-d1e5-4578-9ec3-da7f65e15647 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:40:53.706430 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba38d49-d1e5-4578-9ec3-da7f65e15647 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:40:53.706716 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba38d49-d1e5-4578-9ec3-da7f65e15647 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:40:53.707456 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba38d49-d1e5-4578-9ec3-da7f65e15647 None admin] RBAC: Adding query filter params (role.id=019bde1756cb40de8ce06cef6b261f79, scope.domain.id=default, user.id=cc650418ff744a178289e14fefc617d5) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:40:53.707764 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba38d49-d1e5-4578-9ec3-da7f65e15647 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:40:53.709321 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba38d49-d1e5-4578-9ec3-da7f65e15647 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:40:53.715403 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 28/55] 10.222.0.26 () {56 vars in 1322 bytes} [Mon Sep 19 14:40:53 2022] GET /identity/v3/role_assignments?user.id=cc650418ff744a178289e14fefc617d5&scope.domain.id=default&role.id=019bde1756cb40de8ce06cef6b261f79 => generated 530 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:40:53.741477 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92898314-350e-499f-80ca-599351372a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:40:53.742424 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92898314-350e-499f-80ca-599351372a0e None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:40:53.742424 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92898314-350e-499f-80ca-599351372a0e None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:40:53.742688 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92898314-350e-499f-80ca-599351372a0e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:40:53.743945 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92898314-350e-499f-80ca-599351372a0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:40:53.745500 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92898314-350e-499f-80ca-599351372a0e None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:40:53.747273 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 28/56] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:40:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:40:53.753582 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba38d49-d1e5-4578-9ec3-da7f65e15647 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:40:53.936381 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:40:53.987592 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba38d49-d1e5-4578-9ec3-da7f65e15647 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:40:54.022803 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfd494d-17e2-476f-89db-d6df4c6b4507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:40:54.023420 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd494d-17e2-476f-89db-d6df4c6b4507 None admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:40:54.023702 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd494d-17e2-476f-89db-d6df4c6b4507 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:40:54.023974 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd494d-17e2-476f-89db-d6df4c6b4507 None admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:40:54.024622 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfd494d-17e2-476f-89db-d6df4c6b4507 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:40:54.026107 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfd494d-17e2-476f-89db-d6df4c6b4507 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:40:54.052574 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 29/57] 10.222.0.26 () {60 vars in 1140 bytes} [Mon Sep 19 14:40:53 2022] POST /identity/v3/projects => generated 298 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:40:56.232714 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd17f0c-6d55-4f44-ad51-c92ec2881ae2 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:40:56.233268 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd17f0c-6d55-4f44-ad51-c92ec2881ae2 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:40:56.233268 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd17f0c-6d55-4f44-ad51-c92ec2881ae2 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:40:56.234931 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 29/58] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:40:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:40:56.240522 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4b175c-3696-46b1-861d-b456cf52a0d4 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:40:56.240910 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4b175c-3696-46b1-861d-b456cf52a0d4 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:40:56.241087 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4b175c-3696-46b1-861d-b456cf52a0d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:40:56.261342 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-db4b175c-3696-46b1-861d-b456cf52a0d4 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:40:56.262992 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-db4b175c-3696-46b1-861d-b456cf52a0d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:40:56.345892 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 30/59] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:40:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:40:56.616090 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd17f0c-6d55-4f44-ad51-c92ec2881ae2 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:40:56.636166 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:40:56.726199 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd17f0c-6d55-4f44-ad51-c92ec2881ae2 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:40:56.760973 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb377ed-18ca-4991-9760-205fc57666fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:40:56.761633 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb377ed-18ca-4991-9760-205fc57666fa None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:40:56.761917 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb377ed-18ca-4991-9760-205fc57666fa None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:40:56.762189 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb377ed-18ca-4991-9760-205fc57666fa None admin] PATH_INFO: `/v3/domains/default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:40:56.763350 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb377ed-18ca-4991-9760-205fc57666fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:40:56.764814 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb377ed-18ca-4991-9760-205fc57666fa None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:40:56.766546 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 30/60] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:40:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:40:56.772483 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4b175c-3696-46b1-861d-b456cf52a0d4 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:40:56.812421 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:40:56.874165 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4b175c-3696-46b1-861d-b456cf52a0d4 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:40:56.910217 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6557ad0-ecd6-4c8e-adb0-34795ad8b05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:40:56.910829 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6557ad0-ecd6-4c8e-adb0-34795ad8b05d None admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:40:56.911113 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6557ad0-ecd6-4c8e-adb0-34795ad8b05d None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:40:56.911392 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6557ad0-ecd6-4c8e-adb0-34795ad8b05d None admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:40:56.912040 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6557ad0-ecd6-4c8e-adb0-34795ad8b05d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:40:56.913534 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6557ad0-ecd6-4c8e-adb0-34795ad8b05d None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:40:56.942033 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 31/61] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Sep 19 14:40:56 2022] POST /identity/v3/users => generated 275 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:41:00.361939 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c1612-6928-4af0-b2fc-746dc8ec0e36 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:00.362923 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c1612-6928-4af0-b2fc-746dc8ec0e36 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:00.363411 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c1612-6928-4af0-b2fc-746dc8ec0e36 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:00.364950 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 31/62] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:41:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 14:41:00.370512 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d7a1d8-3ab5-4e0d-9f17-277ef5aef8ef None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:00.371313 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d7a1d8-3ab5-4e0d-9f17-277ef5aef8ef None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:00.371773 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d7a1d8-3ab5-4e0d-9f17-277ef5aef8ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:00.397995 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-27d7a1d8-3ab5-4e0d-9f17-277ef5aef8ef None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:41:00.399518 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-27d7a1d8-3ab5-4e0d-9f17-277ef5aef8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:41:00.427850 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3e567b-a571-46e7-9a0f-db9e5ad350bc None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:00.428454 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3e567b-a571-46e7-9a0f-db9e5ad350bc None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:00.428913 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3e567b-a571-46e7-9a0f-db9e5ad350bc None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:00.430494 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 32/63] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:41:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:41:00.436674 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4815c671-7d72-4430-ab73-ba10355d7f21 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:00.437399 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4815c671-7d72-4430-ab73-ba10355d7f21 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:00.438040 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4815c671-7d72-4430-ab73-ba10355d7f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:00.472125 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-4815c671-7d72-4430-ab73-ba10355d7f21 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:41:00.478214 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-4815c671-7d72-4430-ab73-ba10355d7f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:41:00.511034 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 32/64] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:41:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 14:41:00.512653 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6842bb5b-9783-4eb3-b5f2-fc976919e40d None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:00.517236 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6842bb5b-9783-4eb3-b5f2-fc976919e40d None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:00.517780 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6842bb5b-9783-4eb3-b5f2-fc976919e40d None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:00.519963 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 33/65] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:41:00 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:41:00.531265 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc16fcd-f5e1-477a-b84e-2397df5df05d None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:00.531921 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc16fcd-f5e1-477a-b84e-2397df5df05d None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:00.532565 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc16fcd-f5e1-477a-b84e-2397df5df05d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:00.566538 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-2cc16fcd-f5e1-477a-b84e-2397df5df05d None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:41:00.569437 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-2cc16fcd-f5e1-477a-b84e-2397df5df05d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:41:00.605554 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:00.612447 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 33/66] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:41:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 14:41:00.679918 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 34/67] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:41:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:41:00.927959 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b6c7b-4f87-4fd6-a9c4-afc2c344e94b None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:00.928638 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b6c7b-4f87-4fd6-a9c4-afc2c344e94b None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:00.929188 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b6c7b-4f87-4fd6-a9c4-afc2c344e94b None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:00.930985 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 34/68] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:41:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:41:00.936116 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6162b62b-7ac0-4a6c-a28d-df8f62313a32 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:00.936624 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6162b62b-7ac0-4a6c-a28d-df8f62313a32 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:00.937152 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6162b62b-7ac0-4a6c-a28d-df8f62313a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:00.962360 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-6162b62b-7ac0-4a6c-a28d-df8f62313a32 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:41:00.963928 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-6162b62b-7ac0-4a6c-a28d-df8f62313a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:41:00.970631 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0b6c7b-4f87-4fd6-a9c4-afc2c344e94b None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:00.999991 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:01.051824 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 35/69] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:41:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:41:01.053014 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6162b62b-7ac0-4a6c-a28d-df8f62313a32 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:01.107019 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0b6c7b-4f87-4fd6-a9c4-afc2c344e94b None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:01.143092 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6685025e-9d7d-421c-a371-ce8e7683b471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:01.143732 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685025e-9d7d-421c-a371-ce8e7683b471 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:01.144010 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685025e-9d7d-421c-a371-ce8e7683b471 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:01.144311 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685025e-9d7d-421c-a371-ce8e7683b471 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:01.154957 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6685025e-9d7d-421c-a371-ce8e7683b471 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:41:01.155154 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:01.160817 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-6685025e-9d7d-421c-a371-ce8e7683b471 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:41:01.160817 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:41:01.160817 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:41:01.160817 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:41:01.160817 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:41:01.160817 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:41:01.160817 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:41:01.160817 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:41:01.160817 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:41:01.160817 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:41:01.160817 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:41:01.160817 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:41:01.160817 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:41:01.160817 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:41:01.160817 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:41:01.160817 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:41:01.161864 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:41:01.161864 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:41:01.161864 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:41:01.161864 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:41:01.161864 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:41:01.161864 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:41:01.161864 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:41:01.161864 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:41:01.161864 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:41:01.161864 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:41:01.161864 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:41:01.161864 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:41:01.161864 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:41:01.161864 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:41:01.161864 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:41:01.161864 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:41:01.162740 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:41:01.162740 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:41:01.162740 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:41:01.162740 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:41:01.162740 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:41:01.162740 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:41:01.162740 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:41:01.162740 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:41:01.162740 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:41:01.162740 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:41:01.162740 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:41:01.162740 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:41:01.162740 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 35/70] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 19 14:41:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:41:01.163452 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6685025e-9d7d-421c-a371-ce8e7683b471 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:01.176883 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6162b62b-7ac0-4a6c-a28d-df8f62313a32 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:01.211111 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55a5292-c2f8-42ce-8196-7d7978dce5a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:01.211655 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a5292-c2f8-42ce-8196-7d7978dce5a4 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:01.211936 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a5292-c2f8-42ce-8196-7d7978dce5a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:01.212203 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a5292-c2f8-42ce-8196-7d7978dce5a4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:01.223347 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55a5292-c2f8-42ce-8196-7d7978dce5a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:41:01.228153 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-f55a5292-c2f8-42ce-8196-7d7978dce5a4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 14:41:01.228153 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:41:01.228153 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:41:01.228153 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:41:01.228153 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:41:01.228153 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:41:01.228153 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:41:01.228153 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:41:01.228153 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:41:01.228153 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:41:01.228153 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:41:01.228153 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:41:01.228153 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:41:01.228153 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:41:01.228153 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:41:01.228153 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:41:01.228971 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:41:01.228971 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:41:01.228971 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:41:01.228971 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:41:01.228971 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:41:01.228971 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:41:01.228971 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:41:01.228971 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:41:01.228971 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:41:01.228971 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:41:01.228971 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:41:01.228971 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:41:01.228971 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:41:01.228971 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:41:01.228971 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:41:01.228971 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:41:01.230571 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:41:01.230571 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:41:01.230571 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:41:01.230571 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:41:01.230571 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:41:01.230571 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:41:01.230571 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:41:01.230571 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:41:01.230571 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:41:01.230571 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:41:01.230571 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 14:41:01.230571 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:41:01.230571 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 36/71] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Sep 19 14:41:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:41:01.235138 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e1777-875f-4582-971c-e3b6c9119f29 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:01.235419 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e1777-875f-4582-971c-e3b6c9119f29 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:01.235698 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e1777-875f-4582-971c-e3b6c9119f29 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:01.237180 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 37/72] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:41:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:41:01.242192 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465e1777-875f-4582-971c-e3b6c9119f29 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:01.259893 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:01.289082 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6685025e-9d7d-421c-a371-ce8e7683b471 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:01.331709 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7802f925-2ed4-4a45-b992-11f885a71c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:01.332343 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7802f925-2ed4-4a45-b992-11f885a71c7e None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:01.332624 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7802f925-2ed4-4a45-b992-11f885a71c7e None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:01.332896 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7802f925-2ed4-4a45-b992-11f885a71c7e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:01.344120 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7802f925-2ed4-4a45-b992-11f885a71c7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:41:01.349328 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-7802f925-2ed4-4a45-b992-11f885a71c7e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:41:01.349328 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:41:01.349328 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:41:01.349328 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:41:01.349328 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:41:01.349328 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:41:01.349328 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:41:01.349328 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:41:01.349328 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:41:01.349328 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:41:01.349328 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:41:01.349328 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:41:01.349328 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:41:01.349328 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:41:01.349328 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:41:01.349328 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:41:01.350156 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:41:01.350156 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:41:01.350156 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:41:01.350156 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:41:01.350156 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:41:01.350156 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:41:01.350156 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:41:01.350156 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:41:01.350156 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:41:01.350156 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:41:01.350156 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:41:01.350156 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:41:01.350156 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:41:01.350156 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:41:01.350156 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:41:01.350156 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:41:01.350958 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:41:01.350958 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:41:01.350958 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:41:01.350958 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:41:01.350958 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:41:01.350958 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:41:01.350958 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:41:01.350958 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:41:01.350958 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:41:01.350958 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:41:01.350958 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:41:01.350958 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:41:01.350958 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 36/73] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 19 14:41:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:41:01.351573 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7802f925-2ed4-4a45-b992-11f885a71c7e None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:01.357515 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465e1777-875f-4582-971c-e3b6c9119f29 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:01.396558 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4abf9c-1a4d-4056-befb-439641d6f8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:01.397247 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4abf9c-1a4d-4056-befb-439641d6f8a5 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:01.397453 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4abf9c-1a4d-4056-befb-439641d6f8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:01.397720 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4abf9c-1a4d-4056-befb-439641d6f8a5 None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:01.398381 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4abf9c-1a4d-4056-befb-439641d6f8a5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:41:01.398679 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4abf9c-1a4d-4056-befb-439641d6f8a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:01.400059 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4abf9c-1a4d-4056-befb-439641d6f8a5 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:01.409208 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 38/74] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Sep 19 14:41:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:01.410515 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936dae0-4cbd-4d66-87bd-ce240d959618 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:01.410808 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936dae0-4cbd-4d66-87bd-ce240d959618 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:01.411075 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936dae0-4cbd-4d66-87bd-ce240d959618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:01.429922 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:01.436120 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-7936dae0-4cbd-4d66-87bd-ce240d959618 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:41:01.437573 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-7936dae0-4cbd-4d66-87bd-ce240d959618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:41:01.464888 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7802f925-2ed4-4a45-b992-11f885a71c7e None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:01.501103 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631654ef-063c-4979-ad66-2ddfea32abf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:01.501711 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631654ef-063c-4979-ad66-2ddfea32abf0 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:01.501992 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631654ef-063c-4979-ad66-2ddfea32abf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:01.502265 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631654ef-063c-4979-ad66-2ddfea32abf0 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:01.502931 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631654ef-063c-4979-ad66-2ddfea32abf0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:41:01.503237 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631654ef-063c-4979-ad66-2ddfea32abf0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:01.504639 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 39/75] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:41:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:41:01.504732 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631654ef-063c-4979-ad66-2ddfea32abf0 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:01.505511 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7936dae0-4cbd-4d66-87bd-ce240d959618 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:01.506193 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:01.524955 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 37/76] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 19 14:41:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:01.525724 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631654ef-063c-4979-ad66-2ddfea32abf0 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:01.620403 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7936dae0-4cbd-4d66-87bd-ce240d959618 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:01.637563 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631654ef-063c-4979-ad66-2ddfea32abf0 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:01.659637 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c640f4a0-1467-4821-9f85-080ae4ad56a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:01.660270 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640f4a0-1467-4821-9f85-080ae4ad56a6 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:01.660554 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640f4a0-1467-4821-9f85-080ae4ad56a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:01.660823 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640f4a0-1467-4821-9f85-080ae4ad56a6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:01.661972 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c640f4a0-1467-4821-9f85-080ae4ad56a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:01.663512 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c640f4a0-1467-4821-9f85-080ae4ad56a6 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:01.665109 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 40/77] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:41:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:01.665863 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c640f4a0-1467-4821-9f85-080ae4ad56a6 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:01.671248 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:01.682254 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474632fe-fe57-4f55-be3d-4b434e7518bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:01.682870 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474632fe-fe57-4f55-be3d-4b434e7518bd None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:01.683143 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474632fe-fe57-4f55-be3d-4b434e7518bd None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:01.683414 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474632fe-fe57-4f55-be3d-4b434e7518bd None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:01.684071 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474632fe-fe57-4f55-be3d-4b434e7518bd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:41:01.684373 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474632fe-fe57-4f55-be3d-4b434e7518bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:01.685766 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474632fe-fe57-4f55-be3d-4b434e7518bd None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:01.698690 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 38/78] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 19 14:41:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:01.698690 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474632fe-fe57-4f55-be3d-4b434e7518bd None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:01.753789 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:01.777972 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c640f4a0-1467-4821-9f85-080ae4ad56a6 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:01.800276 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474632fe-fe57-4f55-be3d-4b434e7518bd None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:01.814358 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142e8881-4cce-4403-9bb6-5ac206c81f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:01.815125 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142e8881-4cce-4403-9bb6-5ac206c81f99 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:01.815399 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142e8881-4cce-4403-9bb6-5ac206c81f99 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:01.815665 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142e8881-4cce-4403-9bb6-5ac206c81f99 None admin] PATH_INFO: `/v3/users/5238072e01b240dbb2f0ada386bb22c4` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:01.831246 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142e8881-4cce-4403-9bb6-5ac206c81f99 None admin] RBAC: Authorizing `identity:get_user(user_id=5238072e01b240dbb2f0ada386bb22c4)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:01.832722 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142e8881-4cce-4403-9bb6-5ac206c81f99 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:01.834132 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efa8597-fa24-4271-95e7-5966cb65d872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:01.839329 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 41/79] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 19 14:41:01 2022] GET /identity/v3/users/5238072e01b240dbb2f0ada386bb22c4 => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:01.839458 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efa8597-fa24-4271-95e7-5966cb65d872 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:01.839458 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efa8597-fa24-4271-95e7-5966cb65d872 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:01.839634 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142e8881-4cce-4403-9bb6-5ac206c81f99 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:01.839711 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efa8597-fa24-4271-95e7-5966cb65d872 None admin] PATH_INFO: `/v3/users/5238072e01b240dbb2f0ada386bb22c4` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:01.840559 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efa8597-fa24-4271-95e7-5966cb65d872 None admin] RBAC: Authorizing `identity:get_user(user_id=5238072e01b240dbb2f0ada386bb22c4)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:01.842131 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efa8597-fa24-4271-95e7-5966cb65d872 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:01.848493 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 39/80] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 19 14:41:01 2022] GET /identity/v3/users/5238072e01b240dbb2f0ada386bb22c4 => generated 275 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:01.848493 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efa8597-fa24-4271-95e7-5966cb65d872 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:01.909187 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:01.950900 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efa8597-fa24-4271-95e7-5966cb65d872 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:01.951228 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142e8881-4cce-4403-9bb6-5ac206c81f99 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:01.976163 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:01.988728 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5197eb-d8a8-4ac5-b1b5-5135fae8a572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:01.989235 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c64500-b5ab-4437-bb25-68596fb1feec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:01.989422 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5197eb-d8a8-4ac5-b1b5-5135fae8a572 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:01.989681 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5197eb-d8a8-4ac5-b1b5-5135fae8a572 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:01.989882 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c64500-b5ab-4437-bb25-68596fb1feec None admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:01.989973 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5197eb-d8a8-4ac5-b1b5-5135fae8a572 None admin] PATH_INFO: `/v3/users/cc650418ff744a178289e14fefc617d5` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:01.990173 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c64500-b5ab-4437-bb25-68596fb1feec None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:01.990434 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c64500-b5ab-4437-bb25-68596fb1feec None admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:01.991107 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c64500-b5ab-4437-bb25-68596fb1feec None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:01.991222 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5197eb-d8a8-4ac5-b1b5-5135fae8a572 None admin] RBAC: Authorizing `identity:get_user(user_id=cc650418ff744a178289e14fefc617d5)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:01.992561 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c64500-b5ab-4437-bb25-68596fb1feec None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:01.992666 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5197eb-d8a8-4ac5-b1b5-5135fae8a572 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:01.995081 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 40/81] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 19 14:41:01 2022] GET /identity/v3/users/cc650418ff744a178289e14fefc617d5 => generated 247 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:01.995081 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5197eb-d8a8-4ac5-b1b5-5135fae8a572 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:02.016370 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 42/82] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Sep 19 14:41:01 2022] POST /identity/v3/users => generated 289 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:41:02.016962 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c64500-b5ab-4437-bb25-68596fb1feec None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:02.134622 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5197eb-d8a8-4ac5-b1b5-5135fae8a572 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:02.135117 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c64500-b5ab-4437-bb25-68596fb1feec None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:02.158255 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:02.174705 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48271ede-2af1-4e4d-b554-7b9362d6fd88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:02.175336 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48271ede-2af1-4e4d-b554-7b9362d6fd88 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:02.175616 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48271ede-2af1-4e4d-b554-7b9362d6fd88 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:02.175884 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48271ede-2af1-4e4d-b554-7b9362d6fd88 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:02.180760 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6903400e-0380-413d-9f18-aea4a7f2da9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:02.181673 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6903400e-0380-413d-9f18-aea4a7f2da9a None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:02.182092 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6903400e-0380-413d-9f18-aea4a7f2da9a None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:02.182500 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6903400e-0380-413d-9f18-aea4a7f2da9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:02.246662 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:02.259244 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48271ede-2af1-4e4d-b554-7b9362d6fd88 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:02.260738 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48271ede-2af1-4e4d-b554-7b9362d6fd88 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:02.270367 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6903400e-0380-413d-9f18-aea4a7f2da9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:02.272240 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6903400e-0380-413d-9f18-aea4a7f2da9a None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:02.386021 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 41/83] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 19 14:41:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:02.386687 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48271ede-2af1-4e4d-b554-7b9362d6fd88 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:02.401159 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 43/84] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 19 14:41:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:02.406164 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6903400e-0380-413d-9f18-aea4a7f2da9a None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:02.426132 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:02.514334 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:02.515169 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6903400e-0380-413d-9f18-aea4a7f2da9a None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:02.525052 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48271ede-2af1-4e4d-b554-7b9362d6fd88 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:02.552742 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373a5cfd-2e71-42a0-b9c8-1517632a0ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:02.553150 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373a5cfd-2e71-42a0-b9c8-1517632a0ab9 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:02.553392 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373a5cfd-2e71-42a0-b9c8-1517632a0ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:02.553666 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373a5cfd-2e71-42a0-b9c8-1517632a0ab9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:02.570375 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f76e429-1813-420e-9675-d0743aa813ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:02.571933 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f76e429-1813-420e-9675-d0743aa813ce None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:02.572510 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f76e429-1813-420e-9675-d0743aa813ce None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:02.572974 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f76e429-1813-420e-9675-d0743aa813ce None admin] PATH_INFO: `/v3/roles/member` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:02.588402 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f76e429-1813-420e-9675-d0743aa813ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:41:02.595513 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-6f76e429-1813-420e-9675-d0743aa813ce None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:41:02.595513 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:41:02.595513 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:41:02.595513 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:41:02.595513 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:41:02.595513 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:41:02.595513 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:41:02.595513 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:41:02.595513 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:41:02.595513 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:41:02.595513 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:41:02.595513 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:41:02.595513 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:41:02.595513 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:41:02.595513 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:41:02.595513 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:41:02.596382 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:41:02.596382 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:41:02.596382 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:41:02.596382 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:41:02.596382 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:41:02.596382 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:41:02.596382 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:41:02.596382 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:41:02.596382 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:41:02.596382 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:41:02.596382 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:41:02.596382 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:41:02.596382 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:41:02.596382 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:41:02.596382 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:41:02.596382 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:41:02.597136 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:41:02.597136 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:41:02.597136 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:41:02.597136 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:41:02.597136 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:41:02.597136 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:41:02.597136 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:41:02.597136 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:41:02.597136 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:41:02.597136 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:41:02.597136 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:41:02.597136 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:41:02.599896 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 42/85] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 19 14:41:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:41:02.601667 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f76e429-1813-420e-9675-d0743aa813ce None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:02.637056 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373a5cfd-2e71-42a0-b9c8-1517632a0ab9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:02.638549 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373a5cfd-2e71-42a0-b9c8-1517632a0ab9 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:02.659523 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:02.737544 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f76e429-1813-420e-9675-d0743aa813ce None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:02.745864 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 44/86] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 19 14:41:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:02.746835 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373a5cfd-2e71-42a0-b9c8-1517632a0ab9 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:02.793541 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752be952-8cc7-4808-a8a0-4ff907fa897a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:02.794534 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752be952-8cc7-4808-a8a0-4ff907fa897a None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:02.795007 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752be952-8cc7-4808-a8a0-4ff907fa897a None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:02.795471 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752be952-8cc7-4808-a8a0-4ff907fa897a None admin] PATH_INFO: `/v3/projects/ef8c601e5bc64c818990445d938bb592` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:02.797637 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752be952-8cc7-4808-a8a0-4ff907fa897a None admin] RBAC: Authorizing `identity:get_project(project_id=ef8c601e5bc64c818990445d938bb592)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:02.799825 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752be952-8cc7-4808-a8a0-4ff907fa897a None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:02.802410 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 43/87] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 19 14:41:02 2022] GET /identity/v3/projects/ef8c601e5bc64c818990445d938bb592 => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:02.804231 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752be952-8cc7-4808-a8a0-4ff907fa897a None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:02.831964 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:02.868813 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373a5cfd-2e71-42a0-b9c8-1517632a0ab9 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:02.888830 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:02.910488 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd39cbbe-c6fd-4ec7-9221-b9748184e5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:02.911680 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd39cbbe-c6fd-4ec7-9221-b9748184e5e3 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:02.912158 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd39cbbe-c6fd-4ec7-9221-b9748184e5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:02.912624 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd39cbbe-c6fd-4ec7-9221-b9748184e5e3 None admin] PATH_INFO: `/v3/projects/ef8c601e5bc64c818990445d938bb592` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:02.914507 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd39cbbe-c6fd-4ec7-9221-b9748184e5e3 None admin] RBAC: Authorizing `identity:get_project(project_id=ef8c601e5bc64c818990445d938bb592)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:02.916321 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd39cbbe-c6fd-4ec7-9221-b9748184e5e3 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:02.918585 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 45/88] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 19 14:41:02 2022] GET /identity/v3/projects/ef8c601e5bc64c818990445d938bb592 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:02.919756 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd39cbbe-c6fd-4ec7-9221-b9748184e5e3 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:02.921769 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752be952-8cc7-4808-a8a0-4ff907fa897a None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:02.963642 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d031a2-7e52-4e0c-9d31-2b422f74c193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:02.964252 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d031a2-7e52-4e0c-9d31-2b422f74c193 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:02.964533 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d031a2-7e52-4e0c-9d31-2b422f74c193 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:02.964899 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d031a2-7e52-4e0c-9d31-2b422f74c193 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:02.965919 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d031a2-7e52-4e0c-9d31-2b422f74c193 None admin] RBAC: Adding query filter params (name=member) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:41:02.965919 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d031a2-7e52-4e0c-9d31-2b422f74c193 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:02.967442 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d031a2-7e52-4e0c-9d31-2b422f74c193 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:02.978472 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 44/89] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Sep 19 14:41:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:02.979372 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d031a2-7e52-4e0c-9d31-2b422f74c193 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:03.046739 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd39cbbe-c6fd-4ec7-9221-b9748184e5e3 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:03.079218 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:03.087938 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c06835-cbd3-4408-9286-4687d3f9caf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:03.088863 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c06835-cbd3-4408-9286-4687d3f9caf6 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:03.089493 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c06835-cbd3-4408-9286-4687d3f9caf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:03.090047 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c06835-cbd3-4408-9286-4687d3f9caf6 None admin] PATH_INFO: `/v3/projects/ef8c601e5bc64c818990445d938bb592` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:03.091367 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c06835-cbd3-4408-9286-4687d3f9caf6 None admin] RBAC: Authorizing `identity:get_project(project_id=ef8c601e5bc64c818990445d938bb592)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:03.093404 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c06835-cbd3-4408-9286-4687d3f9caf6 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:03.095812 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 46/90] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 19 14:41:02 2022] GET /identity/v3/projects/ef8c601e5bc64c818990445d938bb592 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:03.096983 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c06835-cbd3-4408-9286-4687d3f9caf6 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:03.102025 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d031a2-7e52-4e0c-9d31-2b422f74c193 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:03.142969 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402d9812-b12b-40dc-a840-1446f73f2838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:03.143650 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d9812-b12b-40dc-a840-1446f73f2838 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:03.143931 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d9812-b12b-40dc-a840-1446f73f2838 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:03.144253 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d9812-b12b-40dc-a840-1446f73f2838 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:03.145028 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402d9812-b12b-40dc-a840-1446f73f2838 None admin] RBAC: Adding query filter params (role.id=74de6794e3b3422b93d26f993d260c35, scope.project.id=ef8c601e5bc64c818990445d938bb592, user.id=5238072e01b240dbb2f0ada386bb22c4) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:41:03.145350 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402d9812-b12b-40dc-a840-1446f73f2838 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:03.146923 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402d9812-b12b-40dc-a840-1446f73f2838 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:03.161335 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 45/91] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 19 14:41:02 2022] GET /identity/v3/role_assignments?user.id=5238072e01b240dbb2f0ada386bb22c4&scope.project.id=ef8c601e5bc64c818990445d938bb592&role.id=74de6794e3b3422b93d26f993d260c35 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:03.162367 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402d9812-b12b-40dc-a840-1446f73f2838 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:03.166573 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:03.241141 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c06835-cbd3-4408-9286-4687d3f9caf6 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:03.304399 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bedef8-c9b2-46c2-9019-6f68362ce1ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:03.305584 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bedef8-c9b2-46c2-9019-6f68362ce1ca None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:03.307309 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bedef8-c9b2-46c2-9019-6f68362ce1ca None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:03.308001 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bedef8-c9b2-46c2-9019-6f68362ce1ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:03.309629 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bedef8-c9b2-46c2-9019-6f68362ce1ca None admin] RBAC: Adding query filter params (role.id=ae7ed67e62684598a31185ab16c971ce, scope.project.id=ef8c601e5bc64c818990445d938bb592, user.id=5238072e01b240dbb2f0ada386bb22c4) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:41:03.310512 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bedef8-c9b2-46c2-9019-6f68362ce1ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:03.313517 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bedef8-c9b2-46c2-9019-6f68362ce1ca None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:03.326648 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 47/92] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 19 14:41:03 2022] GET /identity/v3/role_assignments?user.id=5238072e01b240dbb2f0ada386bb22c4&scope.project.id=ef8c601e5bc64c818990445d938bb592&role.id=ae7ed67e62684598a31185ab16c971ce => generated 259 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:03.329331 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bedef8-c9b2-46c2-9019-6f68362ce1ca None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:03.402716 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402d9812-b12b-40dc-a840-1446f73f2838 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:03.472923 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b36314-f4a8-41d7-99ac-f7704f53e10e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:03.474062 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b36314-f4a8-41d7-99ac-f7704f53e10e None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:03.474368 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b36314-f4a8-41d7-99ac-f7704f53e10e None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:03.475313 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b36314-f4a8-41d7-99ac-f7704f53e10e None admin] PATH_INFO: `/v3/users/5238072e01b240dbb2f0ada386bb22c4` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:03.479188 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b36314-f4a8-41d7-99ac-f7704f53e10e None admin] RBAC: Authorizing `identity:get_user(user_id=5238072e01b240dbb2f0ada386bb22c4)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:03.479732 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b36314-f4a8-41d7-99ac-f7704f53e10e None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:03.481782 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 46/93] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 19 14:41:03 2022] GET /identity/v3/users/5238072e01b240dbb2f0ada386bb22c4 => generated 275 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:03.490125 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b36314-f4a8-41d7-99ac-f7704f53e10e None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:03.540121 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:03.591332 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bedef8-c9b2-46c2-9019-6f68362ce1ca None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:03.634484 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:03.668158 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a31e3a-676e-4394-bb4e-53701ee0a89b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:03.668956 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a31e3a-676e-4394-bb4e-53701ee0a89b None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:03.669293 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a31e3a-676e-4394-bb4e-53701ee0a89b None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:03.669572 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a31e3a-676e-4394-bb4e-53701ee0a89b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:03.670319 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a31e3a-676e-4394-bb4e-53701ee0a89b None admin] RBAC: Adding query filter params (role.id=019bde1756cb40de8ce06cef6b261f79, scope.project.id=ef8c601e5bc64c818990445d938bb592, user.id=cc650418ff744a178289e14fefc617d5) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:41:03.670632 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a31e3a-676e-4394-bb4e-53701ee0a89b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:03.672377 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a31e3a-676e-4394-bb4e-53701ee0a89b None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:03.686714 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 48/94] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 19 14:41:03 2022] GET /identity/v3/role_assignments?user.id=cc650418ff744a178289e14fefc617d5&scope.project.id=ef8c601e5bc64c818990445d938bb592&role.id=019bde1756cb40de8ce06cef6b261f79 => generated 259 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:03.761355 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b36314-f4a8-41d7-99ac-f7704f53e10e None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:03.821423 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb761465-72ca-43c2-ba79-e8ce8102e63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:03.822407 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb761465-72ca-43c2-ba79-e8ce8102e63a None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:03.822880 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb761465-72ca-43c2-ba79-e8ce8102e63a None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:03.823341 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb761465-72ca-43c2-ba79-e8ce8102e63a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:03.926181 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb761465-72ca-43c2-ba79-e8ce8102e63a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:03.928180 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb761465-72ca-43c2-ba79-e8ce8102e63a None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:03.954007 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:04.071114 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 47/95] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 19 14:41:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 581 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:04.077166 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a31e3a-676e-4394-bb4e-53701ee0a89b None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:04.214340 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a31e3a-676e-4394-bb4e-53701ee0a89b None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:04.258566 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daf5c67-a1a8-42ad-8769-f2d4bb6e48e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:04.259207 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daf5c67-a1a8-42ad-8769-f2d4bb6e48e9 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:04.259486 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daf5c67-a1a8-42ad-8769-f2d4bb6e48e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:04.259756 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daf5c67-a1a8-42ad-8769-f2d4bb6e48e9 None admin] PATH_INFO: `/v3/projects/6097cde96e2c4a8cb4c8d8b1c5258e87` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:04.260894 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daf5c67-a1a8-42ad-8769-f2d4bb6e48e9 None admin] RBAC: Authorizing `identity:get_project(project_id=6097cde96e2c4a8cb4c8d8b1c5258e87)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:04.262378 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daf5c67-a1a8-42ad-8769-f2d4bb6e48e9 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:04.264046 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 49/96] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 19 14:41:04 2022] GET /identity/v3/projects/6097cde96e2c4a8cb4c8d8b1c5258e87 => generated 312 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:04.270242 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb761465-72ca-43c2-ba79-e8ce8102e63a None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:04.414910 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb761465-72ca-43c2-ba79-e8ce8102e63a None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:04.444916 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:04.467170 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef85c1e4-17e0-4342-a558-9dc3a2cc434d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:04.467699 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef85c1e4-17e0-4342-a558-9dc3a2cc434d None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:04.467977 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef85c1e4-17e0-4342-a558-9dc3a2cc434d None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:04.468288 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef85c1e4-17e0-4342-a558-9dc3a2cc434d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:04.470097 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef85c1e4-17e0-4342-a558-9dc3a2cc434d None admin] RBAC: Adding query filter params (role.id=74de6794e3b3422b93d26f993d260c35, scope.project.id=6097cde96e2c4a8cb4c8d8b1c5258e87, user.id=5238072e01b240dbb2f0ada386bb22c4) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:41:04.470411 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef85c1e4-17e0-4342-a558-9dc3a2cc434d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:04.471882 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef85c1e4-17e0-4342-a558-9dc3a2cc434d None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:04.478200 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 48/97] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 19 14:41:04 2022] GET /identity/v3/role_assignments?user.id=5238072e01b240dbb2f0ada386bb22c4&scope.project.id=6097cde96e2c4a8cb4c8d8b1c5258e87&role.id=74de6794e3b3422b93d26f993d260c35 => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:04.640290 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce44e0ac-faec-4195-8d01-0d75832a8975 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:04.640829 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce44e0ac-faec-4195-8d01-0d75832a8975 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:04.640829 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce44e0ac-faec-4195-8d01-0d75832a8975 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:04.642335 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 50/98] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:41:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:41:04.648103 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0239d6-2168-424a-a80b-8af6125ebc60 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:04.648549 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0239d6-2168-424a-a80b-8af6125ebc60 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:04.648743 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0239d6-2168-424a-a80b-8af6125ebc60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:04.677991 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-2a0239d6-2168-424a-a80b-8af6125ebc60 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:41:04.679358 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2a0239d6-2168-424a-a80b-8af6125ebc60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:41:04.761213 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 49/99] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:41:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:41:04.965605 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa5076a-c299-45cf-8a5c-19a06cca5845 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:04.966281 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa5076a-c299-45cf-8a5c-19a06cca5845 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:04.966790 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa5076a-c299-45cf-8a5c-19a06cca5845 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:04.968534 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 51/100] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:41:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:41:04.974513 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e6dcce-cd21-439d-8434-80cba379dfb6 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:04.975063 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e6dcce-cd21-439d-8434-80cba379dfb6 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:04.975556 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e6dcce-cd21-439d-8434-80cba379dfb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:05.004767 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-22e6dcce-cd21-439d-8434-80cba379dfb6 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:41:05.006272 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-22e6dcce-cd21-439d-8434-80cba379dfb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:41:05.107448 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 50/101] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:41:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:41:05.217577 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa5076a-c299-45cf-8a5c-19a06cca5845 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:05.285709 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:05.354694 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa5076a-c299-45cf-8a5c-19a06cca5845 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:05.401959 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe34a89-4927-44c5-96a6-f57ee2755a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:05.402605 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe34a89-4927-44c5-96a6-f57ee2755a2f None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:05.402890 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe34a89-4927-44c5-96a6-f57ee2755a2f None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:05.403159 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe34a89-4927-44c5-96a6-f57ee2755a2f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:05.422772 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe34a89-4927-44c5-96a6-f57ee2755a2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:41:05.427541 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-2fe34a89-4927-44c5-96a6-f57ee2755a2f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 14:41:05.427541 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:41:05.427541 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:41:05.427541 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:41:05.427541 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:41:05.427541 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:41:05.427541 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:41:05.427541 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:41:05.427541 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:41:05.427541 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:41:05.427541 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:41:05.427541 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:41:05.427541 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:41:05.427541 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:41:05.427541 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:41:05.427541 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:41:05.428464 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:41:05.428464 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:41:05.428464 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:41:05.428464 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:41:05.428464 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:41:05.428464 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:41:05.428464 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:41:05.428464 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:41:05.428464 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:41:05.428464 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:41:05.428464 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:41:05.428464 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:41:05.428464 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:41:05.428464 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:41:05.428464 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:41:05.428464 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:41:05.429256 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:41:05.429256 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:41:05.429256 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:41:05.429256 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:41:05.429256 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:41:05.429256 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:41:05.429256 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:41:05.429256 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:41:05.429256 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:41:05.429256 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:41:05.429256 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 14:41:05.429256 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:41:05.429256 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 52/102] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 19 14:41:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:41:05.435885 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e6dcce-cd21-439d-8434-80cba379dfb6 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:05.505696 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:05.575528 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e6dcce-cd21-439d-8434-80cba379dfb6 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:05.584155 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe34a89-4927-44c5-96a6-f57ee2755a2f None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:05.628187 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f985b438-463b-44dc-82c7-e29afef37147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:05.628811 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f985b438-463b-44dc-82c7-e29afef37147 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:05.629117 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f985b438-463b-44dc-82c7-e29afef37147 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:05.629394 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f985b438-463b-44dc-82c7-e29afef37147 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:05.630070 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f985b438-463b-44dc-82c7-e29afef37147 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:41:05.630683 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f985b438-463b-44dc-82c7-e29afef37147 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:05.632096 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f985b438-463b-44dc-82c7-e29afef37147 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:05.648390 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 51/103] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Sep 19 14:41:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:05.655812 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f985b438-463b-44dc-82c7-e29afef37147 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:05.743274 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe34a89-4927-44c5-96a6-f57ee2755a2f None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:05.763871 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:05.813936 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4e669e-4340-4c78-8c5e-24c8889f92de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:05.814605 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e669e-4340-4c78-8c5e-24c8889f92de None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:05.814950 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e669e-4340-4c78-8c5e-24c8889f92de None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:05.815226 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e669e-4340-4c78-8c5e-24c8889f92de None admin] PATH_INFO: `/v3/domains/default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:05.816405 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4e669e-4340-4c78-8c5e-24c8889f92de None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:05.817933 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4e669e-4340-4c78-8c5e-24c8889f92de None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:05.829415 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 53/104] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:41:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:05.843562 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4e669e-4340-4c78-8c5e-24c8889f92de None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:05.860076 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f985b438-463b-44dc-82c7-e29afef37147 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:05.861857 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:05.954271 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf327968-8d3e-47d4-9fdc-29b129f8fa9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:05.955224 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf327968-8d3e-47d4-9fdc-29b129f8fa9d None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:05.955466 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf327968-8d3e-47d4-9fdc-29b129f8fa9d None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:05.955842 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf327968-8d3e-47d4-9fdc-29b129f8fa9d None admin] PATH_INFO: `/v3/users/559bc742447647969944d2848f17f106` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:05.964851 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4e669e-4340-4c78-8c5e-24c8889f92de None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:05.979929 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf327968-8d3e-47d4-9fdc-29b129f8fa9d None admin] RBAC: Authorizing `identity:get_user(user_id=559bc742447647969944d2848f17f106)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:05.990522 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf327968-8d3e-47d4-9fdc-29b129f8fa9d None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:05.992920 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 52/105] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 19 14:41:05 2022] GET /identity/v3/users/559bc742447647969944d2848f17f106 => generated 289 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:41:06.003001 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf327968-8d3e-47d4-9fdc-29b129f8fa9d None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:06.009684 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ea3050-1c0c-462f-9bd4-fc6edc245bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:06.010885 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ea3050-1c0c-462f-9bd4-fc6edc245bda None admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:06.012322 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ea3050-1c0c-462f-9bd4-fc6edc245bda None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:06.012784 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ea3050-1c0c-462f-9bd4-fc6edc245bda None admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:06.017670 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ea3050-1c0c-462f-9bd4-fc6edc245bda None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:06.019431 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ea3050-1c0c-462f-9bd4-fc6edc245bda None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:06.089521 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 54/106] 10.222.0.26 () {60 vars in 1141 bytes} [Mon Sep 19 14:41:05 2022] POST /identity/v3/projects => generated 302 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 14:41:06.229244 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf327968-8d3e-47d4-9fdc-29b129f8fa9d None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:06.280129 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38e8200-28da-4e9c-810a-c7312ff9493a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:06.280820 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e8200-28da-4e9c-810a-c7312ff9493a None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:06.281609 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e8200-28da-4e9c-810a-c7312ff9493a None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:06.281609 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e8200-28da-4e9c-810a-c7312ff9493a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:06.320345 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:06.381061 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38e8200-28da-4e9c-810a-c7312ff9493a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:06.382588 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38e8200-28da-4e9c-810a-c7312ff9493a None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:06.517869 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 53/107] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 19 14:41:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:06.526395 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ea3050-1c0c-462f-9bd4-fc6edc245bda None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:06.576572 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:06.673231 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ea3050-1c0c-462f-9bd4-fc6edc245bda None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:06.716300 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6e9df7-a95d-4f61-b7ba-c6bdffe54f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:06.716948 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e9df7-a95d-4f61-b7ba-c6bdffe54f69 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:06.717258 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e9df7-a95d-4f61-b7ba-c6bdffe54f69 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:06.717533 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e9df7-a95d-4f61-b7ba-c6bdffe54f69 None admin] PATH_INFO: `/v3/projects/ef8c601e5bc64c818990445d938bb592` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:06.718773 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6e9df7-a95d-4f61-b7ba-c6bdffe54f69 None admin] RBAC: Authorizing `identity:get_project(project_id=ef8c601e5bc64c818990445d938bb592)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:06.720605 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6e9df7-a95d-4f61-b7ba-c6bdffe54f69 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:06.722381 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 55/108] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 19 14:41:06 2022] GET /identity/v3/projects/ef8c601e5bc64c818990445d938bb592 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:06.728589 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38e8200-28da-4e9c-810a-c7312ff9493a None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:06.793195 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:06.835890 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38e8200-28da-4e9c-810a-c7312ff9493a None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:06.872591 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2d2358-6ec1-4ae0-8444-be41b83c78d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:06.873239 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2d2358-6ec1-4ae0-8444-be41b83c78d9 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:06.873528 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2d2358-6ec1-4ae0-8444-be41b83c78d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:06.873804 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2d2358-6ec1-4ae0-8444-be41b83c78d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:06.874719 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2d2358-6ec1-4ae0-8444-be41b83c78d9 None admin] RBAC: Adding query filter params (role.id=f23b6d2ba5de4bf68b75b7fa1a4f1b84, scope.project.id=ef8c601e5bc64c818990445d938bb592, user.id=559bc742447647969944d2848f17f106) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:41:06.875035 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2d2358-6ec1-4ae0-8444-be41b83c78d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:06.876563 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2d2358-6ec1-4ae0-8444-be41b83c78d9 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:06.882538 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 54/109] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 19 14:41:06 2022] GET /identity/v3/role_assignments?user.id=559bc742447647969944d2848f17f106&scope.project.id=ef8c601e5bc64c818990445d938bb592&role.id=f23b6d2ba5de4bf68b75b7fa1a4f1b84 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:41:06.908822 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6799c8f2-71d6-43a5-ab27-b0086662c9a0 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:06.909368 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6799c8f2-71d6-43a5-ab27-b0086662c9a0 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:06.909437 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6799c8f2-71d6-43a5-ab27-b0086662c9a0 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:06.910759 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 56/110] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:41:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 14:41:06.916742 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1262773d-eb0a-4016-a652-ff63b807edd3 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:06.917102 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1262773d-eb0a-4016-a652-ff63b807edd3 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:06.917343 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1262773d-eb0a-4016-a652-ff63b807edd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:06.941484 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-1262773d-eb0a-4016-a652-ff63b807edd3 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:41:06.942906 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-1262773d-eb0a-4016-a652-ff63b807edd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:41:07.038665 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 55/111] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:41:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:41:07.188096 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18595c6a-be70-41e4-97ae-4e0098f836fd None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:07.188496 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18595c6a-be70-41e4-97ae-4e0098f836fd None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:07.188842 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18595c6a-be70-41e4-97ae-4e0098f836fd None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:07.191107 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 57/112] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:41:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:41:07.198980 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe3511-4eaf-4fb9-9aaf-7525d69743d5 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:07.199373 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe3511-4eaf-4fb9-9aaf-7525d69743d5 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:07.199754 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe3511-4eaf-4fb9-9aaf-7525d69743d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:07.231696 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-31fe3511-4eaf-4fb9-9aaf-7525d69743d5 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:41:07.233379 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-31fe3511-4eaf-4fb9-9aaf-7525d69743d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:41:07.320439 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:07.350521 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 56/113] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:41:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 14:41:07.444188 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18595c6a-be70-41e4-97ae-4e0098f836fd None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:07.596591 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:07.602534 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18595c6a-be70-41e4-97ae-4e0098f836fd None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:07.659755 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bb57ad-b4b1-4ca7-92dd-de2eb4fdd2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:07.660549 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb57ad-b4b1-4ca7-92dd-de2eb4fdd2ef None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:07.661077 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb57ad-b4b1-4ca7-92dd-de2eb4fdd2ef None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:07.661536 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb57ad-b4b1-4ca7-92dd-de2eb4fdd2ef None admin] PATH_INFO: `/v3/roles/member` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:07.679678 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bb57ad-b4b1-4ca7-92dd-de2eb4fdd2ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:41:07.685290 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-75bb57ad-b4b1-4ca7-92dd-de2eb4fdd2ef None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:41:07.685290 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:41:07.685290 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:41:07.685290 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:41:07.685290 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:41:07.685290 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:41:07.685290 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:41:07.685290 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:41:07.685290 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:41:07.685290 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:41:07.685290 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:41:07.685290 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:41:07.685290 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:41:07.685290 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:41:07.685290 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:41:07.685290 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:41:07.687482 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:41:07.687482 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:41:07.687482 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:41:07.687482 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:41:07.687482 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:41:07.687482 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:41:07.687482 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:41:07.687482 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:41:07.687482 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:41:07.687482 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:41:07.687482 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:41:07.687482 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:41:07.687482 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:41:07.687482 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:41:07.687482 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:41:07.687482 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:41:07.689254 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:41:07.689254 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:41:07.689254 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:41:07.689254 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:41:07.689254 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:41:07.689254 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:41:07.689254 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:41:07.689254 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:41:07.689254 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:41:07.689254 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:41:07.689254 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:41:07.689254 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:41:07.689254 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 58/114] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 19 14:41:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:41:07.698780 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38895199-3ae0-45ea-b1c9-c2088d1c8a79 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:07.699117 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38895199-3ae0-45ea-b1c9-c2088d1c8a79 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:07.699347 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38895199-3ae0-45ea-b1c9-c2088d1c8a79 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:07.699611 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bb57ad-b4b1-4ca7-92dd-de2eb4fdd2ef None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:07.700596 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 57/115] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:41:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:41:07.706643 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fbcca8-0e66-43b0-a92d-6d2af308bd29 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:07.706968 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fbcca8-0e66-43b0-a92d-6d2af308bd29 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:07.707183 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fbcca8-0e66-43b0-a92d-6d2af308bd29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:07.729014 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-29fbcca8-0e66-43b0-a92d-6d2af308bd29 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:41:07.730274 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-29fbcca8-0e66-43b0-a92d-6d2af308bd29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:41:07.885994 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 58/116] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:41:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 14:41:07.887983 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae14cf-a520-4c60-a21e-4c797a177606 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:07.888493 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae14cf-a520-4c60-a21e-4c797a177606 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:07.888962 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae14cf-a520-4c60-a21e-4c797a177606 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:07.891077 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 59/117] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:41:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:41:07.892641 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fae14cf-a520-4c60-a21e-4c797a177606 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:07.900302 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bb57ad-b4b1-4ca7-92dd-de2eb4fdd2ef None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:07.979477 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca50cbc4-d51c-495f-8529-f1edab07f99a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:07.980327 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca50cbc4-d51c-495f-8529-f1edab07f99a None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:07.980454 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca50cbc4-d51c-495f-8529-f1edab07f99a None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:07.980744 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca50cbc4-d51c-495f-8529-f1edab07f99a None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:07.981545 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca50cbc4-d51c-495f-8529-f1edab07f99a None admin] RBAC: Adding query filter params (name=member) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:41:07.981912 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca50cbc4-d51c-495f-8529-f1edab07f99a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:07.983574 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca50cbc4-d51c-495f-8529-f1edab07f99a None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:08.025856 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 59/118] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Sep 19 14:41:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:41:08.029237 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd01c67-d6d1-4b50-94e2-329ae0376b6b None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:08.029237 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd01c67-d6d1-4b50-94e2-329ae0376b6b None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:08.029237 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd01c67-d6d1-4b50-94e2-329ae0376b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:08.051888 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fae14cf-a520-4c60-a21e-4c797a177606 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:08.071810 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:08.080347 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-2dd01c67-d6d1-4b50-94e2-329ae0376b6b None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:41:08.081877 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-2dd01c67-d6d1-4b50-94e2-329ae0376b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:41:08.101916 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a5c710-b478-408f-8e3e-303fc1eed203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:08.102753 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a5c710-b478-408f-8e3e-303fc1eed203 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:08.103125 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a5c710-b478-408f-8e3e-303fc1eed203 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:08.103488 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a5c710-b478-408f-8e3e-303fc1eed203 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:08.116140 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a5c710-b478-408f-8e3e-303fc1eed203 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:41:08.121079 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-17a5c710-b478-408f-8e3e-303fc1eed203 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:41:08.121079 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:41:08.121079 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:41:08.121079 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:41:08.121079 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:41:08.121079 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:41:08.121079 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:41:08.121079 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:41:08.121079 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:41:08.121079 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:41:08.121079 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:41:08.121079 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:41:08.121079 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:41:08.121079 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:41:08.121079 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:41:08.121079 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:41:08.122349 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:41:08.122349 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:41:08.122349 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:41:08.122349 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:41:08.122349 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:41:08.122349 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:41:08.122349 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:41:08.122349 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:41:08.122349 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:41:08.122349 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:41:08.122349 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:41:08.122349 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:41:08.122349 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:41:08.122349 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:41:08.122349 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:41:08.122349 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:41:08.123289 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:41:08.123289 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:41:08.123289 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:41:08.123289 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:41:08.123289 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:41:08.123289 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:41:08.123289 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:41:08.123289 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:41:08.123289 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:41:08.123289 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:41:08.123289 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:41:08.123289 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:41:08.124143 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:08.129192 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 60/119] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 19 14:41:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:41:08.130428 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a5c710-b478-408f-8e3e-303fc1eed203 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:08.258648 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a5c710-b478-408f-8e3e-303fc1eed203 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:08.281936 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 60/120] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:41:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:41:08.283394 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd01c67-d6d1-4b50-94e2-329ae0376b6b None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:08.299688 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e344499e-fbc8-4402-bc2a-0421de507d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:08.300340 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e344499e-fbc8-4402-bc2a-0421de507d59 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:08.300677 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e344499e-fbc8-4402-bc2a-0421de507d59 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:08.300957 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e344499e-fbc8-4402-bc2a-0421de507d59 None admin] PATH_INFO: `/v3/users/5238072e01b240dbb2f0ada386bb22c4` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:08.302174 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e344499e-fbc8-4402-bc2a-0421de507d59 None admin] RBAC: Authorizing `identity:get_user(user_id=5238072e01b240dbb2f0ada386bb22c4)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:08.303771 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e344499e-fbc8-4402-bc2a-0421de507d59 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:08.311409 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 61/121] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 19 14:41:08 2022] GET /identity/v3/users/5238072e01b240dbb2f0ada386bb22c4 => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:08.311654 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e344499e-fbc8-4402-bc2a-0421de507d59 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:08.365517 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:08.473582 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e344499e-fbc8-4402-bc2a-0421de507d59 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:08.528332 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd01c67-d6d1-4b50-94e2-329ae0376b6b None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:08.594478 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86a73eb-ea4d-4f1b-b966-6e88a2548e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:08.595459 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a73eb-ea4d-4f1b-b966-6e88a2548e05 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:08.595743 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a73eb-ea4d-4f1b-b966-6e88a2548e05 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:08.596013 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a73eb-ea4d-4f1b-b966-6e88a2548e05 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:08.598923 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2e5e5e-af00-4bbe-b0d2-b247c29424a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:08.600128 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e5e5e-af00-4bbe-b0d2-b247c29424a5 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:08.600638 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e5e5e-af00-4bbe-b0d2-b247c29424a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:08.601173 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e5e5e-af00-4bbe-b0d2-b247c29424a5 None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:08.602423 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2e5e5e-af00-4bbe-b0d2-b247c29424a5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:41:08.602960 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2e5e5e-af00-4bbe-b0d2-b247c29424a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:08.605480 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2e5e5e-af00-4bbe-b0d2-b247c29424a5 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:08.616857 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86a73eb-ea4d-4f1b-b966-6e88a2548e05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:41:08.619800 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 61/122] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 19 14:41:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:08.620654 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2e5e5e-af00-4bbe-b0d2-b247c29424a5 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:08.621976 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-d86a73eb-ea4d-4f1b-b966-6e88a2548e05 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:41:08.621976 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:41:08.621976 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:41:08.621976 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:41:08.621976 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:41:08.621976 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:41:08.621976 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:41:08.621976 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:41:08.621976 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:41:08.621976 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:41:08.621976 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:41:08.621976 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:41:08.621976 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:41:08.621976 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:41:08.621976 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:41:08.621976 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:41:08.623246 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:41:08.623246 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:41:08.623246 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:41:08.623246 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:41:08.623246 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:41:08.623246 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:41:08.623246 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:41:08.623246 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:41:08.623246 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:41:08.623246 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:41:08.623246 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:41:08.623246 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:41:08.623246 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:41:08.623246 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:41:08.623246 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:41:08.623246 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:41:08.623989 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:41:08.623989 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:41:08.623989 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:41:08.623989 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:41:08.623989 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:41:08.623989 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:41:08.623989 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:41:08.623989 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:41:08.623989 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:41:08.623989 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:41:08.623989 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:41:08.623989 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:41:08.623989 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 62/123] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 19 14:41:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:41:08.630819 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86a73eb-ea4d-4f1b-b966-6e88a2548e05 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:08.645523 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:08.746974 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2e5e5e-af00-4bbe-b0d2-b247c29424a5 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:08.789576 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c32e6f-b805-4839-9264-7a29ccb03806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:08.790131 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c32e6f-b805-4839-9264-7a29ccb03806 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:08.790417 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c32e6f-b805-4839-9264-7a29ccb03806 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:08.790734 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c32e6f-b805-4839-9264-7a29ccb03806 None admin] PATH_INFO: `/v3/projects/ef8c601e5bc64c818990445d938bb592` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:08.793572 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c32e6f-b805-4839-9264-7a29ccb03806 None admin] RBAC: Authorizing `identity:get_project(project_id=ef8c601e5bc64c818990445d938bb592)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:08.795066 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c32e6f-b805-4839-9264-7a29ccb03806 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:08.797182 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 62/124] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 19 14:41:08 2022] GET /identity/v3/projects/ef8c601e5bc64c818990445d938bb592 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:08.797814 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c32e6f-b805-4839-9264-7a29ccb03806 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:08.798592 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86a73eb-ea4d-4f1b-b966-6e88a2548e05 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:08.800156 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:08.841837 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a414b4-98b4-4828-a4a0-f0b79fa3c548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:08.842526 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a414b4-98b4-4828-a4a0-f0b79fa3c548 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:08.842804 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a414b4-98b4-4828-a4a0-f0b79fa3c548 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:08.843185 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a414b4-98b4-4828-a4a0-f0b79fa3c548 None admin] PATH_INFO: `/v3/users/cc650418ff744a178289e14fefc617d5` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:08.844407 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a414b4-98b4-4828-a4a0-f0b79fa3c548 None admin] RBAC: Authorizing `identity:get_user(user_id=cc650418ff744a178289e14fefc617d5)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:08.846343 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a414b4-98b4-4828-a4a0-f0b79fa3c548 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:08.848186 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 63/125] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 19 14:41:08 2022] GET /identity/v3/users/cc650418ff744a178289e14fefc617d5 => generated 247 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:08.853628 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a414b4-98b4-4828-a4a0-f0b79fa3c548 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:08.895672 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:08.918634 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c32e6f-b805-4839-9264-7a29ccb03806 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:08.957028 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3f484f-c35e-43e9-aef6-fc930754ae45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:08.958053 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f484f-c35e-43e9-aef6-fc930754ae45 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:08.958491 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f484f-c35e-43e9-aef6-fc930754ae45 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:08.958834 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f484f-c35e-43e9-aef6-fc930754ae45 None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:08.959671 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3f484f-c35e-43e9-aef6-fc930754ae45 None admin] RBAC: Adding query filter params (name=member) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:41:08.960090 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3f484f-c35e-43e9-aef6-fc930754ae45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:08.961899 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3f484f-c35e-43e9-aef6-fc930754ae45 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:08.965291 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a414b4-98b4-4828-a4a0-f0b79fa3c548 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:08.973128 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 63/126] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Sep 19 14:41:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:08.978660 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3f484f-c35e-43e9-aef6-fc930754ae45 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:09.006555 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5730cce3-bc24-479a-9863-5824063e622c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:09.007525 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730cce3-bc24-479a-9863-5824063e622c None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:09.007956 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730cce3-bc24-479a-9863-5824063e622c None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:09.008382 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730cce3-bc24-479a-9863-5824063e622c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:09.020575 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5730cce3-bc24-479a-9863-5824063e622c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:41:09.025867 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-5730cce3-bc24-479a-9863-5824063e622c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 14:41:09.025867 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:41:09.025867 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:41:09.025867 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:41:09.025867 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:41:09.025867 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:41:09.025867 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:41:09.025867 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:41:09.025867 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:41:09.025867 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:41:09.025867 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:41:09.025867 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:41:09.025867 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:41:09.025867 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:41:09.025867 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:41:09.025867 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:41:09.026935 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:41:09.026935 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:41:09.026935 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:41:09.026935 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:41:09.026935 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:41:09.026935 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:41:09.026935 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:41:09.026935 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:41:09.026935 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:41:09.026935 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:41:09.026935 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:41:09.026935 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:41:09.026935 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:41:09.026935 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:41:09.026935 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:41:09.026935 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:41:09.027834 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:41:09.027834 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:41:09.027834 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:41:09.027834 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:41:09.027834 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:41:09.027834 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:41:09.027834 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:41:09.027834 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:41:09.027834 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:41:09.027834 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:41:09.027834 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 14:41:09.027834 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:41:09.029752 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 64/127] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Sep 19 14:41:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:41:09.035708 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5730cce3-bc24-479a-9863-5824063e622c None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:09.070349 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:09.102456 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3f484f-c35e-43e9-aef6-fc930754ae45 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:09.147826 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe860257-fc11-4522-a832-a22f21e10f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:09.148543 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe860257-fc11-4522-a832-a22f21e10f31 None admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:09.148784 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe860257-fc11-4522-a832-a22f21e10f31 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:09.149092 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe860257-fc11-4522-a832-a22f21e10f31 None admin] PATH_INFO: `/v3/projects/ef8c601e5bc64c818990445d938bb592/users/5238072e01b240dbb2f0ada386bb22c4/roles/74de6794e3b3422b93d26f993d260c35` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:09.151048 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe860257-fc11-4522-a832-a22f21e10f31 None admin] RBAC: Authorizing `identity:create_grant(project_id=ef8c601e5bc64c818990445d938bb592, user_id=5238072e01b240dbb2f0ada386bb22c4, role_id=74de6794e3b3422b93d26f993d260c35)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:09.151211 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5730cce3-bc24-479a-9863-5824063e622c None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:09.152512 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe860257-fc11-4522-a832-a22f21e10f31 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:09.170046 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 64/128] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Sep 19 14:41:08 2022] PUT /identity/v3/projects/ef8c601e5bc64c818990445d938bb592/users/5238072e01b240dbb2f0ada386bb22c4/roles/74de6794e3b3422b93d26f993d260c35 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:41:09.171357 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe860257-fc11-4522-a832-a22f21e10f31 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:09.174674 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:09.194048 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f514fd-ea32-473a-8ee6-0ec1a04b7010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:09.194999 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f514fd-ea32-473a-8ee6-0ec1a04b7010 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:09.195427 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f514fd-ea32-473a-8ee6-0ec1a04b7010 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:09.195928 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f514fd-ea32-473a-8ee6-0ec1a04b7010 None admin] PATH_INFO: `/v3/projects/ef8c601e5bc64c818990445d938bb592` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:09.197389 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f514fd-ea32-473a-8ee6-0ec1a04b7010 None admin] RBAC: Authorizing `identity:get_project(project_id=ef8c601e5bc64c818990445d938bb592)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:09.199095 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f514fd-ea32-473a-8ee6-0ec1a04b7010 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:09.201312 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 65/129] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 19 14:41:09 2022] GET /identity/v3/projects/ef8c601e5bc64c818990445d938bb592 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:09.207631 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f514fd-ea32-473a-8ee6-0ec1a04b7010 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:09.307551 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe860257-fc11-4522-a832-a22f21e10f31 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:09.316458 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:09.321133 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f514fd-ea32-473a-8ee6-0ec1a04b7010 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:09.353703 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1c1bb1-e042-4246-88fa-1acbe7785dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:09.354386 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c1bb1-e042-4246-88fa-1acbe7785dee None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:09.355134 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c1bb1-e042-4246-88fa-1acbe7785dee None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:09.355445 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c1bb1-e042-4246-88fa-1acbe7785dee None admin] PATH_INFO: `/v3/users/5238072e01b240dbb2f0ada386bb22c4` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:09.356845 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1c1bb1-e042-4246-88fa-1acbe7785dee None admin] RBAC: Authorizing `identity:get_user(user_id=5238072e01b240dbb2f0ada386bb22c4)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:09.358332 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1c1bb1-e042-4246-88fa-1acbe7785dee None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:09.359988 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 65/130] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 19 14:41:09 2022] GET /identity/v3/users/5238072e01b240dbb2f0ada386bb22c4 => generated 275 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:09.360596 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6f769b-1f4e-47e4-b574-862f94e0a6a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:09.360731 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1c1bb1-e042-4246-88fa-1acbe7785dee None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:09.361501 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f769b-1f4e-47e4-b574-862f94e0a6a8 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:09.361914 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f769b-1f4e-47e4-b574-862f94e0a6a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:09.362455 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f769b-1f4e-47e4-b574-862f94e0a6a8 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:09.363254 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6f769b-1f4e-47e4-b574-862f94e0a6a8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:41:09.363698 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6f769b-1f4e-47e4-b574-862f94e0a6a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:09.365241 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6f769b-1f4e-47e4-b574-862f94e0a6a8 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:09.374560 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 66/131] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 19 14:41:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:09.380229 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6f769b-1f4e-47e4-b574-862f94e0a6a8 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:09.466493 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:09.504861 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1c1bb1-e042-4246-88fa-1acbe7785dee None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:09.543607 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6f769b-1f4e-47e4-b574-862f94e0a6a8 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:09.547090 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50df174-3b55-4fc2-85dd-6bdbad2647df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:09.547418 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50df174-3b55-4fc2-85dd-6bdbad2647df None admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:09.547712 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50df174-3b55-4fc2-85dd-6bdbad2647df None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:09.547985 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50df174-3b55-4fc2-85dd-6bdbad2647df None admin] PATH_INFO: `/v3/projects/ef8c601e5bc64c818990445d938bb592/users/cc650418ff744a178289e14fefc617d5/roles/019bde1756cb40de8ce06cef6b261f79` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:09.550004 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50df174-3b55-4fc2-85dd-6bdbad2647df None admin] RBAC: Authorizing `identity:create_grant(project_id=ef8c601e5bc64c818990445d938bb592, user_id=cc650418ff744a178289e14fefc617d5, role_id=019bde1756cb40de8ce06cef6b261f79)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:09.551476 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50df174-3b55-4fc2-85dd-6bdbad2647df None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:09.571851 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 66/132] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Sep 19 14:41:09 2022] PUT /identity/v3/projects/ef8c601e5bc64c818990445d938bb592/users/cc650418ff744a178289e14fefc617d5/roles/019bde1756cb40de8ce06cef6b261f79 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:41:09.572890 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50df174-3b55-4fc2-85dd-6bdbad2647df None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:09.593861 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2384b5b-1b5a-4405-95dd-3479aeb267c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:09.595160 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2384b5b-1b5a-4405-95dd-3479aeb267c9 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:09.595446 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2384b5b-1b5a-4405-95dd-3479aeb267c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:09.595762 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2384b5b-1b5a-4405-95dd-3479aeb267c9 None admin] PATH_INFO: `/v3/projects/6097cde96e2c4a8cb4c8d8b1c5258e87` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:09.598041 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2384b5b-1b5a-4405-95dd-3479aeb267c9 None admin] RBAC: Authorizing `identity:get_project(project_id=6097cde96e2c4a8cb4c8d8b1c5258e87)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:09.599993 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2384b5b-1b5a-4405-95dd-3479aeb267c9 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:09.602743 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 67/133] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 19 14:41:09 2022] GET /identity/v3/projects/6097cde96e2c4a8cb4c8d8b1c5258e87 => generated 312 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:09.609692 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2384b5b-1b5a-4405-95dd-3479aeb267c9 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:09.654520 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:09.741848 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50df174-3b55-4fc2-85dd-6bdbad2647df None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:09.755911 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2384b5b-1b5a-4405-95dd-3479aeb267c9 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:09.806769 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631c2d6b-6b1a-4de4-98f2-271929017f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:09.807872 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c2d6b-6b1a-4de4-98f2-271929017f7c None admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:09.808037 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:09.808160 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c2d6b-6b1a-4de4-98f2-271929017f7c None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:09.808429 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c2d6b-6b1a-4de4-98f2-271929017f7c None admin] PATH_INFO: `/v3/projects/6097cde96e2c4a8cb4c8d8b1c5258e87/users/5238072e01b240dbb2f0ada386bb22c4/roles/74de6794e3b3422b93d26f993d260c35` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:09.810821 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631c2d6b-6b1a-4de4-98f2-271929017f7c None admin] RBAC: Authorizing `identity:create_grant(project_id=6097cde96e2c4a8cb4c8d8b1c5258e87, user_id=5238072e01b240dbb2f0ada386bb22c4, role_id=74de6794e3b3422b93d26f993d260c35)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:09.812796 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88737cd-2fe2-41e7-8bbe-623a1abd13d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:09.812934 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631c2d6b-6b1a-4de4-98f2-271929017f7c None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:09.813636 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88737cd-2fe2-41e7-8bbe-623a1abd13d0 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:09.813925 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88737cd-2fe2-41e7-8bbe-623a1abd13d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:09.814207 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88737cd-2fe2-41e7-8bbe-623a1abd13d0 None admin] PATH_INFO: `/v3/users/5238072e01b240dbb2f0ada386bb22c4` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:09.815518 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88737cd-2fe2-41e7-8bbe-623a1abd13d0 None admin] RBAC: Authorizing `identity:get_user(user_id=5238072e01b240dbb2f0ada386bb22c4)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:09.816840 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88737cd-2fe2-41e7-8bbe-623a1abd13d0 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:09.818495 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 67/134] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 19 14:41:09 2022] GET /identity/v3/users/5238072e01b240dbb2f0ada386bb22c4 => generated 275 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:09.819777 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e13e44b-1ae6-4319-84cd-81d62f417c96 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:09.820138 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e13e44b-1ae6-4319-84cd-81d62f417c96 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:09.820444 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e13e44b-1ae6-4319-84cd-81d62f417c96 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:09.826689 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 68/135] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:41:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:41:09.828329 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e13e44b-1ae6-4319-84cd-81d62f417c96 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:09.839809 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 68/136] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Sep 19 14:41:09 2022] PUT /identity/v3/projects/6097cde96e2c4a8cb4c8d8b1c5258e87/users/5238072e01b240dbb2f0ada386bb22c4/roles/74de6794e3b3422b93d26f993d260c35 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:41:09.841546 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3e8fe7-2b81-4ee4-aae3-65ed33ea62bd None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:09.842038 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3e8fe7-2b81-4ee4-aae3-65ed33ea62bd None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:09.843095 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3e8fe7-2b81-4ee4-aae3-65ed33ea62bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:09.870361 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-4f3e8fe7-2b81-4ee4-aae3-65ed33ea62bd None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:41:09.871710 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-4f3e8fe7-2b81-4ee4-aae3-65ed33ea62bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:41:09.953195 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 69/137] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:41:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:41:09.981470 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e13e44b-1ae6-4319-84cd-81d62f417c96 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:10.023900 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcb0f7f-9d3c-4cd1-8c61-926ee34ea60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:10.024940 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcb0f7f-9d3c-4cd1-8c61-926ee34ea60e None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:10.025428 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcb0f7f-9d3c-4cd1-8c61-926ee34ea60e None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:10.025927 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcb0f7f-9d3c-4cd1-8c61-926ee34ea60e None admin] PATH_INFO: `/v3/projects/ef8c601e5bc64c818990445d938bb592` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:10.027290 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcb0f7f-9d3c-4cd1-8c61-926ee34ea60e None admin] RBAC: Authorizing `identity:get_project(project_id=ef8c601e5bc64c818990445d938bb592)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:10.029037 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcb0f7f-9d3c-4cd1-8c61-926ee34ea60e None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:10.032067 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 69/138] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 19 14:41:09 2022] GET /identity/v3/projects/ef8c601e5bc64c818990445d938bb592 => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:10.038111 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3e8fe7-2b81-4ee4-aae3-65ed33ea62bd None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:10.078408 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:10.210187 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3e8fe7-2b81-4ee4-aae3-65ed33ea62bd None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:10.253513 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3fdc66-2f02-4174-a0fd-258cf22c92f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:10.254559 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3fdc66-2f02-4174-a0fd-258cf22c92f1 None admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:10.255005 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3fdc66-2f02-4174-a0fd-258cf22c92f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:10.255481 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3fdc66-2f02-4174-a0fd-258cf22c92f1 None admin] PATH_INFO: `/v3/projects/ef8c601e5bc64c818990445d938bb592/users/5238072e01b240dbb2f0ada386bb22c4/roles/ae7ed67e62684598a31185ab16c971ce` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:10.257824 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3fdc66-2f02-4174-a0fd-258cf22c92f1 None admin] RBAC: Authorizing `identity:create_grant(project_id=ef8c601e5bc64c818990445d938bb592, user_id=5238072e01b240dbb2f0ada386bb22c4, role_id=ae7ed67e62684598a31185ab16c971ce)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:10.259475 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3fdc66-2f02-4174-a0fd-258cf22c92f1 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:10.277109 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 70/139] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Sep 19 14:41:10 2022] PUT /identity/v3/projects/ef8c601e5bc64c818990445d938bb592/users/5238072e01b240dbb2f0ada386bb22c4/roles/ae7ed67e62684598a31185ab16c971ce => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:41:10.346211 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44fe5bf-f0a6-4603-8ee2-8b380c89d4ef None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:10.347115 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44fe5bf-f0a6-4603-8ee2-8b380c89d4ef None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:10.347565 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44fe5bf-f0a6-4603-8ee2-8b380c89d4ef None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:10.349286 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 70/140] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:41:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:41:10.355105 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0806d4-a5ce-4b3f-8bdc-04bb2268fcc7 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:10.355643 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0806d4-a5ce-4b3f-8bdc-04bb2268fcc7 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:10.356113 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0806d4-a5ce-4b3f-8bdc-04bb2268fcc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:10.378985 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-ce0806d4-a5ce-4b3f-8bdc-04bb2268fcc7 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:41:10.380562 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ce0806d4-a5ce-4b3f-8bdc-04bb2268fcc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:41:10.435717 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44fe5bf-f0a6-4603-8ee2-8b380c89d4ef None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:10.479650 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 71/141] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:41:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:41:10.623465 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:10.677326 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44fe5bf-f0a6-4603-8ee2-8b380c89d4ef None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:10.722741 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9f69bc-a29e-4587-83a9-232fa03824e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:10.723776 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f69bc-a29e-4587-83a9-232fa03824e7 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:10.724311 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f69bc-a29e-4587-83a9-232fa03824e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:10.724798 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f69bc-a29e-4587-83a9-232fa03824e7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:10.726139 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9f69bc-a29e-4587-83a9-232fa03824e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:10.727910 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9f69bc-a29e-4587-83a9-232fa03824e7 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:10.729742 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 71/142] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:41:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:10.735641 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0806d4-a5ce-4b3f-8bdc-04bb2268fcc7 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:10.747316 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:10.840212 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0806d4-a5ce-4b3f-8bdc-04bb2268fcc7 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:10.886136 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa46a283-e886-4d69-a58d-203ce79a3548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:10.886786 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa46a283-e886-4d69-a58d-203ce79a3548 None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:10.887155 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa46a283-e886-4d69-a58d-203ce79a3548 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:10.887417 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa46a283-e886-4d69-a58d-203ce79a3548 None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:10.888092 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa46a283-e886-4d69-a58d-203ce79a3548 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:10.889728 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa46a283-e886-4d69-a58d-203ce79a3548 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:10.921155 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 72/143] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Sep 19 14:41:10 2022] POST /identity/v3/users => generated 283 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 14:41:10.932629 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9f69bc-a29e-4587-83a9-232fa03824e7 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:11.069426 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9f69bc-a29e-4587-83a9-232fa03824e7 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:11.121953 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6463c9-56ab-4e13-9fe8-24612e8b84de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:11.122604 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6463c9-56ab-4e13-9fe8-24612e8b84de None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:11.122882 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6463c9-56ab-4e13-9fe8-24612e8b84de None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:11.123149 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6463c9-56ab-4e13-9fe8-24612e8b84de None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:11.125413 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:11.136053 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6463c9-56ab-4e13-9fe8-24612e8b84de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:41:11.141736 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-2b6463c9-56ab-4e13-9fe8-24612e8b84de None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 14:41:11.141736 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:41:11.141736 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:41:11.141736 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:41:11.141736 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:41:11.141736 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:41:11.141736 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:41:11.141736 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:41:11.141736 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:41:11.141736 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:41:11.141736 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:41:11.141736 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:41:11.141736 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:41:11.141736 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:41:11.141736 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:41:11.141736 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:41:11.142587 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:41:11.142587 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:41:11.142587 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:41:11.142587 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:41:11.142587 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:41:11.142587 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:41:11.142587 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:41:11.142587 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:41:11.142587 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:41:11.142587 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:41:11.142587 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:41:11.142587 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:41:11.142587 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:41:11.142587 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:41:11.142587 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:41:11.142587 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:41:11.143335 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:41:11.143335 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:41:11.143335 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:41:11.143335 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:41:11.143335 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:41:11.143335 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:41:11.143335 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:41:11.143335 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:41:11.143335 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:41:11.143335 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:41:11.143335 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 14:41:11.143335 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:41:11.143335 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 72/144] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 19 14:41:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:41:11.148850 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa46a283-e886-4d69-a58d-203ce79a3548 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:11.218548 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:11.262196 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa46a283-e886-4d69-a58d-203ce79a3548 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:11.302283 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c062c3-dbf2-48f3-8d61-cced64bff9ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:11.302908 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c062c3-dbf2-48f3-8d61-cced64bff9ca None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:11.303180 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c062c3-dbf2-48f3-8d61-cced64bff9ca None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:11.303447 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c062c3-dbf2-48f3-8d61-cced64bff9ca None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:11.304113 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c062c3-dbf2-48f3-8d61-cced64bff9ca None admin] RBAC: Adding query filter params (name=reader) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:41:11.304409 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c062c3-dbf2-48f3-8d61-cced64bff9ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:11.305852 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c062c3-dbf2-48f3-8d61-cced64bff9ca None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:11.316390 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 73/145] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Sep 19 14:41:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:11.322933 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6463c9-56ab-4e13-9fe8-24612e8b84de None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:11.445172 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6463c9-56ab-4e13-9fe8-24612e8b84de None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:11.494179 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3311b17e-78e8-40cc-925f-a2b7fcf27465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:11.494838 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3311b17e-78e8-40cc-925f-a2b7fcf27465 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:11.495161 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3311b17e-78e8-40cc-925f-a2b7fcf27465 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:11.495530 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3311b17e-78e8-40cc-925f-a2b7fcf27465 None admin] PATH_INFO: `/v3/users/559bc742447647969944d2848f17f106` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:11.496717 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3311b17e-78e8-40cc-925f-a2b7fcf27465 None admin] RBAC: Authorizing `identity:get_user(user_id=559bc742447647969944d2848f17f106)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:11.498236 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3311b17e-78e8-40cc-925f-a2b7fcf27465 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:11.500427 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 73/146] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 19 14:41:11 2022] GET /identity/v3/users/559bc742447647969944d2848f17f106 => generated 289 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:11.506398 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c062c3-dbf2-48f3-8d61-cced64bff9ca None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:11.625814 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c062c3-dbf2-48f3-8d61-cced64bff9ca None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:11.660741 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59a4c2b-883f-4958-aed8-2adb067a6234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:11.661416 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59a4c2b-883f-4958-aed8-2adb067a6234 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:11.662037 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59a4c2b-883f-4958-aed8-2adb067a6234 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:11.662308 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59a4c2b-883f-4958-aed8-2adb067a6234 None admin] PATH_INFO: `/v3/projects/ef8c601e5bc64c818990445d938bb592` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:11.662911 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:11.663910 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59a4c2b-883f-4958-aed8-2adb067a6234 None admin] RBAC: Authorizing `identity:get_project(project_id=ef8c601e5bc64c818990445d938bb592)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:11.665477 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59a4c2b-883f-4958-aed8-2adb067a6234 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:11.672903 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 74/147] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 19 14:41:11 2022] GET /identity/v3/projects/ef8c601e5bc64c818990445d938bb592 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:11.674145 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3311b17e-78e8-40cc-925f-a2b7fcf27465 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:11.789980 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:11.869156 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3311b17e-78e8-40cc-925f-a2b7fcf27465 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:11.935959 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81365e9-b7ae-4c8c-9691-061b7c6a40f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:11.938054 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81365e9-b7ae-4c8c-9691-061b7c6a40f6 None admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:11.938777 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81365e9-b7ae-4c8c-9691-061b7c6a40f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:11.939557 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81365e9-b7ae-4c8c-9691-061b7c6a40f6 None admin] PATH_INFO: `/v3/projects/ef8c601e5bc64c818990445d938bb592/users/559bc742447647969944d2848f17f106/roles/f23b6d2ba5de4bf68b75b7fa1a4f1b84` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:11.943235 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81365e9-b7ae-4c8c-9691-061b7c6a40f6 None admin] RBAC: Authorizing `identity:create_grant(project_id=ef8c601e5bc64c818990445d938bb592, user_id=559bc742447647969944d2848f17f106, role_id=f23b6d2ba5de4bf68b75b7fa1a4f1b84)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:11.946292 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81365e9-b7ae-4c8c-9691-061b7c6a40f6 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:11.975190 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 74/148] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Sep 19 14:41:11 2022] PUT /identity/v3/projects/ef8c601e5bc64c818990445d938bb592/users/559bc742447647969944d2848f17f106/roles/f23b6d2ba5de4bf68b75b7fa1a4f1b84 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:41:12.956901 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a5446-2801-4dd1-9d73-be51827614f9 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:12.958105 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a5446-2801-4dd1-9d73-be51827614f9 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:12.958607 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a5446-2801-4dd1-9d73-be51827614f9 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:12.960276 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 75/149] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:41:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:41:12.966920 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b72f48-74be-4c1b-86dc-54594fc4ad40 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:12.968478 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b72f48-74be-4c1b-86dc-54594fc4ad40 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:12.969118 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b72f48-74be-4c1b-86dc-54594fc4ad40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:12.992867 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-d2b72f48-74be-4c1b-86dc-54594fc4ad40 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:41:12.994488 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-d2b72f48-74be-4c1b-86dc-54594fc4ad40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:41:13.090813 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 75/150] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:41:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:41:13.669025 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774a5446-2801-4dd1-9d73-be51827614f9 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:13.837336 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774a5446-2801-4dd1-9d73-be51827614f9 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:13.880538 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb862ef6-585f-4f9a-88df-cdc2c89843c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:13.881496 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb862ef6-585f-4f9a-88df-cdc2c89843c3 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:13.881945 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb862ef6-585f-4f9a-88df-cdc2c89843c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:13.882351 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb862ef6-585f-4f9a-88df-cdc2c89843c3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:13.894646 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb862ef6-585f-4f9a-88df-cdc2c89843c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:41:13.900342 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-fb862ef6-585f-4f9a-88df-cdc2c89843c3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:41:13.900342 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:41:13.900342 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:41:13.900342 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:41:13.900342 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:41:13.900342 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:41:13.900342 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:41:13.900342 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:41:13.900342 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:41:13.900342 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:41:13.900342 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:41:13.900342 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:41:13.900342 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:41:13.900342 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:41:13.900342 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:41:13.900342 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:41:13.901462 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:41:13.901462 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:41:13.901462 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:41:13.901462 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:41:13.901462 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:41:13.901462 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:41:13.901462 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:41:13.901462 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:41:13.901462 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:41:13.901462 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:41:13.901462 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:41:13.901462 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:41:13.901462 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:41:13.901462 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:41:13.901462 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:41:13.901462 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:41:13.902389 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:41:13.902389 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:41:13.902389 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:41:13.902389 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:41:13.902389 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:41:13.902389 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:41:13.902389 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:41:13.902389 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:41:13.902389 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:41:13.902389 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:41:13.902389 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:41:13.902389 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:41:13.904336 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 76/151] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 19 14:41:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:41:13.910964 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b72f48-74be-4c1b-86dc-54594fc4ad40 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:13.974540 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:14.049912 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b72f48-74be-4c1b-86dc-54594fc4ad40 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:14.079352 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c260147e-917f-4d51-998d-faa8514cf1c1 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:14.079851 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c260147e-917f-4d51-998d-faa8514cf1c1 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:14.079851 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c260147e-917f-4d51-998d-faa8514cf1c1 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:14.081463 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 77/152] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:41:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:41:14.095409 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda1207-7054-4cf0-9145-12b4f0169cb1 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:14.095710 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda1207-7054-4cf0-9145-12b4f0169cb1 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:14.095949 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda1207-7054-4cf0-9145-12b4f0169cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:14.106441 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f9d29d-27dd-43b5-8901-a99a7ae8a950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:14.107084 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f9d29d-27dd-43b5-8901-a99a7ae8a950 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:14.107360 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f9d29d-27dd-43b5-8901-a99a7ae8a950 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:14.107646 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f9d29d-27dd-43b5-8901-a99a7ae8a950 None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:14.108401 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f9d29d-27dd-43b5-8901-a99a7ae8a950 None admin] RBAC: Adding query filter params (name=member) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:41:14.108765 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f9d29d-27dd-43b5-8901-a99a7ae8a950 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:14.110598 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f9d29d-27dd-43b5-8901-a99a7ae8a950 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:14.121328 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 76/153] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Sep 19 14:41:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:14.121733 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-ccda1207-7054-4cf0-9145-12b4f0169cb1 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:41:14.122953 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ccda1207-7054-4cf0-9145-12b4f0169cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:41:14.131950 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f9d29d-27dd-43b5-8901-a99a7ae8a950 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:14.227270 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:14.270111 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 78/154] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:41:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 14:41:14.326892 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f9d29d-27dd-43b5-8901-a99a7ae8a950 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:14.344644 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d130d-5800-4c0d-9f94-9d271d3763b3 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:14.344922 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d130d-5800-4c0d-9f94-9d271d3763b3 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:14.345207 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d130d-5800-4c0d-9f94-9d271d3763b3 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:14.346633 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 79/155] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:41:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:41:14.351620 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:14.354797 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87120a44-45ce-4cea-9069-8b52e87ed85c None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:14.355877 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87120a44-45ce-4cea-9069-8b52e87ed85c None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:14.356348 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87120a44-45ce-4cea-9069-8b52e87ed85c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:14.378782 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710a0dfb-9b0f-45bb-ab0e-0804466ac469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:14.379480 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710a0dfb-9b0f-45bb-ab0e-0804466ac469 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:14.379761 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710a0dfb-9b0f-45bb-ab0e-0804466ac469 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:14.380095 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710a0dfb-9b0f-45bb-ab0e-0804466ac469 None admin] PATH_INFO: `/v3/users/5238072e01b240dbb2f0ada386bb22c4` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:14.381672 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710a0dfb-9b0f-45bb-ab0e-0804466ac469 None admin] RBAC: Authorizing `identity:get_user(user_id=5238072e01b240dbb2f0ada386bb22c4)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:14.383164 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710a0dfb-9b0f-45bb-ab0e-0804466ac469 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:14.384803 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 77/156] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 19 14:41:14 2022] GET /identity/v3/users/5238072e01b240dbb2f0ada386bb22c4 => generated 275 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:14.393022 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710a0dfb-9b0f-45bb-ab0e-0804466ac469 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:14.405890 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-87120a44-45ce-4cea-9069-8b52e87ed85c None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:41:14.407549 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-87120a44-45ce-4cea-9069-8b52e87ed85c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:41:14.516501 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710a0dfb-9b0f-45bb-ab0e-0804466ac469 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:14.568726 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 80/157] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:41:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 14:41:14.570507 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3505d83-6929-45cd-93c0-79c025aef020 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:14.570993 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3505d83-6929-45cd-93c0-79c025aef020 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:14.571459 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3505d83-6929-45cd-93c0-79c025aef020 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:14.572963 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 81/158] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:41:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:41:14.579079 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751be02-e941-4c2f-be70-09261f8d8988 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:14.579691 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751be02-e941-4c2f-be70-09261f8d8988 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:14.580242 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751be02-e941-4c2f-be70-09261f8d8988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:14.581930 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67782dee-6da6-41e9-b6dc-a77e400c1ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:14.582561 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67782dee-6da6-41e9-b6dc-a77e400c1ccd None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:14.582837 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67782dee-6da6-41e9-b6dc-a77e400c1ccd None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:14.583103 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67782dee-6da6-41e9-b6dc-a77e400c1ccd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:14.622103 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-5751be02-e941-4c2f-be70-09261f8d8988 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:41:14.623336 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-5751be02-e941-4c2f-be70-09261f8d8988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:41:14.673693 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:14.701990 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67782dee-6da6-41e9-b6dc-a77e400c1ccd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:14.704612 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67782dee-6da6-41e9-b6dc-a77e400c1ccd None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:14.859288 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 82/159] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:41:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:41:14.882575 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 78/160] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 19 14:41:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:14.894124 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5751be02-e941-4c2f-be70-09261f8d8988 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:14.937262 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67782dee-6da6-41e9-b6dc-a77e400c1ccd None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:14.956186 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:15.047959 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5751be02-e941-4c2f-be70-09261f8d8988 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:15.116254 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53229b87-a193-4e7b-ae0b-84b2c2b9b430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:15.117576 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53229b87-a193-4e7b-ae0b-84b2c2b9b430 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:15.118423 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53229b87-a193-4e7b-ae0b-84b2c2b9b430 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:15.118835 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53229b87-a193-4e7b-ae0b-84b2c2b9b430 None admin] PATH_INFO: `/v3/projects/ef8c601e5bc64c818990445d938bb592` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:15.123379 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53229b87-a193-4e7b-ae0b-84b2c2b9b430 None admin] RBAC: Authorizing `identity:get_project(project_id=ef8c601e5bc64c818990445d938bb592)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:15.125708 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53229b87-a193-4e7b-ae0b-84b2c2b9b430 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:15.128132 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 83/161] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 19 14:41:14 2022] GET /identity/v3/projects/ef8c601e5bc64c818990445d938bb592 => generated 298 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:15.134857 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53229b87-a193-4e7b-ae0b-84b2c2b9b430 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:15.184828 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:15.238946 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67782dee-6da6-41e9-b6dc-a77e400c1ccd None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:15.334297 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb92267e-eba1-47dc-b030-d5608af0bfab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:15.335332 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92267e-eba1-47dc-b030-d5608af0bfab None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:15.335792 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92267e-eba1-47dc-b030-d5608af0bfab None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:15.336250 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92267e-eba1-47dc-b030-d5608af0bfab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:15.344773 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53229b87-a193-4e7b-ae0b-84b2c2b9b430 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:15.365389 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:15.365931 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb92267e-eba1-47dc-b030-d5608af0bfab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:41:15.370868 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-bb92267e-eba1-47dc-b030-d5608af0bfab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:41:15.370868 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:41:15.370868 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:41:15.370868 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:41:15.370868 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:41:15.370868 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:41:15.370868 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:41:15.370868 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:41:15.370868 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:41:15.370868 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:41:15.370868 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:41:15.370868 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:41:15.370868 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:41:15.370868 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:41:15.370868 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:41:15.370868 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:41:15.371712 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:41:15.371712 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:41:15.371712 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:41:15.371712 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:41:15.371712 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:41:15.371712 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:41:15.371712 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:41:15.371712 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:41:15.371712 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:41:15.371712 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:41:15.371712 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:41:15.371712 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:41:15.371712 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:41:15.371712 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:41:15.371712 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:41:15.371712 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:41:15.372445 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:41:15.372445 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:41:15.372445 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:41:15.372445 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:41:15.372445 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:41:15.372445 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:41:15.372445 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:41:15.372445 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:41:15.372445 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:41:15.372445 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:41:15.372445 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:41:15.372445 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:41:15.372445 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 79/162] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 19 14:41:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 436 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:41:15.374052 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb92267e-eba1-47dc-b030-d5608af0bfab None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:15.405828 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9012bbd0-071f-4e28-ad18-395c8006252d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:15.406441 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9012bbd0-071f-4e28-ad18-395c8006252d None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:15.406874 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9012bbd0-071f-4e28-ad18-395c8006252d None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:15.407153 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9012bbd0-071f-4e28-ad18-395c8006252d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:15.407892 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9012bbd0-071f-4e28-ad18-395c8006252d None admin] RBAC: Adding query filter params (role.id=74de6794e3b3422b93d26f993d260c35, scope.project.id=ef8c601e5bc64c818990445d938bb592, user.id=5238072e01b240dbb2f0ada386bb22c4) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:41:15.408200 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9012bbd0-071f-4e28-ad18-395c8006252d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:15.417906 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9012bbd0-071f-4e28-ad18-395c8006252d None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:15.424834 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 84/163] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 19 14:41:15 2022] GET /identity/v3/role_assignments?user.id=5238072e01b240dbb2f0ada386bb22c4&scope.project.id=ef8c601e5bc64c818990445d938bb592&role.id=74de6794e3b3422b93d26f993d260c35 => generated 608 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:41:15.425697 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9012bbd0-071f-4e28-ad18-395c8006252d None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:15.561012 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb92267e-eba1-47dc-b030-d5608af0bfab None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:15.603894 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9012bbd0-071f-4e28-ad18-395c8006252d None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:15.636863 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155563c4-a70a-4530-af03-18b3462fbfde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:15.637611 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155563c4-a70a-4530-af03-18b3462fbfde None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:15.637896 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155563c4-a70a-4530-af03-18b3462fbfde None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:15.638168 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155563c4-a70a-4530-af03-18b3462fbfde None admin] PATH_INFO: `/v3/roles/member` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:15.664670 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155563c4-a70a-4530-af03-18b3462fbfde None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:41:15.666806 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd846fb1-1d0f-4afa-8fdf-dc370d77f132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:15.667768 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd846fb1-1d0f-4afa-8fdf-dc370d77f132 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:15.668260 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd846fb1-1d0f-4afa-8fdf-dc370d77f132 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:15.668764 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd846fb1-1d0f-4afa-8fdf-dc370d77f132 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:15.669732 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd846fb1-1d0f-4afa-8fdf-dc370d77f132 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:41:15.670239 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd846fb1-1d0f-4afa-8fdf-dc370d77f132 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:15.672151 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd846fb1-1d0f-4afa-8fdf-dc370d77f132 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:15.677017 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-155563c4-a70a-4530-af03-18b3462fbfde None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:41:15.677017 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:41:15.677017 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:41:15.677017 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:41:15.677017 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:41:15.677017 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:41:15.677017 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:41:15.677017 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:41:15.677017 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:41:15.677017 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:41:15.677017 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:41:15.677017 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:41:15.677017 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:41:15.677017 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:41:15.677017 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:41:15.677017 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:41:15.677998 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:41:15.677998 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:41:15.677998 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:41:15.677998 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:41:15.677998 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:41:15.677998 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:41:15.677998 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:41:15.677998 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:41:15.677998 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:41:15.677998 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:41:15.677998 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:41:15.677998 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:41:15.677998 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:41:15.677998 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:41:15.677998 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:41:15.677998 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:41:15.678803 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:41:15.678803 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:41:15.678803 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:41:15.678803 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:41:15.678803 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:41:15.678803 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:41:15.678803 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:41:15.678803 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:41:15.678803 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:41:15.678803 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:41:15.678803 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:41:15.678803 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:41:15.678803 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 80/164] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 19 14:41:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:41:15.678803 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155563c4-a70a-4530-af03-18b3462fbfde None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:15.680931 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:15.701400 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 85/165] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 19 14:41:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:15.702870 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd846fb1-1d0f-4afa-8fdf-dc370d77f132 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:15.778145 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:15.818668 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155563c4-a70a-4530-af03-18b3462fbfde None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:15.858803 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150c96ef-b465-4cfe-a5cc-4deb34120db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:15.859453 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150c96ef-b465-4cfe-a5cc-4deb34120db4 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:15.859730 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150c96ef-b465-4cfe-a5cc-4deb34120db4 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:15.859997 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150c96ef-b465-4cfe-a5cc-4deb34120db4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:15.871149 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150c96ef-b465-4cfe-a5cc-4deb34120db4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:41:15.877006 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-150c96ef-b465-4cfe-a5cc-4deb34120db4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 14:41:15.877006 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:41:15.877006 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:41:15.877006 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:41:15.877006 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:41:15.877006 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:41:15.877006 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:41:15.877006 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:41:15.877006 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:41:15.877006 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:41:15.877006 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:41:15.877006 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:41:15.877006 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:41:15.877006 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:41:15.877006 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:41:15.877006 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:41:15.877920 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:41:15.877920 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:41:15.877920 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:41:15.877920 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:41:15.877920 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:41:15.877920 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:41:15.877920 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:41:15.877920 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:41:15.877920 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:41:15.877920 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:41:15.877920 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:41:15.877920 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:41:15.877920 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:41:15.877920 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:41:15.877920 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:41:15.877920 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:41:15.878679 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:41:15.878679 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:41:15.878679 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:41:15.878679 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:41:15.878679 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:41:15.878679 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:41:15.878679 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:41:15.878679 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:41:15.878679 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:41:15.878679 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:41:15.878679 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 14:41:15.878679 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:41:15.878679 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 81/166] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Sep 19 14:41:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:41:15.879308 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150c96ef-b465-4cfe-a5cc-4deb34120db4 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:15.926312 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd846fb1-1d0f-4afa-8fdf-dc370d77f132 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:15.954176 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:15.998597 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150c96ef-b465-4cfe-a5cc-4deb34120db4 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:16.026831 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8aa9e1-dde8-4eb0-bbd4-78c8394824fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:16.027457 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8aa9e1-dde8-4eb0-bbd4-78c8394824fa None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:16.027733 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8aa9e1-dde8-4eb0-bbd4-78c8394824fa None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:16.027996 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8aa9e1-dde8-4eb0-bbd4-78c8394824fa None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:16.028665 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8aa9e1-dde8-4eb0-bbd4-78c8394824fa None admin] RBAC: Adding query filter params (name=member) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:41:16.028961 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8aa9e1-dde8-4eb0-bbd4-78c8394824fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:16.030762 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8aa9e1-dde8-4eb0-bbd4-78c8394824fa None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:16.036298 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3a762c-ab9c-400f-a73b-0e28390a9203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:16.037203 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a762c-ab9c-400f-a73b-0e28390a9203 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:16.037641 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a762c-ab9c-400f-a73b-0e28390a9203 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:16.038082 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a762c-ab9c-400f-a73b-0e28390a9203 None admin] PATH_INFO: `/v3/users/cc650418ff744a178289e14fefc617d5` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:16.039434 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3a762c-ab9c-400f-a73b-0e28390a9203 None admin] RBAC: Authorizing `identity:get_user(user_id=cc650418ff744a178289e14fefc617d5)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:16.041232 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3a762c-ab9c-400f-a73b-0e28390a9203 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:16.043100 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 82/167] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 19 14:41:15 2022] GET /identity/v3/users/cc650418ff744a178289e14fefc617d5 => generated 247 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:16.044072 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3a762c-ab9c-400f-a73b-0e28390a9203 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:16.047746 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 86/168] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Sep 19 14:41:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:16.049558 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46345a5-9aa2-44a0-b001-539c28cd8c89 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:16.049724 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46345a5-9aa2-44a0-b001-539c28cd8c89 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:16.050019 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46345a5-9aa2-44a0-b001-539c28cd8c89 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:16.051586 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 87/169] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:41:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:41:16.054676 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46345a5-9aa2-44a0-b001-539c28cd8c89 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:16.166553 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3a762c-ab9c-400f-a73b-0e28390a9203 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:16.201467 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:16.208186 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afac4b9c-8112-4341-ad62-9e85e65191cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:16.209287 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac4b9c-8112-4341-ad62-9e85e65191cc None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:16.209745 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac4b9c-8112-4341-ad62-9e85e65191cc None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:16.210367 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac4b9c-8112-4341-ad62-9e85e65191cc None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:16.211310 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afac4b9c-8112-4341-ad62-9e85e65191cc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:41:16.211945 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afac4b9c-8112-4341-ad62-9e85e65191cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:16.213636 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afac4b9c-8112-4341-ad62-9e85e65191cc None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:16.225604 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 83/170] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 19 14:41:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:16.226956 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afac4b9c-8112-4341-ad62-9e85e65191cc None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:16.260126 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:16.282262 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46345a5-9aa2-44a0-b001-539c28cd8c89 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:16.360659 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088d15b9-87d0-42b4-8cd5-5d041c9464c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:16.361329 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d15b9-87d0-42b4-8cd5-5d041c9464c5 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:16.361604 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d15b9-87d0-42b4-8cd5-5d041c9464c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:16.363259 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d15b9-87d0-42b4-8cd5-5d041c9464c5 None admin] PATH_INFO: `/v3/users/5238072e01b240dbb2f0ada386bb22c4` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:16.365581 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088d15b9-87d0-42b4-8cd5-5d041c9464c5 None admin] RBAC: Authorizing `identity:get_user(user_id=5238072e01b240dbb2f0ada386bb22c4)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:16.367060 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088d15b9-87d0-42b4-8cd5-5d041c9464c5 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:16.370696 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afac4b9c-8112-4341-ad62-9e85e65191cc None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:16.377329 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 88/171] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 19 14:41:16 2022] GET /identity/v3/users/5238072e01b240dbb2f0ada386bb22c4 => generated 275 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:16.378633 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17e7cd-e2e3-4ba4-b59f-62663a166ce5 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:16.378959 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17e7cd-e2e3-4ba4-b59f-62663a166ce5 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:16.379229 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17e7cd-e2e3-4ba4-b59f-62663a166ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:16.405156 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-5e17e7cd-e2e3-4ba4-b59f-62663a166ce5 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:41:16.406510 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-5e17e7cd-e2e3-4ba4-b59f-62663a166ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:41:16.430550 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f5aacd-ac33-4e75-b226-65fe41f9432c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:16.431157 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f5aacd-ac33-4e75-b226-65fe41f9432c None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:16.431430 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f5aacd-ac33-4e75-b226-65fe41f9432c None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:16.431690 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f5aacd-ac33-4e75-b226-65fe41f9432c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:16.497470 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:16.506002 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f5aacd-ac33-4e75-b226-65fe41f9432c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:16.507779 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f5aacd-ac33-4e75-b226-65fe41f9432c None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:16.551499 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 89/172] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:41:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:41:16.553071 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e17e7cd-e2e3-4ba4-b59f-62663a166ce5 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:16.733947 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 84/173] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 19 14:41:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:16.735035 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f5aacd-ac33-4e75-b226-65fe41f9432c None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:16.739481 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:16.749206 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e17e7cd-e2e3-4ba4-b59f-62663a166ce5 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:16.809732 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c396a0-b57c-4617-a996-b5c3745a6289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:16.810380 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c396a0-b57c-4617-a996-b5c3745a6289 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:16.810730 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c396a0-b57c-4617-a996-b5c3745a6289 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:16.811084 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c396a0-b57c-4617-a996-b5c3745a6289 None admin] PATH_INFO: `/v3/users/5238072e01b240dbb2f0ada386bb22c4` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:16.812491 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c396a0-b57c-4617-a996-b5c3745a6289 None admin] RBAC: Authorizing `identity:get_user(user_id=5238072e01b240dbb2f0ada386bb22c4)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:16.813993 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c396a0-b57c-4617-a996-b5c3745a6289 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:16.815596 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 90/174] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 19 14:41:16 2022] GET /identity/v3/users/5238072e01b240dbb2f0ada386bb22c4 => generated 275 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:16.816412 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c396a0-b57c-4617-a996-b5c3745a6289 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:16.884697 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:16.892312 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f5aacd-ac33-4e75-b226-65fe41f9432c None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:16.927017 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c396a0-b57c-4617-a996-b5c3745a6289 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:16.930310 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0b49e1-f8fb-4ed9-b177-cdd2c13e29b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:16.931144 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b49e1-f8fb-4ed9-b177-cdd2c13e29b3 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:16.931616 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b49e1-f8fb-4ed9-b177-cdd2c13e29b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:16.932108 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b49e1-f8fb-4ed9-b177-cdd2c13e29b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:16.960182 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15581fef-984a-43ca-beea-27560402604b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:16.960799 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15581fef-984a-43ca-beea-27560402604b None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:16.961105 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15581fef-984a-43ca-beea-27560402604b None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:16.961372 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15581fef-984a-43ca-beea-27560402604b None admin] PATH_INFO: `/v3/projects/ef8c601e5bc64c818990445d938bb592` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:16.962499 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15581fef-984a-43ca-beea-27560402604b None admin] RBAC: Authorizing `identity:get_project(project_id=ef8c601e5bc64c818990445d938bb592)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:16.963941 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15581fef-984a-43ca-beea-27560402604b None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:16.965592 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 91/175] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 19 14:41:16 2022] GET /identity/v3/projects/ef8c601e5bc64c818990445d938bb592 => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:16.970190 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ab3c02-8b8a-42c8-bc9f-4cc8d8e42739 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:16.970190 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ab3c02-8b8a-42c8-bc9f-4cc8d8e42739 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:16.970190 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ab3c02-8b8a-42c8-bc9f-4cc8d8e42739 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:16.970190 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 92/176] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:41:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:41:16.970190 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ab3c02-8b8a-42c8-bc9f-4cc8d8e42739 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:17.006361 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:17.006551 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0b49e1-f8fb-4ed9-b177-cdd2c13e29b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:17.008119 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0b49e1-f8fb-4ed9-b177-cdd2c13e29b3 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:17.071366 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ab3c02-8b8a-42c8-bc9f-4cc8d8e42739 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:17.099560 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:17.105315 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9311e606-3e86-4dee-8c5f-24fe8fe0c4b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:17.105919 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9311e606-3e86-4dee-8c5f-24fe8fe0c4b2 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:17.106185 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9311e606-3e86-4dee-8c5f-24fe8fe0c4b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:17.106452 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9311e606-3e86-4dee-8c5f-24fe8fe0c4b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:17.110104 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 85/177] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 19 14:41:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:17.111336 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6d97f7-68d1-4131-be4f-dfe3c08d9114 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:17.111620 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6d97f7-68d1-4131-be4f-dfe3c08d9114 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:17.111888 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6d97f7-68d1-4131-be4f-dfe3c08d9114 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:17.113276 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 86/178] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:41:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:41:17.114151 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410292be-0754-453c-964e-bedb6ebeb2d2 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:17.114431 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410292be-0754-453c-964e-bedb6ebeb2d2 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:17.114701 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410292be-0754-453c-964e-bedb6ebeb2d2 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:17.119498 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 87/179] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:41:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:41:17.119498 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410292be-0754-453c-964e-bedb6ebeb2d2 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:17.183570 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9311e606-3e86-4dee-8c5f-24fe8fe0c4b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:17.185072 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9311e606-3e86-4dee-8c5f-24fe8fe0c4b2 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:17.219941 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:17.231709 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410292be-0754-453c-964e-bedb6ebeb2d2 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:17.266968 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce2eb81-1ce1-45ec-bf13-f075eed701f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:17.267511 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce2eb81-1ce1-45ec-bf13-f075eed701f3 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:17.267783 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce2eb81-1ce1-45ec-bf13-f075eed701f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:17.268048 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce2eb81-1ce1-45ec-bf13-f075eed701f3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:17.278618 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce2eb81-1ce1-45ec-bf13-f075eed701f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:41:17.283721 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-0ce2eb81-1ce1-45ec-bf13-f075eed701f3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:41:17.283721 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:41:17.283721 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:41:17.283721 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:41:17.283721 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:41:17.283721 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:41:17.283721 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:41:17.283721 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:41:17.283721 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:41:17.283721 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:41:17.283721 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:41:17.283721 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:41:17.283721 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:41:17.283721 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:41:17.283721 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:41:17.283721 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:41:17.284767 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:41:17.284767 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:41:17.284767 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:41:17.284767 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:41:17.284767 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:41:17.284767 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:41:17.284767 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:41:17.284767 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:41:17.284767 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:41:17.284767 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:41:17.284767 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:41:17.284767 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:41:17.284767 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:41:17.284767 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:41:17.284767 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:41:17.284767 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:41:17.285747 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:41:17.285747 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:41:17.285747 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:41:17.285747 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:41:17.285747 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:41:17.285747 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:41:17.285747 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:41:17.285747 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:41:17.285747 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:41:17.285747 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:41:17.285747 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:41:17.285747 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:41:17.285747 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 88/180] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 19 14:41:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:41:17.285747 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce2eb81-1ce1-45ec-bf13-f075eed701f3 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:17.296654 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 93/181] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 19 14:41:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:17.298074 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775c9384-5dad-4cbc-85ea-fb6ab509d0f4 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:17.298352 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775c9384-5dad-4cbc-85ea-fb6ab509d0f4 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:17.298620 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775c9384-5dad-4cbc-85ea-fb6ab509d0f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:17.318240 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-775c9384-5dad-4cbc-85ea-fb6ab509d0f4 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:41:17.319440 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-775c9384-5dad-4cbc-85ea-fb6ab509d0f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:41:17.354908 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:17.406926 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce2eb81-1ce1-45ec-bf13-f075eed701f3 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:17.409817 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 94/182] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:41:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:41:17.410650 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775c9384-5dad-4cbc-85ea-fb6ab509d0f4 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:17.447644 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcf793b-be93-49cb-ac67-f51fc372c79f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:17.448359 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf793b-be93-49cb-ac67-f51fc372c79f None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:17.448697 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf793b-be93-49cb-ac67-f51fc372c79f None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:17.449014 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf793b-be93-49cb-ac67-f51fc372c79f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:17.449725 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcf793b-be93-49cb-ac67-f51fc372c79f None admin] RBAC: Adding query filter params (role.id=019bde1756cb40de8ce06cef6b261f79, scope.project.id=ef8c601e5bc64c818990445d938bb592, user.id=cc650418ff744a178289e14fefc617d5) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:41:17.450068 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcf793b-be93-49cb-ac67-f51fc372c79f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:17.451482 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcf793b-be93-49cb-ac67-f51fc372c79f None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:17.457691 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 89/183] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 19 14:41:17 2022] GET /identity/v3/role_assignments?user.id=cc650418ff744a178289e14fefc617d5&scope.project.id=ef8c601e5bc64c818990445d938bb592&role.id=019bde1756cb40de8ce06cef6b261f79 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:17.459046 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71291c6c-2b01-4dfb-a1bc-4c5eb0f506ae None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:17.459164 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71291c6c-2b01-4dfb-a1bc-4c5eb0f506ae None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:17.459437 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71291c6c-2b01-4dfb-a1bc-4c5eb0f506ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:17.491103 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-71291c6c-2b01-4dfb-a1bc-4c5eb0f506ae None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:41:17.493329 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-71291c6c-2b01-4dfb-a1bc-4c5eb0f506ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:41:17.527748 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:17.579473 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775c9384-5dad-4cbc-85ea-fb6ab509d0f4 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:17.588724 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 90/184] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:41:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:41:17.590373 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6455918-106c-4468-b39c-8d671972cc39 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:17.590863 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6455918-106c-4468-b39c-8d671972cc39 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:17.591362 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6455918-106c-4468-b39c-8d671972cc39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:17.612160 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-a6455918-106c-4468-b39c-8d671972cc39 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:41:17.613898 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-a6455918-106c-4468-b39c-8d671972cc39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:41:17.659548 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fff3780-78f3-4015-acf9-d4c05aff6df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:17.661556 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fff3780-78f3-4015-acf9-d4c05aff6df0 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:17.662626 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fff3780-78f3-4015-acf9-d4c05aff6df0 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:17.663104 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fff3780-78f3-4015-acf9-d4c05aff6df0 None admin] PATH_INFO: `/v3/projects/6097cde96e2c4a8cb4c8d8b1c5258e87` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:17.666376 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fff3780-78f3-4015-acf9-d4c05aff6df0 None admin] RBAC: Authorizing `identity:get_project(project_id=6097cde96e2c4a8cb4c8d8b1c5258e87)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:17.668690 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fff3780-78f3-4015-acf9-d4c05aff6df0 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:17.673272 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 95/185] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 19 14:41:17 2022] GET /identity/v3/projects/6097cde96e2c4a8cb4c8d8b1c5258e87 => generated 312 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:17.676585 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fff3780-78f3-4015-acf9-d4c05aff6df0 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:17.701247 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:17.736881 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 91/186] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:41:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:41:17.738100 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6455918-106c-4468-b39c-8d671972cc39 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:17.836785 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fff3780-78f3-4015-acf9-d4c05aff6df0 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:17.874802 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6455918-106c-4468-b39c-8d671972cc39 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:17.879072 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:17.891847 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373d5f7f-db14-46d8-90b7-f6a7cba4d754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:17.892467 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373d5f7f-db14-46d8-90b7-f6a7cba4d754 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:17.892743 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373d5f7f-db14-46d8-90b7-f6a7cba4d754 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:17.895624 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373d5f7f-db14-46d8-90b7-f6a7cba4d754 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:17.895624 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373d5f7f-db14-46d8-90b7-f6a7cba4d754 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:41:17.895624 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373d5f7f-db14-46d8-90b7-f6a7cba4d754 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:17.895624 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373d5f7f-db14-46d8-90b7-f6a7cba4d754 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:17.907435 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 96/187] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 19 14:41:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:17.908264 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373d5f7f-db14-46d8-90b7-f6a7cba4d754 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:17.929929 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69c4e9c-cb95-4e96-8df8-af4db6aba2a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:17.930573 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69c4e9c-cb95-4e96-8df8-af4db6aba2a7 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:17.930957 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69c4e9c-cb95-4e96-8df8-af4db6aba2a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:17.931226 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69c4e9c-cb95-4e96-8df8-af4db6aba2a7 None admin] PATH_INFO: `/v3/projects/ef8c601e5bc64c818990445d938bb592` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:17.932470 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69c4e9c-cb95-4e96-8df8-af4db6aba2a7 None admin] RBAC: Authorizing `identity:get_project(project_id=ef8c601e5bc64c818990445d938bb592)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:17.933960 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69c4e9c-cb95-4e96-8df8-af4db6aba2a7 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:17.935900 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 92/188] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 19 14:41:17 2022] GET /identity/v3/projects/ef8c601e5bc64c818990445d938bb592 => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:17.936739 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69c4e9c-cb95-4e96-8df8-af4db6aba2a7 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:17.991390 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:18.020178 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373d5f7f-db14-46d8-90b7-f6a7cba4d754 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:18.051746 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69c4e9c-cb95-4e96-8df8-af4db6aba2a7 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:18.055129 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ad321e-5cd1-4ce9-8ca5-fafaf0b4db17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:18.055729 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad321e-5cd1-4ce9-8ca5-fafaf0b4db17 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:18.056003 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad321e-5cd1-4ce9-8ca5-fafaf0b4db17 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:18.056269 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad321e-5cd1-4ce9-8ca5-fafaf0b4db17 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:18.056983 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ad321e-5cd1-4ce9-8ca5-fafaf0b4db17 None admin] RBAC: Adding query filter params (role.id=74de6794e3b3422b93d26f993d260c35, scope.project.id=6097cde96e2c4a8cb4c8d8b1c5258e87, user.id=5238072e01b240dbb2f0ada386bb22c4) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:41:18.057315 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ad321e-5cd1-4ce9-8ca5-fafaf0b4db17 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:18.058745 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ad321e-5cd1-4ce9-8ca5-fafaf0b4db17 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:18.064484 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 97/189] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 19 14:41:17 2022] GET /identity/v3/role_assignments?user.id=5238072e01b240dbb2f0ada386bb22c4&scope.project.id=6097cde96e2c4a8cb4c8d8b1c5258e87&role.id=74de6794e3b3422b93d26f993d260c35 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:18.064484 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ad321e-5cd1-4ce9-8ca5-fafaf0b4db17 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:18.099761 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2480067-2777-4c07-9877-0284f1846fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:18.100371 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2480067-2777-4c07-9877-0284f1846fb4 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:18.100584 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2480067-2777-4c07-9877-0284f1846fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:18.100849 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2480067-2777-4c07-9877-0284f1846fb4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:18.114114 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2480067-2777-4c07-9877-0284f1846fb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:41:18.123289 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-d2480067-2777-4c07-9877-0284f1846fb4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 14:41:18.123289 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:41:18.123289 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:41:18.123289 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:41:18.123289 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:41:18.123289 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:41:18.123289 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:41:18.123289 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:41:18.123289 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:41:18.123289 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:41:18.123289 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:41:18.123289 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:41:18.123289 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:41:18.123289 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:41:18.123289 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:41:18.123289 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:41:18.124394 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:41:18.124394 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:41:18.124394 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:41:18.124394 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:41:18.124394 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:41:18.124394 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:41:18.124394 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:41:18.124394 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:41:18.124394 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:41:18.124394 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:41:18.124394 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:41:18.124394 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:41:18.124394 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:41:18.124394 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:41:18.124394 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:41:18.124394 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:41:18.125371 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:41:18.125371 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:41:18.125371 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:41:18.125371 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:41:18.125371 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:41:18.125371 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:41:18.125371 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:41:18.125371 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:41:18.125371 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:41:18.125371 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:41:18.125371 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 14:41:18.125371 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:41:18.125371 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 93/190] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Sep 19 14:41:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:41:18.125371 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2480067-2777-4c07-9877-0284f1846fb4 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:18.147393 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:18.195404 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ad321e-5cd1-4ce9-8ca5-fafaf0b4db17 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:18.233535 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971b7d77-6310-4398-baf1-208305b65b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:18.234241 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b7d77-6310-4398-baf1-208305b65b2c None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:18.234358 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b7d77-6310-4398-baf1-208305b65b2c None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:18.234634 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b7d77-6310-4398-baf1-208305b65b2c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:18.235831 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971b7d77-6310-4398-baf1-208305b65b2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:18.237365 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971b7d77-6310-4398-baf1-208305b65b2c None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:18.239181 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 98/191] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:41:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:18.244692 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971b7d77-6310-4398-baf1-208305b65b2c None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:18.265847 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2480067-2777-4c07-9877-0284f1846fb4 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:18.269389 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:18.311099 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a3bdb7-4e6b-4af2-be2b-66af06254162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:18.311839 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a3bdb7-4e6b-4af2-be2b-66af06254162 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:18.312114 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a3bdb7-4e6b-4af2-be2b-66af06254162 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:18.312379 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a3bdb7-4e6b-4af2-be2b-66af06254162 None admin] PATH_INFO: `/v3/users/098c2d80960448799e1de59ef2c02826` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:18.327427 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a3bdb7-4e6b-4af2-be2b-66af06254162 None admin] RBAC: Authorizing `identity:get_user(user_id=098c2d80960448799e1de59ef2c02826)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:18.328900 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a3bdb7-4e6b-4af2-be2b-66af06254162 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:18.331209 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 94/192] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 19 14:41:18 2022] GET /identity/v3/users/098c2d80960448799e1de59ef2c02826 => generated 283 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:18.331720 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a3bdb7-4e6b-4af2-be2b-66af06254162 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:18.363276 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971b7d77-6310-4398-baf1-208305b65b2c None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:18.388679 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:18.397891 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91666c1b-a278-44d0-9fc7-8dbd19892237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:18.398491 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91666c1b-a278-44d0-9fc7-8dbd19892237 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:18.398764 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91666c1b-a278-44d0-9fc7-8dbd19892237 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:18.399055 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91666c1b-a278-44d0-9fc7-8dbd19892237 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:18.399762 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91666c1b-a278-44d0-9fc7-8dbd19892237 None admin] RBAC: Adding query filter params (role.id=ae7ed67e62684598a31185ab16c971ce, scope.project.id=ef8c601e5bc64c818990445d938bb592, user.id=5238072e01b240dbb2f0ada386bb22c4) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:41:18.400135 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91666c1b-a278-44d0-9fc7-8dbd19892237 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:18.401619 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91666c1b-a278-44d0-9fc7-8dbd19892237 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:18.407604 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 99/193] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 19 14:41:18 2022] GET /identity/v3/role_assignments?user.id=5238072e01b240dbb2f0ada386bb22c4&scope.project.id=ef8c601e5bc64c818990445d938bb592&role.id=ae7ed67e62684598a31185ab16c971ce => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:18.409890 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91666c1b-a278-44d0-9fc7-8dbd19892237 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:18.460860 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a3bdb7-4e6b-4af2-be2b-66af06254162 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:18.523607 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1f5b13-0b3e-4139-b4ef-28a5212c6c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:18.524598 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f5b13-0b3e-4139-b4ef-28a5212c6c35 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:18.525084 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f5b13-0b3e-4139-b4ef-28a5212c6c35 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:18.525540 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f5b13-0b3e-4139-b4ef-28a5212c6c35 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:18.545359 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1f5b13-0b3e-4139-b4ef-28a5212c6c35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:41:18.551267 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-be1f5b13-0b3e-4139-b4ef-28a5212c6c35 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 14:41:18.551267 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:41:18.551267 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:41:18.551267 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:41:18.551267 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:41:18.551267 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:41:18.551267 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:41:18.551267 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:41:18.551267 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:41:18.551267 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:41:18.551267 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:41:18.551267 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:41:18.551267 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:41:18.551267 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:41:18.551267 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:41:18.551267 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:41:18.552180 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:41:18.552180 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:41:18.552180 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:41:18.552180 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:41:18.552180 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:41:18.552180 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:41:18.552180 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:41:18.552180 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:41:18.552180 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:41:18.552180 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:41:18.552180 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:41:18.552180 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:41:18.552180 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:41:18.552180 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:41:18.552180 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:41:18.552180 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:41:18.552959 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:41:18.552959 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:41:18.552959 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:41:18.552959 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:41:18.552959 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:41:18.552959 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:41:18.552959 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:41:18.552959 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:41:18.552959 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:41:18.552959 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:41:18.552959 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 14:41:18.552959 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:41:18.552959 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 95/194] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 19 14:41:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:41:18.553742 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1f5b13-0b3e-4139-b4ef-28a5212c6c35 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:18.562492 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91666c1b-a278-44d0-9fc7-8dbd19892237 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:18.584929 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:18.610333 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b46001-2e23-4b96-82b2-710cb4a37589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:18.610971 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b46001-2e23-4b96-82b2-710cb4a37589 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:18.611271 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b46001-2e23-4b96-82b2-710cb4a37589 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:18.611562 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b46001-2e23-4b96-82b2-710cb4a37589 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:18.612620 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b46001-2e23-4b96-82b2-710cb4a37589 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:41:18.612620 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b46001-2e23-4b96-82b2-710cb4a37589 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:18.614055 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b46001-2e23-4b96-82b2-710cb4a37589 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:18.623391 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 100/195] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 19 14:41:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:18.624265 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b46001-2e23-4b96-82b2-710cb4a37589 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:18.677425 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1f5b13-0b3e-4139-b4ef-28a5212c6c35 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:18.687895 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:18.712627 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199735c8-344c-470f-9ec4-40ae38180e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:18.713237 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199735c8-344c-470f-9ec4-40ae38180e30 None admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:18.713517 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199735c8-344c-470f-9ec4-40ae38180e30 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:18.713815 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199735c8-344c-470f-9ec4-40ae38180e30 None admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:18.714461 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199735c8-344c-470f-9ec4-40ae38180e30 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:18.715887 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199735c8-344c-470f-9ec4-40ae38180e30 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:18.735182 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b46001-2e23-4b96-82b2-710cb4a37589 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:18.740083 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 96/196] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Sep 19 14:41:18 2022] POST /identity/v3/users => generated 297 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:41:18.749163 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199735c8-344c-470f-9ec4-40ae38180e30 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:18.794207 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4695fc-119c-4ac9-95c9-beb4a6e5a635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:18.794911 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4695fc-119c-4ac9-95c9-beb4a6e5a635 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:18.795176 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4695fc-119c-4ac9-95c9-beb4a6e5a635 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:18.795387 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4695fc-119c-4ac9-95c9-beb4a6e5a635 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:18.846656 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:18.873516 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199735c8-344c-470f-9ec4-40ae38180e30 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:18.882000 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4695fc-119c-4ac9-95c9-beb4a6e5a635 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:18.883491 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4695fc-119c-4ac9-95c9-beb4a6e5a635 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:18.914679 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21172c4d-199f-47da-9c9d-0396eb268edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:18.915295 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21172c4d-199f-47da-9c9d-0396eb268edb None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:18.915582 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21172c4d-199f-47da-9c9d-0396eb268edb None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:18.915865 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21172c4d-199f-47da-9c9d-0396eb268edb None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:18.916569 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21172c4d-199f-47da-9c9d-0396eb268edb None admin] RBAC: Adding query filter params (name=reader) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:41:18.916877 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21172c4d-199f-47da-9c9d-0396eb268edb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:18.918294 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21172c4d-199f-47da-9c9d-0396eb268edb None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:18.929138 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 97/197] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Sep 19 14:41:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:18.929998 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21172c4d-199f-47da-9c9d-0396eb268edb None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:18.954461 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:19.032632 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 101/198] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 19 14:41:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:19.033847 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4695fc-119c-4ac9-95c9-beb4a6e5a635 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:19.089694 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21172c4d-199f-47da-9c9d-0396eb268edb None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:19.136533 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6c45b4-a7b3-41cd-aecc-e831b0bbc14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:19.138690 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c45b4-a7b3-41cd-aecc-e831b0bbc14a None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:19.138690 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c45b4-a7b3-41cd-aecc-e831b0bbc14a None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:19.138690 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c45b4-a7b3-41cd-aecc-e831b0bbc14a None admin] PATH_INFO: `/v3/users/098c2d80960448799e1de59ef2c02826` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:19.139411 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6c45b4-a7b3-41cd-aecc-e831b0bbc14a None admin] RBAC: Authorizing `identity:get_user(user_id=098c2d80960448799e1de59ef2c02826)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:19.141869 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6c45b4-a7b3-41cd-aecc-e831b0bbc14a None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:19.142868 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 98/199] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 19 14:41:18 2022] GET /identity/v3/users/098c2d80960448799e1de59ef2c02826 => generated 283 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:19.143488 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6c45b4-a7b3-41cd-aecc-e831b0bbc14a None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:19.157670 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:19.169609 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4695fc-119c-4ac9-95c9-beb4a6e5a635 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:19.216594 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abd2f10-dc14-485b-85b8-62fcabd2633c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:19.217390 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abd2f10-dc14-485b-85b8-62fcabd2633c None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:19.217804 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abd2f10-dc14-485b-85b8-62fcabd2633c None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:19.218121 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abd2f10-dc14-485b-85b8-62fcabd2633c None admin] PATH_INFO: `/v3/users/559bc742447647969944d2848f17f106` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:19.220247 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abd2f10-dc14-485b-85b8-62fcabd2633c None admin] RBAC: Authorizing `identity:get_user(user_id=559bc742447647969944d2848f17f106)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:19.221692 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abd2f10-dc14-485b-85b8-62fcabd2633c None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:19.223324 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 102/200] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 19 14:41:19 2022] GET /identity/v3/users/559bc742447647969944d2848f17f106 => generated 289 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:19.224088 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abd2f10-dc14-485b-85b8-62fcabd2633c None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:19.248723 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:19.282220 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6c45b4-a7b3-41cd-aecc-e831b0bbc14a None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:19.338521 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e112ef-b9db-4d78-8362-8a8f232febc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:19.339162 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e112ef-b9db-4d78-8362-8a8f232febc1 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:19.339438 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e112ef-b9db-4d78-8362-8a8f232febc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:19.339922 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e112ef-b9db-4d78-8362-8a8f232febc1 None admin] PATH_INFO: `/v3/projects/e5026d679036436ab5fab42a948bc2a7` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:19.341943 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e112ef-b9db-4d78-8362-8a8f232febc1 None admin] RBAC: Authorizing `identity:get_project(project_id=e5026d679036436ab5fab42a948bc2a7)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:19.345294 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e112ef-b9db-4d78-8362-8a8f232febc1 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:19.346330 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abd2f10-dc14-485b-85b8-62fcabd2633c None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:19.348226 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 99/201] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 19 14:41:19 2022] GET /identity/v3/projects/e5026d679036436ab5fab42a948bc2a7 => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:19.350339 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e112ef-b9db-4d78-8362-8a8f232febc1 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:19.389598 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9408672f-e81b-4b99-8367-ecb20e9b74f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:19.390315 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408672f-e81b-4b99-8367-ecb20e9b74f9 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:19.390520 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408672f-e81b-4b99-8367-ecb20e9b74f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:19.390783 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408672f-e81b-4b99-8367-ecb20e9b74f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:19.465173 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9408672f-e81b-4b99-8367-ecb20e9b74f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:19.466302 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9408672f-e81b-4b99-8367-ecb20e9b74f9 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:19.468844 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:19.491647 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:19.505358 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e112ef-b9db-4d78-8362-8a8f232febc1 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:19.545359 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b18b03f-7f3e-4415-ad4a-a6ac248e3175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:19.546303 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b18b03f-7f3e-4415-ad4a-a6ac248e3175 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:19.546585 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b18b03f-7f3e-4415-ad4a-a6ac248e3175 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:19.546906 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b18b03f-7f3e-4415-ad4a-a6ac248e3175 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:19.599384 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 103/202] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 19 14:41:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:19.604114 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9408672f-e81b-4b99-8367-ecb20e9b74f9 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:19.641172 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b18b03f-7f3e-4415-ad4a-a6ac248e3175 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:19.642570 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b18b03f-7f3e-4415-ad4a-a6ac248e3175 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:19.716226 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9408672f-e81b-4b99-8367-ecb20e9b74f9 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:19.738298 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:19.741386 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:19.755171 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630c6fc8-1fb3-4829-a945-aaee59c351a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:19.755772 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630c6fc8-1fb3-4829-a945-aaee59c351a3 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:19.756045 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630c6fc8-1fb3-4829-a945-aaee59c351a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:19.756312 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630c6fc8-1fb3-4829-a945-aaee59c351a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:19.757056 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630c6fc8-1fb3-4829-a945-aaee59c351a3 None admin] RBAC: Adding query filter params (role.id=019bde1756cb40de8ce06cef6b261f79, scope.project.id=e5026d679036436ab5fab42a948bc2a7, user.id=098c2d80960448799e1de59ef2c02826) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:41:19.757362 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630c6fc8-1fb3-4829-a945-aaee59c351a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:19.759581 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630c6fc8-1fb3-4829-a945-aaee59c351a3 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:19.766953 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 104/203] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 19 14:41:19 2022] GET /identity/v3/role_assignments?user.id=098c2d80960448799e1de59ef2c02826&scope.project.id=e5026d679036436ab5fab42a948bc2a7&role.id=019bde1756cb40de8ce06cef6b261f79 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:19.767807 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630c6fc8-1fb3-4829-a945-aaee59c351a3 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:19.778046 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 100/204] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 19 14:41:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:19.785879 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b18b03f-7f3e-4415-ad4a-a6ac248e3175 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:19.949181 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630c6fc8-1fb3-4829-a945-aaee59c351a3 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:19.990427 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dda12d6-85ae-4ae6-bc5e-86b784b87d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:19.991492 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dda12d6-85ae-4ae6-bc5e-86b784b87d62 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:19.991993 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dda12d6-85ae-4ae6-bc5e-86b784b87d62 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:19.992463 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dda12d6-85ae-4ae6-bc5e-86b784b87d62 None admin] PATH_INFO: `/v3/projects/e5026d679036436ab5fab42a948bc2a7` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:19.993834 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dda12d6-85ae-4ae6-bc5e-86b784b87d62 None admin] RBAC: Authorizing `identity:get_project(project_id=e5026d679036436ab5fab42a948bc2a7)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:19.995492 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dda12d6-85ae-4ae6-bc5e-86b784b87d62 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:19.997353 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 105/205] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 19 14:41:19 2022] GET /identity/v3/projects/e5026d679036436ab5fab42a948bc2a7 => generated 302 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:20.005529 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dda12d6-85ae-4ae6-bc5e-86b784b87d62 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:20.024965 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b18b03f-7f3e-4415-ad4a-a6ac248e3175 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:20.062733 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b251b3d1-8e21-4f3e-9052-de05a2288907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:20.063494 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b251b3d1-8e21-4f3e-9052-de05a2288907 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:20.063840 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b251b3d1-8e21-4f3e-9052-de05a2288907 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:20.064176 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b251b3d1-8e21-4f3e-9052-de05a2288907 None admin] PATH_INFO: `/v3/projects/ef8c601e5bc64c818990445d938bb592` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:20.065528 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b251b3d1-8e21-4f3e-9052-de05a2288907 None admin] RBAC: Authorizing `identity:get_project(project_id=ef8c601e5bc64c818990445d938bb592)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:20.067052 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b251b3d1-8e21-4f3e-9052-de05a2288907 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:20.068779 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 101/206] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 19 14:41:19 2022] GET /identity/v3/projects/ef8c601e5bc64c818990445d938bb592 => generated 298 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:20.072436 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:20.077897 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b251b3d1-8e21-4f3e-9052-de05a2288907 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:20.124829 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dda12d6-85ae-4ae6-bc5e-86b784b87d62 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:20.134515 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:20.160842 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc779a62-8f0c-4ce8-8590-40294c3f26fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:20.161515 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc779a62-8f0c-4ce8-8590-40294c3f26fc None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:20.161794 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc779a62-8f0c-4ce8-8590-40294c3f26fc None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:20.162120 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc779a62-8f0c-4ce8-8590-40294c3f26fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:20.162845 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc779a62-8f0c-4ce8-8590-40294c3f26fc None admin] RBAC: Adding query filter params (role.id=ae7ed67e62684598a31185ab16c971ce, scope.project.id=e5026d679036436ab5fab42a948bc2a7, user.id=098c2d80960448799e1de59ef2c02826) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:41:20.163237 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc779a62-8f0c-4ce8-8590-40294c3f26fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:20.164680 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc779a62-8f0c-4ce8-8590-40294c3f26fc None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:20.177202 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 106/207] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 19 14:41:20 2022] GET /identity/v3/role_assignments?user.id=098c2d80960448799e1de59ef2c02826&scope.project.id=e5026d679036436ab5fab42a948bc2a7&role.id=ae7ed67e62684598a31185ab16c971ce => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:20.207612 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b251b3d1-8e21-4f3e-9052-de05a2288907 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:20.263752 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70f4061-7def-4740-b1c3-c40255f0c81c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:20.264883 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f4061-7def-4740-b1c3-c40255f0c81c None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:20.265488 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f4061-7def-4740-b1c3-c40255f0c81c None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:20.265977 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f4061-7def-4740-b1c3-c40255f0c81c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:20.266928 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70f4061-7def-4740-b1c3-c40255f0c81c None admin] RBAC: Adding query filter params (role.id=f23b6d2ba5de4bf68b75b7fa1a4f1b84, scope.project.id=ef8c601e5bc64c818990445d938bb592, user.id=559bc742447647969944d2848f17f106) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:41:20.267440 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70f4061-7def-4740-b1c3-c40255f0c81c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:20.269180 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70f4061-7def-4740-b1c3-c40255f0c81c None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:20.276542 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 102/208] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 19 14:41:20 2022] GET /identity/v3/role_assignments?user.id=559bc742447647969944d2848f17f106&scope.project.id=ef8c601e5bc64c818990445d938bb592&role.id=f23b6d2ba5de4bf68b75b7fa1a4f1b84 => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:21.424393 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c51206-71bc-43d1-91be-ec47b0210181 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:21.425455 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c51206-71bc-43d1-91be-ec47b0210181 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:21.425939 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c51206-71bc-43d1-91be-ec47b0210181 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:21.427568 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 107/209] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:41:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:41:21.429237 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c11736-ecad-4fd3-9e51-fffc73b304c9 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:21.429685 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c11736-ecad-4fd3-9e51-fffc73b304c9 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:21.429761 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c11736-ecad-4fd3-9e51-fffc73b304c9 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:21.431240 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 103/210] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:41:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:41:21.437110 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aadcf8-9895-46f3-9453-9b5f02997c00 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:21.437641 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a74ed9-9fd0-4306-b588-5913896c2ead None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:21.437777 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aadcf8-9895-46f3-9453-9b5f02997c00 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:21.437944 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aadcf8-9895-46f3-9453-9b5f02997c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:21.438406 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a74ed9-9fd0-4306-b588-5913896c2ead None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:21.438873 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a74ed9-9fd0-4306-b588-5913896c2ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:21.459453 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-75a74ed9-9fd0-4306-b588-5913896c2ead None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:41:21.459680 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-46aadcf8-9895-46f3-9453-9b5f02997c00 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:41:21.460711 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-46aadcf8-9895-46f3-9453-9b5f02997c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:41:21.461382 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-75a74ed9-9fd0-4306-b588-5913896c2ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:41:21.552917 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 108/211] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:41:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 14:41:21.564399 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 104/212] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:41:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 14:41:21.836509 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aadcf8-9895-46f3-9453-9b5f02997c00 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:21.862466 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a74ed9-9fd0-4306-b588-5913896c2ead None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:21.893551 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:21.934112 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:21.962981 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aadcf8-9895-46f3-9453-9b5f02997c00 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:22.012035 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d80ce0-aeaa-4325-bd2d-77e1e30126cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:22.013905 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d80ce0-aeaa-4325-bd2d-77e1e30126cf None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:22.014497 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d80ce0-aeaa-4325-bd2d-77e1e30126cf None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:22.014982 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d80ce0-aeaa-4325-bd2d-77e1e30126cf None admin] PATH_INFO: `/v3/domains/default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:22.017097 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d80ce0-aeaa-4325-bd2d-77e1e30126cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:22.020725 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d80ce0-aeaa-4325-bd2d-77e1e30126cf None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:22.030777 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a74ed9-9fd0-4306-b588-5913896c2ead None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:22.031343 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 109/213] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:41:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:22.033189 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d80ce0-aeaa-4325-bd2d-77e1e30126cf None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:22.070042 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbce37e-048c-44e8-a9de-0355793cf667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:22.071211 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbce37e-048c-44e8-a9de-0355793cf667 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:22.071665 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbce37e-048c-44e8-a9de-0355793cf667 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:22.072122 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbce37e-048c-44e8-a9de-0355793cf667 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:22.083993 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbce37e-048c-44e8-a9de-0355793cf667 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:41:22.090985 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-1dbce37e-048c-44e8-a9de-0355793cf667 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:41:22.090985 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:41:22.090985 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:41:22.090985 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:41:22.090985 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:41:22.090985 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:41:22.090985 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:41:22.090985 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:41:22.090985 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:41:22.090985 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:41:22.090985 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:41:22.090985 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:41:22.090985 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:41:22.090985 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:41:22.090985 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:41:22.090985 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:41:22.091828 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:41:22.091828 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:41:22.091828 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:41:22.091828 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:41:22.091828 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:41:22.091828 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:41:22.091828 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:41:22.091828 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:41:22.091828 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:41:22.091828 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:41:22.091828 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:41:22.091828 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:41:22.091828 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:41:22.091828 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:41:22.091828 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:41:22.091828 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:41:22.092678 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:41:22.092678 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:41:22.092678 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:41:22.092678 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:41:22.092678 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:41:22.092678 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:41:22.092678 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:41:22.092678 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:41:22.092678 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:41:22.092678 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:41:22.092678 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:41:22.092678 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:41:22.100215 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 105/214] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 19 14:41:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:41:22.101509 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbce37e-048c-44e8-a9de-0355793cf667 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:22.146565 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d80ce0-aeaa-4325-bd2d-77e1e30126cf None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:22.161625 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:22.183464 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7999d1f4-5484-4146-99e0-59eecb28e9e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:22.184413 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7999d1f4-5484-4146-99e0-59eecb28e9e5 None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:22.184871 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7999d1f4-5484-4146-99e0-59eecb28e9e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:22.185381 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7999d1f4-5484-4146-99e0-59eecb28e9e5 None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:22.186453 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7999d1f4-5484-4146-99e0-59eecb28e9e5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:22.188118 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7999d1f4-5484-4146-99e0-59eecb28e9e5 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:22.213277 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 110/215] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Sep 19 14:41:22 2022] POST /identity/v3/users => generated 297 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:41:22.227307 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbce37e-048c-44e8-a9de-0355793cf667 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:22.242795 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:22.271513 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb69302-918c-4eb4-880c-3bc0034aa873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:22.272617 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb69302-918c-4eb4-880c-3bc0034aa873 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:22.273152 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb69302-918c-4eb4-880c-3bc0034aa873 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:22.273619 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb69302-918c-4eb4-880c-3bc0034aa873 None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:22.274547 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb69302-918c-4eb4-880c-3bc0034aa873 None admin] RBAC: Adding query filter params (name=member) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:41:22.275142 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb69302-918c-4eb4-880c-3bc0034aa873 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:22.276735 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb69302-918c-4eb4-880c-3bc0034aa873 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:22.287118 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 106/216] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Sep 19 14:41:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:22.295201 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7999d1f4-5484-4146-99e0-59eecb28e9e5 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:22.420217 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7999d1f4-5484-4146-99e0-59eecb28e9e5 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:22.460335 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60a1248-5bae-4b98-b60d-7b3710777a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:22.461160 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a1248-5bae-4b98-b60d-7b3710777a6b None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:22.461284 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a1248-5bae-4b98-b60d-7b3710777a6b None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:22.461547 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a1248-5bae-4b98-b60d-7b3710777a6b None admin] PATH_INFO: `/v3/users/1b380e8f3600405aa3fdc10d224283db` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:22.488324 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60a1248-5bae-4b98-b60d-7b3710777a6b None admin] RBAC: Authorizing `identity:get_user(user_id=1b380e8f3600405aa3fdc10d224283db)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:22.491614 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60a1248-5bae-4b98-b60d-7b3710777a6b None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:22.494765 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 111/217] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 19 14:41:22 2022] GET /identity/v3/users/1b380e8f3600405aa3fdc10d224283db => generated 297 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:22.504144 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb69302-918c-4eb4-880c-3bc0034aa873 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:22.531785 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a6928e-c691-4911-a2ad-b0d18063495e None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:22.532113 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a6928e-c691-4911-a2ad-b0d18063495e None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:22.532338 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a6928e-c691-4911-a2ad-b0d18063495e None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:22.533727 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 112/218] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:41:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:41:22.541312 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c4cf0f-5a25-4f30-a9b0-63b875b25578 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:22.541648 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c4cf0f-5a25-4f30-a9b0-63b875b25578 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:22.541830 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c4cf0f-5a25-4f30-a9b0-63b875b25578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:22.569678 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-c1c4cf0f-5a25-4f30-a9b0-63b875b25578 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:41:22.571320 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-c1c4cf0f-5a25-4f30-a9b0-63b875b25578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:41:22.598000 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:22.657719 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 113/219] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:41:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:41:22.662935 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb69302-918c-4eb4-880c-3bc0034aa873 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:22.707457 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f5aa86-f8d7-4b6c-9187-a9cbfc0eb72c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:22.708001 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f5aa86-f8d7-4b6c-9187-a9cbfc0eb72c None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:22.708281 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f5aa86-f8d7-4b6c-9187-a9cbfc0eb72c None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:22.708557 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f5aa86-f8d7-4b6c-9187-a9cbfc0eb72c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:22.753026 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:22.804755 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f5aa86-f8d7-4b6c-9187-a9cbfc0eb72c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:22.806295 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f5aa86-f8d7-4b6c-9187-a9cbfc0eb72c None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:22.925174 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 107/220] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 19 14:41:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:22.933162 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c4cf0f-5a25-4f30-a9b0-63b875b25578 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:22.947566 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e7f17-98fb-4a88-b38c-c2a9b4de58a7 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:22.948080 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e7f17-98fb-4a88-b38c-c2a9b4de58a7 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:22.948492 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e7f17-98fb-4a88-b38c-c2a9b4de58a7 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:22.950070 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 108/221] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:41:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:41:22.955761 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dca1668-4c34-4e1f-8460-cf4c1ea1cca4 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:22.956335 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dca1668-4c34-4e1f-8460-cf4c1ea1cca4 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:22.956806 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dca1668-4c34-4e1f-8460-cf4c1ea1cca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:22.981573 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-3dca1668-4c34-4e1f-8460-cf4c1ea1cca4 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:41:22.983185 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-3dca1668-4c34-4e1f-8460-cf4c1ea1cca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:41:23.049165 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:23.065134 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 109/222] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:41:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 14:41:23.065659 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c4cf0f-5a25-4f30-a9b0-63b875b25578 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:23.066169 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dca1668-4c34-4e1f-8460-cf4c1ea1cca4 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:23.105759 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e643f0f-38ad-4617-80ff-747520f519ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:23.106799 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e643f0f-38ad-4617-80ff-747520f519ed None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:23.107270 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e643f0f-38ad-4617-80ff-747520f519ed None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:23.107811 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e643f0f-38ad-4617-80ff-747520f519ed None admin] PATH_INFO: `/v3/projects/e5026d679036436ab5fab42a948bc2a7` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:23.109908 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e643f0f-38ad-4617-80ff-747520f519ed None admin] RBAC: Authorizing `identity:get_project(project_id=e5026d679036436ab5fab42a948bc2a7)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:23.111728 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e643f0f-38ad-4617-80ff-747520f519ed None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:23.113744 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 114/223] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 19 14:41:22 2022] GET /identity/v3/projects/e5026d679036436ab5fab42a948bc2a7 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:23.125044 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e643f0f-38ad-4617-80ff-747520f519ed None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:23.150406 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:23.239606 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e643f0f-38ad-4617-80ff-747520f519ed None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:23.289049 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b91921-d573-44ca-ab0d-9dc968d16c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:23.289727 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b91921-d573-44ca-ab0d-9dc968d16c49 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:23.290064 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b91921-d573-44ca-ab0d-9dc968d16c49 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:23.290454 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b91921-d573-44ca-ab0d-9dc968d16c49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:23.291263 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b91921-d573-44ca-ab0d-9dc968d16c49 None admin] RBAC: Adding query filter params (role.id=74de6794e3b3422b93d26f993d260c35, scope.project.id=e5026d679036436ab5fab42a948bc2a7, user.id=1b380e8f3600405aa3fdc10d224283db) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:41:23.291571 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b91921-d573-44ca-ab0d-9dc968d16c49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:23.295778 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b91921-d573-44ca-ab0d-9dc968d16c49 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:23.308638 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 115/224] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 19 14:41:23 2022] GET /identity/v3/role_assignments?user.id=1b380e8f3600405aa3fdc10d224283db&scope.project.id=e5026d679036436ab5fab42a948bc2a7&role.id=74de6794e3b3422b93d26f993d260c35 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:23.338999 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dca1668-4c34-4e1f-8460-cf4c1ea1cca4 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:23.379011 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8c9735-dfd9-49d2-ad31-03b204fd6f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:23.379664 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8c9735-dfd9-49d2-ad31-03b204fd6f4d None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:23.379946 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8c9735-dfd9-49d2-ad31-03b204fd6f4d None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:23.380222 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8c9735-dfd9-49d2-ad31-03b204fd6f4d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:23.395160 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8c9735-dfd9-49d2-ad31-03b204fd6f4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:41:23.400676 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-de8c9735-dfd9-49d2-ad31-03b204fd6f4d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:41:23.400676 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:41:23.400676 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:41:23.400676 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:41:23.400676 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:41:23.400676 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:41:23.400676 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:41:23.400676 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:41:23.400676 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:41:23.400676 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:41:23.400676 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:41:23.400676 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:41:23.400676 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:41:23.400676 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:41:23.400676 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:41:23.400676 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:41:23.401660 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:41:23.401660 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:41:23.401660 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:41:23.401660 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:41:23.401660 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:41:23.401660 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:41:23.401660 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:41:23.401660 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:41:23.401660 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:41:23.401660 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:41:23.401660 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:41:23.401660 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:41:23.401660 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:41:23.401660 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:41:23.401660 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:41:23.401660 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:41:23.402503 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:41:23.402503 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:41:23.402503 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:41:23.402503 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:41:23.402503 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:41:23.402503 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:41:23.402503 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:41:23.402503 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:41:23.402503 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:41:23.402503 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:41:23.402503 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:41:23.402503 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:41:23.402503 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 110/225] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 19 14:41:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:41:23.410654 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b91921-d573-44ca-ab0d-9dc968d16c49 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:23.425435 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8c9735-dfd9-49d2-ad31-03b204fd6f4d None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:23.541934 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:23.609738 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:23.626695 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b91921-d573-44ca-ab0d-9dc968d16c49 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:23.663723 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8c9735-dfd9-49d2-ad31-03b204fd6f4d None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:23.679412 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b57321-7b16-4b59-9572-080e29f56c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:23.680312 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b57321-7b16-4b59-9572-080e29f56c87 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:23.680729 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b57321-7b16-4b59-9572-080e29f56c87 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:23.681225 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b57321-7b16-4b59-9572-080e29f56c87 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:23.684044 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b57321-7b16-4b59-9572-080e29f56c87 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:41:23.685734 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b57321-7b16-4b59-9572-080e29f56c87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:23.688165 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b57321-7b16-4b59-9572-080e29f56c87 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:23.708851 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 116/226] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 19 14:41:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:23.718162 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b57321-7b16-4b59-9572-080e29f56c87 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:23.738566 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbafba85-b47f-4d78-a867-75f8d00d2367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:23.739487 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbafba85-b47f-4d78-a867-75f8d00d2367 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:23.739895 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbafba85-b47f-4d78-a867-75f8d00d2367 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:23.740291 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbafba85-b47f-4d78-a867-75f8d00d2367 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:23.761798 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbafba85-b47f-4d78-a867-75f8d00d2367 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:41:23.768480 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-fbafba85-b47f-4d78-a867-75f8d00d2367 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 14:41:23.768480 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:41:23.768480 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:41:23.768480 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:41:23.768480 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:41:23.768480 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:41:23.768480 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:41:23.768480 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:41:23.768480 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:41:23.768480 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:41:23.768480 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:41:23.768480 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:41:23.768480 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:41:23.768480 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:41:23.768480 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:41:23.768480 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:41:23.769545 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:41:23.769545 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:41:23.769545 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:41:23.769545 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:41:23.769545 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:41:23.769545 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:41:23.769545 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:41:23.769545 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:41:23.769545 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:41:23.769545 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:41:23.769545 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:41:23.769545 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:41:23.769545 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:41:23.769545 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:41:23.769545 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:41:23.769545 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:41:23.770448 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:41:23.770448 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:41:23.770448 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:41:23.770448 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:41:23.770448 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:41:23.770448 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:41:23.770448 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:41:23.770448 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:41:23.770448 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:41:23.770448 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:41:23.770448 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 14:41:23.770448 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:41:23.780537 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 111/227] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Sep 19 14:41:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:41:23.784548 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbafba85-b47f-4d78-a867-75f8d00d2367 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:23.939538 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b57321-7b16-4b59-9572-080e29f56c87 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:23.974093 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbafba85-b47f-4d78-a867-75f8d00d2367 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:23.989212 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:24.022112 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ba110-dff4-4c96-8dc1-f4170e5c300f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:24.022880 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ba110-dff4-4c96-8dc1-f4170e5c300f None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:24.023164 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ba110-dff4-4c96-8dc1-f4170e5c300f None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:24.023418 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ba110-dff4-4c96-8dc1-f4170e5c300f None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:24.024087 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410ba110-dff4-4c96-8dc1-f4170e5c300f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:41:24.024461 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410ba110-dff4-4c96-8dc1-f4170e5c300f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:24.026103 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410ba110-dff4-4c96-8dc1-f4170e5c300f None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:24.035162 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df24cf7-eb18-4aff-93c3-6fadb504bc75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:24.035825 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df24cf7-eb18-4aff-93c3-6fadb504bc75 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:24.036271 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df24cf7-eb18-4aff-93c3-6fadb504bc75 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:24.036386 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df24cf7-eb18-4aff-93c3-6fadb504bc75 None admin] PATH_INFO: `/v3/users/098c2d80960448799e1de59ef2c02826` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:24.036537 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 112/228] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 19 14:41:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:24.041137 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df24cf7-eb18-4aff-93c3-6fadb504bc75 None admin] RBAC: Authorizing `identity:get_user(user_id=098c2d80960448799e1de59ef2c02826)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:24.041530 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ba110-dff4-4c96-8dc1-f4170e5c300f None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:24.042619 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df24cf7-eb18-4aff-93c3-6fadb504bc75 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:24.049017 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 117/229] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 19 14:41:23 2022] GET /identity/v3/users/098c2d80960448799e1de59ef2c02826 => generated 283 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:41:24.062606 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df24cf7-eb18-4aff-93c3-6fadb504bc75 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:24.128941 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:24.161336 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ba110-dff4-4c96-8dc1-f4170e5c300f None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:24.200141 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e5c1b3-4e89-4168-a444-e9a3baa8109a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:24.201109 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e5c1b3-4e89-4168-a444-e9a3baa8109a None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:24.201582 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e5c1b3-4e89-4168-a444-e9a3baa8109a None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:24.202087 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e5c1b3-4e89-4168-a444-e9a3baa8109a None admin] PATH_INFO: `/v3/users/098c2d80960448799e1de59ef2c02826` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:24.203565 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e5c1b3-4e89-4168-a444-e9a3baa8109a None admin] RBAC: Authorizing `identity:get_user(user_id=098c2d80960448799e1de59ef2c02826)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:24.205298 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e5c1b3-4e89-4168-a444-e9a3baa8109a None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:24.207620 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 113/230] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 19 14:41:24 2022] GET /identity/v3/users/098c2d80960448799e1de59ef2c02826 => generated 283 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:24.213955 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e5c1b3-4e89-4168-a444-e9a3baa8109a None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:24.294406 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df24cf7-eb18-4aff-93c3-6fadb504bc75 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:24.300390 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:24.370655 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554656ab-6f8a-4c1c-99cc-b0b7a4147554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:24.371309 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554656ab-6f8a-4c1c-99cc-b0b7a4147554 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:24.371587 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554656ab-6f8a-4c1c-99cc-b0b7a4147554 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:24.371925 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554656ab-6f8a-4c1c-99cc-b0b7a4147554 None admin] PATH_INFO: `/v3/projects/e5026d679036436ab5fab42a948bc2a7` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:24.377821 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554656ab-6f8a-4c1c-99cc-b0b7a4147554 None admin] RBAC: Authorizing `identity:get_project(project_id=e5026d679036436ab5fab42a948bc2a7)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:24.379403 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554656ab-6f8a-4c1c-99cc-b0b7a4147554 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:24.381241 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 118/231] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 19 14:41:24 2022] GET /identity/v3/projects/e5026d679036436ab5fab42a948bc2a7 => generated 302 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:24.388000 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e5c1b3-4e89-4168-a444-e9a3baa8109a None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:24.402062 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554656ab-6f8a-4c1c-99cc-b0b7a4147554 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:24.433416 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285b412e-60e2-4b7f-b6d8-64ca1dbc273e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:24.434588 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b412e-60e2-4b7f-b6d8-64ca1dbc273e None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:24.435325 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b412e-60e2-4b7f-b6d8-64ca1dbc273e None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:24.435960 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b412e-60e2-4b7f-b6d8-64ca1dbc273e None admin] PATH_INFO: `/v3/projects/e5026d679036436ab5fab42a948bc2a7` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:24.437633 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285b412e-60e2-4b7f-b6d8-64ca1dbc273e None admin] RBAC: Authorizing `identity:get_project(project_id=e5026d679036436ab5fab42a948bc2a7)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:24.439373 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285b412e-60e2-4b7f-b6d8-64ca1dbc273e None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:24.441489 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 114/232] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 19 14:41:24 2022] GET /identity/v3/projects/e5026d679036436ab5fab42a948bc2a7 => generated 302 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:24.447525 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285b412e-60e2-4b7f-b6d8-64ca1dbc273e None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:24.572199 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285b412e-60e2-4b7f-b6d8-64ca1dbc273e None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:24.582560 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:24.589519 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:24.616095 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66ccd6e-9442-4bb8-9203-46d5eec45e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:24.617248 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ccd6e-9442-4bb8-9203-46d5eec45e2c None admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:24.617769 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ccd6e-9442-4bb8-9203-46d5eec45e2c None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:24.618232 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ccd6e-9442-4bb8-9203-46d5eec45e2c None admin] PATH_INFO: `/v3/projects/e5026d679036436ab5fab42a948bc2a7/users/098c2d80960448799e1de59ef2c02826/roles/ae7ed67e62684598a31185ab16c971ce` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:24.620727 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66ccd6e-9442-4bb8-9203-46d5eec45e2c None admin] RBAC: Authorizing `identity:create_grant(project_id=e5026d679036436ab5fab42a948bc2a7, user_id=098c2d80960448799e1de59ef2c02826, role_id=ae7ed67e62684598a31185ab16c971ce)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:24.623049 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66ccd6e-9442-4bb8-9203-46d5eec45e2c None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:24.640523 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554656ab-6f8a-4c1c-99cc-b0b7a4147554 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:24.652369 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 115/233] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Sep 19 14:41:24 2022] PUT /identity/v3/projects/e5026d679036436ab5fab42a948bc2a7/users/098c2d80960448799e1de59ef2c02826/roles/ae7ed67e62684598a31185ab16c971ce => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:41:24.697774 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b253560e-1925-4d56-9e8c-67a2ab0ac4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:24.698880 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b253560e-1925-4d56-9e8c-67a2ab0ac4a7 None admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:24.699344 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b253560e-1925-4d56-9e8c-67a2ab0ac4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:24.699810 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b253560e-1925-4d56-9e8c-67a2ab0ac4a7 None admin] PATH_INFO: `/v3/projects/e5026d679036436ab5fab42a948bc2a7/users/098c2d80960448799e1de59ef2c02826/roles/019bde1756cb40de8ce06cef6b261f79` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:24.702341 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b253560e-1925-4d56-9e8c-67a2ab0ac4a7 None admin] RBAC: Authorizing `identity:create_grant(project_id=e5026d679036436ab5fab42a948bc2a7, user_id=098c2d80960448799e1de59ef2c02826, role_id=019bde1756cb40de8ce06cef6b261f79)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:24.703994 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b253560e-1925-4d56-9e8c-67a2ab0ac4a7 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:24.726226 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 119/234] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Sep 19 14:41:24 2022] PUT /identity/v3/projects/e5026d679036436ab5fab42a948bc2a7/users/098c2d80960448799e1de59ef2c02826/roles/019bde1756cb40de8ce06cef6b261f79 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:41:25.060684 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77518b35-c081-4901-8673-592b0a981cf3 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:25.061345 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77518b35-c081-4901-8673-592b0a981cf3 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:25.061977 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77518b35-c081-4901-8673-592b0a981cf3 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:25.062871 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 116/235] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:41:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 14:41:25.068700 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8794a0-1c79-4ba0-83f1-4d8098e4ea12 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:25.069306 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8794a0-1c79-4ba0-83f1-4d8098e4ea12 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:25.069774 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8794a0-1c79-4ba0-83f1-4d8098e4ea12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:25.091115 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-ed8794a0-1c79-4ba0-83f1-4d8098e4ea12 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:41:25.093138 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ed8794a0-1c79-4ba0-83f1-4d8098e4ea12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:41:25.171912 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 120/236] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:41:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:41:25.228336 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc88861-1735-40a9-8c5b-914a442ae2b8 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:25.228683 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc88861-1735-40a9-8c5b-914a442ae2b8 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:25.228894 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc88861-1735-40a9-8c5b-914a442ae2b8 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:25.230581 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 117/237] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:41:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:41:25.236337 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb08ac-0d37-4501-9c01-b8f61953784e None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:25.236629 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb08ac-0d37-4501-9c01-b8f61953784e None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:25.236906 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb08ac-0d37-4501-9c01-b8f61953784e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:25.260474 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-2deb08ac-0d37-4501-9c01-b8f61953784e None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:41:25.261627 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2deb08ac-0d37-4501-9c01-b8f61953784e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:41:25.354840 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 121/238] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:41:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:41:25.504745 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc88861-1735-40a9-8c5b-914a442ae2b8 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:25.640409 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc88861-1735-40a9-8c5b-914a442ae2b8 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:25.687142 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbcc886-4a45-4d0f-b1e1-9af251f1bacb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:25.687833 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbcc886-4a45-4d0f-b1e1-9af251f1bacb None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:25.688119 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbcc886-4a45-4d0f-b1e1-9af251f1bacb None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:25.688394 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbcc886-4a45-4d0f-b1e1-9af251f1bacb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:25.688489 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deb08ac-0d37-4501-9c01-b8f61953784e None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:25.705393 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:25.710852 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbcc886-4a45-4d0f-b1e1-9af251f1bacb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:41:25.715823 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-ecbcc886-4a45-4d0f-b1e1-9af251f1bacb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 14:41:25.715823 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:41:25.715823 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:41:25.715823 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:41:25.715823 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:41:25.715823 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:41:25.715823 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:41:25.715823 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:41:25.715823 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:41:25.715823 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:41:25.715823 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:41:25.715823 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:41:25.715823 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:41:25.715823 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:41:25.715823 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:41:25.715823 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:41:25.716700 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:41:25.716700 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:41:25.716700 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:41:25.716700 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:41:25.716700 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:41:25.716700 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:41:25.716700 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:41:25.716700 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:41:25.716700 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:41:25.716700 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:41:25.716700 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:41:25.716700 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:41:25.716700 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:41:25.716700 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:41:25.716700 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:41:25.716700 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:41:25.717965 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:41:25.717965 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:41:25.717965 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:41:25.717965 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:41:25.717965 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:41:25.717965 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:41:25.717965 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:41:25.717965 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:41:25.717965 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:41:25.717965 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:41:25.717965 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 14:41:25.717965 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:41:25.717965 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 118/239] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 19 14:41:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:41:25.731878 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbcc886-4a45-4d0f-b1e1-9af251f1bacb None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:25.801401 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:25.818059 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deb08ac-0d37-4501-9c01-b8f61953784e None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:25.863675 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eaefc5-b98d-4896-a956-75baac84743c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:25.864689 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eaefc5-b98d-4896-a956-75baac84743c None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:25.865892 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eaefc5-b98d-4896-a956-75baac84743c None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:25.866366 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eaefc5-b98d-4896-a956-75baac84743c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:25.868582 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eaefc5-b98d-4896-a956-75baac84743c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:25.871506 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eaefc5-b98d-4896-a956-75baac84743c None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:25.874256 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 122/240] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:41:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:25.882007 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eaefc5-b98d-4896-a956-75baac84743c None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:25.943028 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbcc886-4a45-4d0f-b1e1-9af251f1bacb None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:26.019412 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c040fb30-cbc9-493d-8377-596e0e3ee527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:26.020073 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c040fb30-cbc9-493d-8377-596e0e3ee527 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:26.020354 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c040fb30-cbc9-493d-8377-596e0e3ee527 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:26.020626 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c040fb30-cbc9-493d-8377-596e0e3ee527 None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:26.021356 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c040fb30-cbc9-493d-8377-596e0e3ee527 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:41:26.021657 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c040fb30-cbc9-493d-8377-596e0e3ee527 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:26.023086 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c040fb30-cbc9-493d-8377-596e0e3ee527 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:26.038262 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:26.043017 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 119/241] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Sep 19 14:41:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:26.050522 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c040fb30-cbc9-493d-8377-596e0e3ee527 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:26.080447 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eaefc5-b98d-4896-a956-75baac84743c None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:26.124231 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f076837-83dc-4f88-919b-873dd0f2f72c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:26.124870 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f076837-83dc-4f88-919b-873dd0f2f72c None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:26.125196 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f076837-83dc-4f88-919b-873dd0f2f72c None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:26.125465 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f076837-83dc-4f88-919b-873dd0f2f72c None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:26.126119 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f076837-83dc-4f88-919b-873dd0f2f72c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:26.127929 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f076837-83dc-4f88-919b-873dd0f2f72c None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:26.152652 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 123/242] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Sep 19 14:41:25 2022] POST /identity/v3/users => generated 293 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:41:26.154259 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7719ea0a-77d5-48e5-8bf0-cb720e04a34e None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:26.154574 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7719ea0a-77d5-48e5-8bf0-cb720e04a34e None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:26.154929 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7719ea0a-77d5-48e5-8bf0-cb720e04a34e None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:26.156322 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 124/243] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:41:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:41:26.162368 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e80a3e-024e-482c-91c4-561109d581c5 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:26.162668 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e80a3e-024e-482c-91c4-561109d581c5 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:26.162914 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e80a3e-024e-482c-91c4-561109d581c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:26.184243 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-20e80a3e-024e-482c-91c4-561109d581c5 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:41:26.185628 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-20e80a3e-024e-482c-91c4-561109d581c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:41:26.196619 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:26.214597 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c040fb30-cbc9-493d-8377-596e0e3ee527 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:26.295782 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c794ea-2705-4c14-bf7b-4ef847345a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:26.297859 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 125/244] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:41:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:41:26.298369 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c794ea-2705-4c14-bf7b-4ef847345a2e None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:26.298647 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c794ea-2705-4c14-bf7b-4ef847345a2e None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:26.298918 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c794ea-2705-4c14-bf7b-4ef847345a2e None admin] PATH_INFO: `/v3/users/f2245ff2fede4c8b994b584b100d133b` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:26.315687 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c794ea-2705-4c14-bf7b-4ef847345a2e None admin] RBAC: Authorizing `identity:get_user(user_id=f2245ff2fede4c8b994b584b100d133b)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:26.317344 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c794ea-2705-4c14-bf7b-4ef847345a2e None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:26.319513 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 120/245] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 19 14:41:26 2022] GET /identity/v3/users/f2245ff2fede4c8b994b584b100d133b => generated 297 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:41:26.326839 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e80a3e-024e-482c-91c4-561109d581c5 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:26.412142 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:26.453176 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e80a3e-024e-482c-91c4-561109d581c5 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:26.493365 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813a56f2-1879-4635-af1e-fc5ab7ae4cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:26.493977 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a56f2-1879-4635-af1e-fc5ab7ae4cba None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:26.494249 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a56f2-1879-4635-af1e-fc5ab7ae4cba None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:26.494514 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a56f2-1879-4635-af1e-fc5ab7ae4cba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:26.564710 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813a56f2-1879-4635-af1e-fc5ab7ae4cba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:26.566299 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813a56f2-1879-4635-af1e-fc5ab7ae4cba None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:26.617794 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c794ea-2705-4c14-bf7b-4ef847345a2e None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:26.643667 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:26.692197 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 126/246] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 19 14:41:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:26.698083 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813a56f2-1879-4635-af1e-fc5ab7ae4cba None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:26.728911 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c794ea-2705-4c14-bf7b-4ef847345a2e None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:26.773694 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ea3acf-b4dd-45bd-95c5-a7af2d4d332d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:26.774933 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ea3acf-b4dd-45bd-95c5-a7af2d4d332d None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:26.775713 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ea3acf-b4dd-45bd-95c5-a7af2d4d332d None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:26.776473 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ea3acf-b4dd-45bd-95c5-a7af2d4d332d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:26.801973 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ea3acf-b4dd-45bd-95c5-a7af2d4d332d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:41:26.807057 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-d3ea3acf-b4dd-45bd-95c5-a7af2d4d332d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:41:26.807057 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:41:26.807057 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:41:26.807057 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:41:26.807057 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:41:26.807057 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:41:26.807057 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:41:26.807057 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:41:26.807057 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:41:26.807057 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:41:26.807057 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:41:26.807057 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:41:26.807057 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:41:26.807057 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:41:26.807057 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:41:26.807057 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:41:26.807918 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:41:26.807918 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:41:26.807918 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:41:26.807918 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:41:26.807918 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:41:26.807918 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:41:26.807918 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:41:26.807918 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:41:26.807918 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:41:26.807918 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:41:26.807918 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:41:26.807918 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:41:26.807918 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:41:26.807918 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:41:26.807918 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:41:26.807918 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:41:26.808685 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:41:26.808685 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:41:26.808685 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:41:26.808685 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:41:26.808685 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:41:26.808685 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:41:26.808685 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:41:26.808685 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:41:26.808685 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:41:26.808685 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:41:26.808685 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:41:26.808685 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:41:26.808685 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 121/247] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 19 14:41:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:41:26.812442 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813a56f2-1879-4635-af1e-fc5ab7ae4cba None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:26.816131 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ea3acf-b4dd-45bd-95c5-a7af2d4d332d None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:26.830961 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:26.853678 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45bdc82-10de-44e7-9c02-f199b37db157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:26.854316 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45bdc82-10de-44e7-9c02-f199b37db157 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:26.854609 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45bdc82-10de-44e7-9c02-f199b37db157 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:26.854893 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45bdc82-10de-44e7-9c02-f199b37db157 None admin] PATH_INFO: `/v3/projects/e5026d679036436ab5fab42a948bc2a7` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:26.856128 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45bdc82-10de-44e7-9c02-f199b37db157 None admin] RBAC: Authorizing `identity:get_project(project_id=e5026d679036436ab5fab42a948bc2a7)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:26.857863 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45bdc82-10de-44e7-9c02-f199b37db157 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:26.859912 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 127/248] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 19 14:41:26 2022] GET /identity/v3/projects/e5026d679036436ab5fab42a948bc2a7 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:41:26.866328 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45bdc82-10de-44e7-9c02-f199b37db157 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:26.900295 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:26.951952 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ea3acf-b4dd-45bd-95c5-a7af2d4d332d None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:26.999444 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45bdc82-10de-44e7-9c02-f199b37db157 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:27.006662 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf6d1c8-900a-4dfe-8893-68a8c2326a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:27.007506 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf6d1c8-900a-4dfe-8893-68a8c2326a98 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:27.007930 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf6d1c8-900a-4dfe-8893-68a8c2326a98 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:27.008367 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf6d1c8-900a-4dfe-8893-68a8c2326a98 None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:27.009226 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf6d1c8-900a-4dfe-8893-68a8c2326a98 None admin] RBAC: Adding query filter params (name=member) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:41:27.009685 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf6d1c8-900a-4dfe-8893-68a8c2326a98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:27.011227 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf6d1c8-900a-4dfe-8893-68a8c2326a98 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:27.024249 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 122/249] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Sep 19 14:41:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:41:27.030248 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf6d1c8-900a-4dfe-8893-68a8c2326a98 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:27.052911 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ef96ac-eb28-48aa-a571-9cf71a047d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:27.053606 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef96ac-eb28-48aa-a571-9cf71a047d37 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:27.053883 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef96ac-eb28-48aa-a571-9cf71a047d37 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:27.054151 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef96ac-eb28-48aa-a571-9cf71a047d37 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:27.054888 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ef96ac-eb28-48aa-a571-9cf71a047d37 None admin] RBAC: Adding query filter params (role.id=f23b6d2ba5de4bf68b75b7fa1a4f1b84, scope.project.id=e5026d679036436ab5fab42a948bc2a7, user.id=f2245ff2fede4c8b994b584b100d133b) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:41:27.055193 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ef96ac-eb28-48aa-a571-9cf71a047d37 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:27.056729 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ef96ac-eb28-48aa-a571-9cf71a047d37 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:27.064100 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 128/250] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 19 14:41:26 2022] GET /identity/v3/role_assignments?user.id=f2245ff2fede4c8b994b584b100d133b&scope.project.id=e5026d679036436ab5fab42a948bc2a7&role.id=f23b6d2ba5de4bf68b75b7fa1a4f1b84 => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:41:27.134701 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:27.168489 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf6d1c8-900a-4dfe-8893-68a8c2326a98 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:27.216630 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38a453c-4571-453c-bb2b-87873e338cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:27.217387 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a453c-4571-453c-bb2b-87873e338cc3 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:27.217668 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a453c-4571-453c-bb2b-87873e338cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:27.217958 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a453c-4571-453c-bb2b-87873e338cc3 None admin] PATH_INFO: `/v3/users/1b380e8f3600405aa3fdc10d224283db` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:27.219498 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38a453c-4571-453c-bb2b-87873e338cc3 None admin] RBAC: Authorizing `identity:get_user(user_id=1b380e8f3600405aa3fdc10d224283db)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:27.221011 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38a453c-4571-453c-bb2b-87873e338cc3 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:27.222705 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 123/251] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 19 14:41:27 2022] GET /identity/v3/users/1b380e8f3600405aa3fdc10d224283db => generated 297 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:27.228907 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ef96ac-eb28-48aa-a571-9cf71a047d37 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:27.360177 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:27.367065 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ef96ac-eb28-48aa-a571-9cf71a047d37 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:27.416826 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba892dd2-a316-4a0f-ab62-bc845cca456b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:27.417995 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba892dd2-a316-4a0f-ab62-bc845cca456b None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:27.418487 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba892dd2-a316-4a0f-ab62-bc845cca456b None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:27.418963 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba892dd2-a316-4a0f-ab62-bc845cca456b None admin] PATH_INFO: `/v3/projects/e5026d679036436ab5fab42a948bc2a7` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:27.420953 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba892dd2-a316-4a0f-ab62-bc845cca456b None admin] RBAC: Authorizing `identity:get_project(project_id=e5026d679036436ab5fab42a948bc2a7)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:27.423727 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba892dd2-a316-4a0f-ab62-bc845cca456b None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:27.433651 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 129/252] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 19 14:41:27 2022] GET /identity/v3/projects/e5026d679036436ab5fab42a948bc2a7 => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:27.436474 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38a453c-4571-453c-bb2b-87873e338cc3 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:27.589534 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38a453c-4571-453c-bb2b-87873e338cc3 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:27.638818 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5440d022-1dc3-4d84-8a26-4cef8eecf035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:27.639914 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5440d022-1dc3-4d84-8a26-4cef8eecf035 None admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:27.640383 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5440d022-1dc3-4d84-8a26-4cef8eecf035 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:27.640841 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5440d022-1dc3-4d84-8a26-4cef8eecf035 None admin] PATH_INFO: `/v3/projects/e5026d679036436ab5fab42a948bc2a7/users/1b380e8f3600405aa3fdc10d224283db/roles/74de6794e3b3422b93d26f993d260c35` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:27.646596 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5440d022-1dc3-4d84-8a26-4cef8eecf035 None admin] RBAC: Authorizing `identity:create_grant(project_id=e5026d679036436ab5fab42a948bc2a7, user_id=1b380e8f3600405aa3fdc10d224283db, role_id=74de6794e3b3422b93d26f993d260c35)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:27.648450 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5440d022-1dc3-4d84-8a26-4cef8eecf035 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:27.667816 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:27.675577 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 124/253] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Sep 19 14:41:27 2022] PUT /identity/v3/projects/e5026d679036436ab5fab42a948bc2a7/users/1b380e8f3600405aa3fdc10d224283db/roles/74de6794e3b3422b93d26f993d260c35 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:41:27.839091 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611acd8d-d2f5-44ac-b11d-5821c892bd82 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:27.839606 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611acd8d-d2f5-44ac-b11d-5821c892bd82 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:27.839713 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611acd8d-d2f5-44ac-b11d-5821c892bd82 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:27.841311 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 130/254] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:41:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:41:27.847354 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2914696f-b2b8-435a-ad6c-ff270d3b027a None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:27.848267 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2914696f-b2b8-435a-ad6c-ff270d3b027a None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:27.848746 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2914696f-b2b8-435a-ad6c-ff270d3b027a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:27.858089 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67db1a4-acd8-4489-96e0-7942f0fff2dd None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:27.858501 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67db1a4-acd8-4489-96e0-7942f0fff2dd None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:27.858722 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67db1a4-acd8-4489-96e0-7942f0fff2dd None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:27.860214 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 131/255] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:41:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:41:27.866890 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b357470-a80c-4689-bb93-9b31c15d4410 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:27.867491 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b357470-a80c-4689-bb93-9b31c15d4410 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:27.867981 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b357470-a80c-4689-bb93-9b31c15d4410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:27.876686 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-2914696f-b2b8-435a-ad6c-ff270d3b027a None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:41:27.878249 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-2914696f-b2b8-435a-ad6c-ff270d3b027a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:41:27.892025 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-1b357470-a80c-4689-bb93-9b31c15d4410 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:41:27.893690 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-1b357470-a80c-4689-bb93-9b31c15d4410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:41:28.010010 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 125/256] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:41:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:41:28.024853 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 132/257] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:41:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 14:41:28.322661 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2914696f-b2b8-435a-ad6c-ff270d3b027a None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:28.465020 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2914696f-b2b8-435a-ad6c-ff270d3b027a None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:28.511847 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:28.521484 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54686688-b838-4f9f-9794-0447a5427c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:28.522125 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54686688-b838-4f9f-9794-0447a5427c5c None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:28.522404 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54686688-b838-4f9f-9794-0447a5427c5c None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:28.522667 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54686688-b838-4f9f-9794-0447a5427c5c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:28.541890 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54686688-b838-4f9f-9794-0447a5427c5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:41:28.546886 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-54686688-b838-4f9f-9794-0447a5427c5c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 14:41:28.546886 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:41:28.546886 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:41:28.546886 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:41:28.546886 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:41:28.546886 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:41:28.546886 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:41:28.546886 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:41:28.546886 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:41:28.546886 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:41:28.546886 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:41:28.546886 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:41:28.546886 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:41:28.546886 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:41:28.546886 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:41:28.546886 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:41:28.547763 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:41:28.547763 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:41:28.547763 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:41:28.547763 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:41:28.547763 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:41:28.547763 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:41:28.547763 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:41:28.547763 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:41:28.547763 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:41:28.547763 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:41:28.547763 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:41:28.547763 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:41:28.547763 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:41:28.547763 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:41:28.547763 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:41:28.547763 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:41:28.548537 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:41:28.548537 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:41:28.548537 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:41:28.548537 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:41:28.548537 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:41:28.548537 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:41:28.548537 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:41:28.548537 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:41:28.548537 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:41:28.548537 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:41:28.548537 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 14:41:28.548537 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:41:28.548537 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 126/258] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Sep 19 14:41:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:41:28.554294 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b357470-a80c-4689-bb93-9b31c15d4410 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:28.566272 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54686688-b838-4f9f-9794-0447a5427c5c None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:28.709210 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54686688-b838-4f9f-9794-0447a5427c5c None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:28.714900 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:28.730411 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b357470-a80c-4689-bb93-9b31c15d4410 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:28.757701 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0721560-13b8-4ceb-983e-64581965d6d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:28.758368 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0721560-13b8-4ceb-983e-64581965d6d0 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:28.758619 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0721560-13b8-4ceb-983e-64581965d6d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:28.758884 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0721560-13b8-4ceb-983e-64581965d6d0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:28.774216 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0721560-13b8-4ceb-983e-64581965d6d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:41:28.779002 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-e0721560-13b8-4ceb-983e-64581965d6d0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:41:28.779002 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:41:28.779002 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:41:28.779002 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:41:28.779002 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:41:28.779002 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:41:28.779002 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:41:28.779002 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:41:28.779002 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:41:28.779002 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:41:28.779002 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:41:28.779002 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:41:28.779002 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:41:28.779002 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:41:28.779002 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:41:28.779002 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:41:28.780641 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:41:28.780641 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:41:28.780641 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:41:28.780641 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:41:28.780641 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:41:28.780641 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:41:28.780641 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:41:28.780641 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:41:28.780641 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:41:28.780641 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:41:28.780641 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:41:28.780641 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:41:28.780641 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:41:28.780641 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:41:28.780641 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:41:28.780641 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:41:28.781442 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:41:28.781442 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:41:28.781442 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:41:28.781442 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:41:28.781442 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:41:28.781442 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:41:28.781442 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:41:28.781442 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:41:28.781442 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:41:28.781442 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:41:28.781442 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:41:28.781442 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:41:28.781442 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 127/259] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 19 14:41:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:41:28.790019 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0721560-13b8-4ceb-983e-64581965d6d0 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:28.809736 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421a4c19-bc68-43c0-8bbc-c27153eae4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:28.810369 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a4c19-bc68-43c0-8bbc-c27153eae4a2 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:28.810706 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a4c19-bc68-43c0-8bbc-c27153eae4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:28.811609 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a4c19-bc68-43c0-8bbc-c27153eae4a2 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:28.811719 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421a4c19-bc68-43c0-8bbc-c27153eae4a2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:41:28.812001 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421a4c19-bc68-43c0-8bbc-c27153eae4a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:28.813449 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421a4c19-bc68-43c0-8bbc-c27153eae4a2 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:28.828391 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 133/260] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 19 14:41:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:28.833940 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421a4c19-bc68-43c0-8bbc-c27153eae4a2 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:28.849086 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:28.954944 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0721560-13b8-4ceb-983e-64581965d6d0 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:29.012016 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f888a1-7c33-4809-a4f5-e41d6cb7671a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:29.012679 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f888a1-7c33-4809-a4f5-e41d6cb7671a None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:29.012955 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f888a1-7c33-4809-a4f5-e41d6cb7671a None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:29.013247 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f888a1-7c33-4809-a4f5-e41d6cb7671a None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:29.014284 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f888a1-7c33-4809-a4f5-e41d6cb7671a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:41:29.014621 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f888a1-7c33-4809-a4f5-e41d6cb7671a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:29.016142 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f888a1-7c33-4809-a4f5-e41d6cb7671a None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:29.031817 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 128/261] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 19 14:41:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:29.037604 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f888a1-7c33-4809-a4f5-e41d6cb7671a None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:29.100856 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421a4c19-bc68-43c0-8bbc-c27153eae4a2 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:29.174347 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c99df09-e0da-41c3-a1a5-cf77e026d1cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:29.174991 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c99df09-e0da-41c3-a1a5-cf77e026d1cd None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:29.175266 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c99df09-e0da-41c3-a1a5-cf77e026d1cd None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:29.175523 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c99df09-e0da-41c3-a1a5-cf77e026d1cd None admin] PATH_INFO: `/v3/users/098c2d80960448799e1de59ef2c02826` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:29.176666 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c99df09-e0da-41c3-a1a5-cf77e026d1cd None admin] RBAC: Authorizing `identity:get_user(user_id=098c2d80960448799e1de59ef2c02826)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:29.178168 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c99df09-e0da-41c3-a1a5-cf77e026d1cd None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:29.179756 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 134/262] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 19 14:41:28 2022] GET /identity/v3/users/098c2d80960448799e1de59ef2c02826 => generated 283 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:41:29.185274 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c99df09-e0da-41c3-a1a5-cf77e026d1cd None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:29.203536 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f888a1-7c33-4809-a4f5-e41d6cb7671a None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:29.222025 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:29.233700 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:29.264243 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b97ab36-e6c5-44d9-8ad8-f51bd6706b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:29.265288 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97ab36-e6c5-44d9-8ad8-f51bd6706b25 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:29.265717 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97ab36-e6c5-44d9-8ad8-f51bd6706b25 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:29.266110 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97ab36-e6c5-44d9-8ad8-f51bd6706b25 None admin] PATH_INFO: `/v3/users/098c2d80960448799e1de59ef2c02826` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:29.267623 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b97ab36-e6c5-44d9-8ad8-f51bd6706b25 None admin] RBAC: Authorizing `identity:get_user(user_id=098c2d80960448799e1de59ef2c02826)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:29.269380 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b97ab36-e6c5-44d9-8ad8-f51bd6706b25 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:29.271293 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 129/263] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 19 14:41:29 2022] GET /identity/v3/users/098c2d80960448799e1de59ef2c02826 => generated 283 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:41:29.276863 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b97ab36-e6c5-44d9-8ad8-f51bd6706b25 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:29.374102 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c99df09-e0da-41c3-a1a5-cf77e026d1cd None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:29.423447 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5000f418-4328-4cdb-ba2d-98224574ce62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:29.424071 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5000f418-4328-4cdb-ba2d-98224574ce62 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:29.424355 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5000f418-4328-4cdb-ba2d-98224574ce62 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:29.424624 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5000f418-4328-4cdb-ba2d-98224574ce62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:29.495076 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b97ab36-e6c5-44d9-8ad8-f51bd6706b25 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:29.565959 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5000f418-4328-4cdb-ba2d-98224574ce62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:29.567386 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5000f418-4328-4cdb-ba2d-98224574ce62 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:29.570548 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bad7610-6f89-4b54-a8d2-fbe763d59f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:29.571175 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad7610-6f89-4b54-a8d2-fbe763d59f85 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:29.571452 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad7610-6f89-4b54-a8d2-fbe763d59f85 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:29.571723 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad7610-6f89-4b54-a8d2-fbe763d59f85 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:29.617207 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:29.669413 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:29.715309 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bad7610-6f89-4b54-a8d2-fbe763d59f85 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:29.717439 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bad7610-6f89-4b54-a8d2-fbe763d59f85 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:29.769112 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 135/264] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 19 14:41:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 584 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 19 14:41:29.774788 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5000f418-4328-4cdb-ba2d-98224574ce62 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:29.834202 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 130/265] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 19 14:41:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 19 14:41:29.840556 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bad7610-6f89-4b54-a8d2-fbe763d59f85 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:29.938516 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:29.965952 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bad7610-6f89-4b54-a8d2-fbe763d59f85 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:30.026945 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5000f418-4328-4cdb-ba2d-98224574ce62 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:30.050490 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2490fe2-74e0-4457-be34-65c986bac4e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:30.051531 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2490fe2-74e0-4457-be34-65c986bac4e8 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:30.051953 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2490fe2-74e0-4457-be34-65c986bac4e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:30.052229 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2490fe2-74e0-4457-be34-65c986bac4e8 None admin] PATH_INFO: `/v3/projects/e5026d679036436ab5fab42a948bc2a7` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:30.053404 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2490fe2-74e0-4457-be34-65c986bac4e8 None admin] RBAC: Authorizing `identity:get_project(project_id=e5026d679036436ab5fab42a948bc2a7)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:30.054865 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2490fe2-74e0-4457-be34-65c986bac4e8 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:30.056521 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 131/266] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 19 14:41:29 2022] GET /identity/v3/projects/e5026d679036436ab5fab42a948bc2a7 => generated 302 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:41:30.060468 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb357f-ef1e-4768-947b-998eee2d9b4d None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:30.060759 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb357f-ef1e-4768-947b-998eee2d9b4d None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:30.061054 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb357f-ef1e-4768-947b-998eee2d9b4d None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:30.062348 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 132/267] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:41:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:41:30.065873 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fb357f-ef1e-4768-947b-998eee2d9b4d None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:30.073390 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:30.095217 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6a76ba-102d-47e8-b669-2a595a5fa4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:30.095781 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6a76ba-102d-47e8-b669-2a595a5fa4ad None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:30.096055 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6a76ba-102d-47e8-b669-2a595a5fa4ad None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:30.096319 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6a76ba-102d-47e8-b669-2a595a5fa4ad None admin] PATH_INFO: `/v3/projects/e5026d679036436ab5fab42a948bc2a7` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:30.097640 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6a76ba-102d-47e8-b669-2a595a5fa4ad None admin] RBAC: Authorizing `identity:get_project(project_id=e5026d679036436ab5fab42a948bc2a7)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:30.099334 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6a76ba-102d-47e8-b669-2a595a5fa4ad None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:30.101313 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 136/268] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 19 14:41:29 2022] GET /identity/v3/projects/e5026d679036436ab5fab42a948bc2a7 => generated 302 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:41:30.108519 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e0fbf-192a-4fce-893a-695d699fa107 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:30.108973 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e0fbf-192a-4fce-893a-695d699fa107 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:30.109430 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e0fbf-192a-4fce-893a-695d699fa107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:30.150180 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-fe4e0fbf-192a-4fce-893a-695d699fa107 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:41:30.151625 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-fe4e0fbf-192a-4fce-893a-695d699fa107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:41:30.198593 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fb357f-ef1e-4768-947b-998eee2d9b4d None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:30.280210 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 137/269] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:41:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:41:30.281583 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4e0fbf-192a-4fce-893a-695d699fa107 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:30.310396 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1551ba9e-e8c8-4528-8508-43479e7e8815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:30.311268 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1551ba9e-e8c8-4528-8508-43479e7e8815 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:30.311554 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1551ba9e-e8c8-4528-8508-43479e7e8815 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:30.311833 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1551ba9e-e8c8-4528-8508-43479e7e8815 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:30.312584 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1551ba9e-e8c8-4528-8508-43479e7e8815 None admin] RBAC: Adding query filter params (role.id=019bde1756cb40de8ce06cef6b261f79, scope.project.id=e5026d679036436ab5fab42a948bc2a7, user.id=098c2d80960448799e1de59ef2c02826) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:41:30.312898 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1551ba9e-e8c8-4528-8508-43479e7e8815 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:30.314408 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1551ba9e-e8c8-4528-8508-43479e7e8815 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:30.326526 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 133/270] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 19 14:41:30 2022] GET /identity/v3/role_assignments?user.id=098c2d80960448799e1de59ef2c02826&scope.project.id=e5026d679036436ab5fab42a948bc2a7&role.id=019bde1756cb40de8ce06cef6b261f79 => generated 608 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:41:30.333024 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9487d47-50a6-480a-b0db-0878cd584de7 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:30.333024 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9487d47-50a6-480a-b0db-0878cd584de7 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:30.333024 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9487d47-50a6-480a-b0db-0878cd584de7 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:30.334395 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 134/271] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:41:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:41:30.335976 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a4c09e-44f3-466a-973f-a00480f52b5c None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:30.336347 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a4c09e-44f3-466a-973f-a00480f52b5c None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:30.336756 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a4c09e-44f3-466a-973f-a00480f52b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:30.367442 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-c3a4c09e-44f3-466a-973f-a00480f52b5c None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:41:30.374374 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-c3a4c09e-44f3-466a-973f-a00480f52b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:41:30.385780 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:30.505425 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4e0fbf-192a-4fce-893a-695d699fa107 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:30.547270 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:30.564352 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b29e66b-6b58-4d31-be76-6568431d8abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:30.564964 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b29e66b-6b58-4d31-be76-6568431d8abd None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:30.565264 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b29e66b-6b58-4d31-be76-6568431d8abd None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:30.565525 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b29e66b-6b58-4d31-be76-6568431d8abd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:30.566246 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b29e66b-6b58-4d31-be76-6568431d8abd None admin] RBAC: Adding query filter params (role.id=ae7ed67e62684598a31185ab16c971ce, scope.project.id=e5026d679036436ab5fab42a948bc2a7, user.id=098c2d80960448799e1de59ef2c02826) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:41:30.566548 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b29e66b-6b58-4d31-be76-6568431d8abd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:30.567342 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 135/272] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:41:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 14:41:30.569488 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefc9818-8c57-476c-b8c0-77792234fd39 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:30.569984 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefc9818-8c57-476c-b8c0-77792234fd39 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:30.570440 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefc9818-8c57-476c-b8c0-77792234fd39 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:30.572845 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 136/273] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:41:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:41:30.574185 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b29e66b-6b58-4d31-be76-6568431d8abd None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:30.589374 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590640c9-8a12-4319-a77a-0f19bb3fd2e8 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:30.589872 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590640c9-8a12-4319-a77a-0f19bb3fd2e8 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:30.590352 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590640c9-8a12-4319-a77a-0f19bb3fd2e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:30.594687 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 138/274] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 19 14:41:30 2022] GET /identity/v3/role_assignments?user.id=098c2d80960448799e1de59ef2c02826&scope.project.id=e5026d679036436ab5fab42a948bc2a7&role.id=ae7ed67e62684598a31185ab16c971ce => generated 608 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:30.643219 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-590640c9-8a12-4319-a77a-0f19bb3fd2e8 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:41:30.645244 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-590640c9-8a12-4319-a77a-0f19bb3fd2e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:41:30.745450 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 137/275] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:41:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 19 14:41:30.797966 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b29e66b-6b58-4d31-be76-6568431d8abd None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:30.906948 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b29e66b-6b58-4d31-be76-6568431d8abd None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:30.945484 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069fa648-4524-4120-91b4-5a4321a94bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:30.946486 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069fa648-4524-4120-91b4-5a4321a94bcb None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:30.946970 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069fa648-4524-4120-91b4-5a4321a94bcb None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:30.947469 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069fa648-4524-4120-91b4-5a4321a94bcb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:30.948801 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069fa648-4524-4120-91b4-5a4321a94bcb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:30.950545 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069fa648-4524-4120-91b4-5a4321a94bcb None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:30.952611 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 139/276] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:41:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:41:30.959951 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590640c9-8a12-4319-a77a-0f19bb3fd2e8 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:31.019573 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069fa648-4524-4120-91b4-5a4321a94bcb None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:31.049640 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:31.085825 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590640c9-8a12-4319-a77a-0f19bb3fd2e8 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:31.094317 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:31.131796 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191cfe51-1de9-4034-83ea-85d1cda05859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:31.132816 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191cfe51-1de9-4034-83ea-85d1cda05859 None admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:31.133317 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191cfe51-1de9-4034-83ea-85d1cda05859 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:31.133835 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191cfe51-1de9-4034-83ea-85d1cda05859 None admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:31.134682 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191cfe51-1de9-4034-83ea-85d1cda05859 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:31.136504 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191cfe51-1de9-4034-83ea-85d1cda05859 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:31.155813 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069fa648-4524-4120-91b4-5a4321a94bcb None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:31.164270 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 138/277] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Sep 19 14:41:30 2022] POST /identity/v3/users => generated 293 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:41:31.165867 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191cfe51-1de9-4034-83ea-85d1cda05859 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:31.195710 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df0e9d8-55e9-4caf-b749-1ded42ddae11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:31.196362 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df0e9d8-55e9-4caf-b749-1ded42ddae11 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:31.196647 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df0e9d8-55e9-4caf-b749-1ded42ddae11 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:31.196903 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df0e9d8-55e9-4caf-b749-1ded42ddae11 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:31.210141 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df0e9d8-55e9-4caf-b749-1ded42ddae11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:41:31.216258 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-0df0e9d8-55e9-4caf-b749-1ded42ddae11 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 14:41:31.216258 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:41:31.216258 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:41:31.216258 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:41:31.216258 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:41:31.216258 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:41:31.216258 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:41:31.216258 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:41:31.216258 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:41:31.216258 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:41:31.216258 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:41:31.216258 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:41:31.216258 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:41:31.216258 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:41:31.216258 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:41:31.216258 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:41:31.217417 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:41:31.217417 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:41:31.217417 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:41:31.217417 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:41:31.217417 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:41:31.217417 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:41:31.217417 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:41:31.217417 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:41:31.217417 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:41:31.217417 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:41:31.217417 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:41:31.217417 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:41:31.217417 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:41:31.217417 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:41:31.217417 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:41:31.217417 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:41:31.218167 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:41:31.218167 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:41:31.218167 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:41:31.218167 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:41:31.218167 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:41:31.218167 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:41:31.218167 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:41:31.218167 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:41:31.218167 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:41:31.218167 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:41:31.218167 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 14:41:31.218167 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:41:31.218167 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 140/278] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 19 14:41:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:41:31.225364 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df0e9d8-55e9-4caf-b749-1ded42ddae11 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:31.323514 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191cfe51-1de9-4034-83ea-85d1cda05859 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:31.356070 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:31.366451 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df0e9d8-55e9-4caf-b749-1ded42ddae11 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:31.369408 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ab1aa0-0cd7-4a03-8918-18ba240a1ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:31.370031 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab1aa0-0cd7-4a03-8918-18ba240a1ee0 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:31.370312 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab1aa0-0cd7-4a03-8918-18ba240a1ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:31.370581 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab1aa0-0cd7-4a03-8918-18ba240a1ee0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:31.381956 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:31.384723 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ab1aa0-0cd7-4a03-8918-18ba240a1ee0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:41:31.390815 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-73ab1aa0-0cd7-4a03-8918-18ba240a1ee0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:41:31.390815 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:41:31.390815 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:41:31.390815 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:41:31.390815 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:41:31.390815 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:41:31.390815 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:41:31.390815 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:41:31.390815 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:41:31.390815 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:41:31.390815 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:41:31.390815 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:41:31.390815 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:41:31.390815 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:41:31.390815 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:41:31.390815 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:41:31.391708 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:41:31.391708 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:41:31.391708 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:41:31.391708 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:41:31.391708 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:41:31.391708 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:41:31.391708 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:41:31.391708 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:41:31.391708 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:41:31.391708 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:41:31.391708 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:41:31.391708 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:41:31.391708 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:41:31.391708 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:41:31.391708 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:41:31.391708 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:41:31.392519 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:41:31.392519 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:41:31.392519 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:41:31.392519 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:41:31.392519 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:41:31.392519 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:41:31.392519 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:41:31.392519 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:41:31.392519 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:41:31.392519 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:41:31.392519 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:41:31.392519 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:41:31.392519 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 139/279] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 19 14:41:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:41:31.393321 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55ed3ff-bb8a-4ccb-88e9-23ba3e8ade8c None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:31.393534 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55ed3ff-bb8a-4ccb-88e9-23ba3e8ade8c None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:31.393806 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55ed3ff-bb8a-4ccb-88e9-23ba3e8ade8c None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:31.395212 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 140/280] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:41:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:41:31.399974 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55ed3ff-bb8a-4ccb-88e9-23ba3e8ade8c None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:31.412494 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5841938f-d98b-4485-b9f2-f7f2f899219b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:31.413188 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5841938f-d98b-4485-b9f2-f7f2f899219b None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:31.413465 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5841938f-d98b-4485-b9f2-f7f2f899219b None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:31.413735 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5841938f-d98b-4485-b9f2-f7f2f899219b None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:31.414463 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5841938f-d98b-4485-b9f2-f7f2f899219b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:41:31.414747 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5841938f-d98b-4485-b9f2-f7f2f899219b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:31.416110 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5841938f-d98b-4485-b9f2-f7f2f899219b None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:31.426850 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 141/281] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Sep 19 14:41:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:31.428092 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df2190-0fea-4e70-8121-c1722646d726 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:31.428380 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df2190-0fea-4e70-8121-c1722646d726 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:31.428651 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df2190-0fea-4e70-8121-c1722646d726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:31.447545 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-e8df2190-0fea-4e70-8121-c1722646d726 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:41:31.448764 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e8df2190-0fea-4e70-8121-c1722646d726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:41:31.537663 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 142/282] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:41:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:41:31.537931 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55ed3ff-bb8a-4ccb-88e9-23ba3e8ade8c None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:31.538960 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8df2190-0fea-4e70-8121-c1722646d726 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:31.592061 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a79d26-2caf-4f60-b273-6d048a8c7cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:31.592734 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a79d26-2caf-4f60-b273-6d048a8c7cb4 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:31.593346 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a79d26-2caf-4f60-b273-6d048a8c7cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:31.593618 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a79d26-2caf-4f60-b273-6d048a8c7cb4 None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:31.594616 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a79d26-2caf-4f60-b273-6d048a8c7cb4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:41:31.595456 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a79d26-2caf-4f60-b273-6d048a8c7cb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:31.597132 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a79d26-2caf-4f60-b273-6d048a8c7cb4 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:31.608174 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 141/283] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Sep 19 14:41:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:31.613973 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a79d26-2caf-4f60-b273-6d048a8c7cb4 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:31.669988 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:31.673420 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8df2190-0fea-4e70-8121-c1722646d726 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:31.677899 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:31.721787 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fac150-d01f-45d6-8c65-21d7b732b323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:31.722815 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fac150-d01f-45d6-8c65-21d7b732b323 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:31.723268 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fac150-d01f-45d6-8c65-21d7b732b323 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:31.723712 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fac150-d01f-45d6-8c65-21d7b732b323 None admin] PATH_INFO: `/v3/users/f2245ff2fede4c8b994b584b100d133b` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:31.725262 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fac150-d01f-45d6-8c65-21d7b732b323 None admin] RBAC: Authorizing `identity:get_user(user_id=f2245ff2fede4c8b994b584b100d133b)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:31.726942 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fac150-d01f-45d6-8c65-21d7b732b323 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:31.729018 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 143/284] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 19 14:41:31 2022] GET /identity/v3/users/f2245ff2fede4c8b994b584b100d133b => generated 297 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:31.733922 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a79d26-2caf-4f60-b273-6d048a8c7cb4 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:31.734903 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fac150-d01f-45d6-8c65-21d7b732b323 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:31.774059 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a143b1-1faa-4a6c-ab68-3c67ba9ae9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:31.774705 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a143b1-1faa-4a6c-ab68-3c67ba9ae9c5 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:31.774984 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a143b1-1faa-4a6c-ab68-3c67ba9ae9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:31.775314 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a143b1-1faa-4a6c-ab68-3c67ba9ae9c5 None admin] PATH_INFO: `/v3/users/be8f16cf6e1545ad92005a77a4485258` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:31.790659 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a143b1-1faa-4a6c-ab68-3c67ba9ae9c5 None admin] RBAC: Authorizing `identity:get_user(user_id=be8f16cf6e1545ad92005a77a4485258)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:31.792325 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a143b1-1faa-4a6c-ab68-3c67ba9ae9c5 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:31.794267 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 142/285] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 19 14:41:31 2022] GET /identity/v3/users/be8f16cf6e1545ad92005a77a4485258 => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:41:31.804363 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a143b1-1faa-4a6c-ab68-3c67ba9ae9c5 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:31.887749 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fac150-d01f-45d6-8c65-21d7b732b323 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:31.926495 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c55e761-19d4-4f56-8616-fe6c79f30202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:31.927201 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c55e761-19d4-4f56-8616-fe6c79f30202 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:31.927581 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c55e761-19d4-4f56-8616-fe6c79f30202 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:31.927952 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c55e761-19d4-4f56-8616-fe6c79f30202 None admin] PATH_INFO: `/v3/projects/e5026d679036436ab5fab42a948bc2a7` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:31.929232 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c55e761-19d4-4f56-8616-fe6c79f30202 None admin] RBAC: Authorizing `identity:get_project(project_id=e5026d679036436ab5fab42a948bc2a7)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:31.930925 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c55e761-19d4-4f56-8616-fe6c79f30202 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:31.932676 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 144/286] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 19 14:41:31 2022] GET /identity/v3/projects/e5026d679036436ab5fab42a948bc2a7 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:41:31.933579 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c55e761-19d4-4f56-8616-fe6c79f30202 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:31.960422 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a143b1-1faa-4a6c-ab68-3c67ba9ae9c5 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:31.971721 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:31.979988 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:32.009680 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fbec7a-c2c6-48cd-b934-1f4a81aac666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:32.010284 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fbec7a-c2c6-48cd-b934-1f4a81aac666 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:32.010583 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fbec7a-c2c6-48cd-b934-1f4a81aac666 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:32.011128 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fbec7a-c2c6-48cd-b934-1f4a81aac666 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:32.011858 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fbec7a-c2c6-48cd-b934-1f4a81aac666 None admin] RBAC: Adding query filter params (role.id=74de6794e3b3422b93d26f993d260c35, user.id=be8f16cf6e1545ad92005a77a4485258, scope.system=all) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:41:32.012763 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fbec7a-c2c6-48cd-b934-1f4a81aac666 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:32.014529 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fbec7a-c2c6-48cd-b934-1f4a81aac666 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:32.025092 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 143/287] 10.222.0.26 () {56 vars in 1308 bytes} [Mon Sep 19 14:41:31 2022] GET /identity/v3/role_assignments?user.id=be8f16cf6e1545ad92005a77a4485258&scope.system=all&role.id=74de6794e3b3422b93d26f993d260c35 => generated 226 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:32.026392 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fbec7a-c2c6-48cd-b934-1f4a81aac666 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:32.085449 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c55e761-19d4-4f56-8616-fe6c79f30202 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:32.157137 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b821d7-510e-4aec-bc3f-562aef1f0ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:32.158530 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b821d7-510e-4aec-bc3f-562aef1f0ef9 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:32.158955 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b821d7-510e-4aec-bc3f-562aef1f0ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:32.159368 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b821d7-510e-4aec-bc3f-562aef1f0ef9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:32.180881 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b821d7-510e-4aec-bc3f-562aef1f0ef9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:41:32.186639 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-a9b821d7-510e-4aec-bc3f-562aef1f0ef9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:41:32.186639 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:41:32.186639 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:41:32.186639 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:41:32.186639 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:41:32.186639 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:41:32.186639 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:41:32.186639 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:41:32.186639 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:41:32.186639 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:41:32.186639 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:41:32.186639 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:41:32.186639 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:41:32.186639 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:41:32.186639 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:41:32.186639 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:41:32.187767 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:41:32.187767 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:41:32.187767 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:41:32.187767 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:41:32.187767 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:41:32.187767 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:41:32.187767 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:41:32.187767 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:41:32.187767 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:41:32.187767 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:41:32.187767 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:41:32.187767 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:41:32.187767 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:41:32.187767 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:41:32.187767 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:41:32.187767 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:41:32.188743 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:41:32.188743 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:41:32.188743 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:41:32.188743 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:41:32.188743 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:41:32.188743 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:41:32.188743 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:41:32.188743 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:41:32.188743 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:41:32.188743 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:41:32.188743 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:41:32.188743 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:41:32.194853 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 145/288] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 19 14:41:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:41:32.201157 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b821d7-510e-4aec-bc3f-562aef1f0ef9 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:32.209569 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fbec7a-c2c6-48cd-b934-1f4a81aac666 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:32.277975 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb1d352-2c08-4b60-930c-1ee7944d33c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:32.278647 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb1d352-2c08-4b60-930c-1ee7944d33c7 None admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:32.278921 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb1d352-2c08-4b60-930c-1ee7944d33c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:32.279254 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb1d352-2c08-4b60-930c-1ee7944d33c7 None admin] PATH_INFO: `/v3/projects/e5026d679036436ab5fab42a948bc2a7/users/f2245ff2fede4c8b994b584b100d133b/roles/f23b6d2ba5de4bf68b75b7fa1a4f1b84` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:32.283598 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb1d352-2c08-4b60-930c-1ee7944d33c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=e5026d679036436ab5fab42a948bc2a7, user_id=f2245ff2fede4c8b994b584b100d133b, role_id=f23b6d2ba5de4bf68b75b7fa1a4f1b84)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:32.285575 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb1d352-2c08-4b60-930c-1ee7944d33c7 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:32.303127 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 144/289] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Sep 19 14:41:32 2022] PUT /identity/v3/projects/e5026d679036436ab5fab42a948bc2a7/users/f2245ff2fede4c8b994b584b100d133b/roles/f23b6d2ba5de4bf68b75b7fa1a4f1b84 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:41:32.356569 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:32.359902 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b821d7-510e-4aec-bc3f-562aef1f0ef9 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:32.398447 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d416c346-367e-4fb2-a7be-e2ef52b63eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:32.399098 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d416c346-367e-4fb2-a7be-e2ef52b63eb7 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:32.399374 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d416c346-367e-4fb2-a7be-e2ef52b63eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:32.399639 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d416c346-367e-4fb2-a7be-e2ef52b63eb7 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:32.400300 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d416c346-367e-4fb2-a7be-e2ef52b63eb7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:41:32.400596 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d416c346-367e-4fb2-a7be-e2ef52b63eb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:32.402036 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d416c346-367e-4fb2-a7be-e2ef52b63eb7 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:32.411937 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 146/290] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Sep 19 14:41:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:41:32.417914 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb1d352-2c08-4b60-930c-1ee7944d33c7 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:32.471181 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:32.566262 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb1d352-2c08-4b60-930c-1ee7944d33c7 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:32.610972 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77b90ca-bedb-44cb-ae1c-4d21d5d8c88b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:32.611989 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77b90ca-bedb-44cb-ae1c-4d21d5d8c88b None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:32.612454 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77b90ca-bedb-44cb-ae1c-4d21d5d8c88b None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:32.612905 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77b90ca-bedb-44cb-ae1c-4d21d5d8c88b None admin] PATH_INFO: `/v3/users/1b380e8f3600405aa3fdc10d224283db` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:32.614250 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77b90ca-bedb-44cb-ae1c-4d21d5d8c88b None admin] RBAC: Authorizing `identity:get_user(user_id=1b380e8f3600405aa3fdc10d224283db)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:32.615878 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77b90ca-bedb-44cb-ae1c-4d21d5d8c88b None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:32.622313 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 145/291] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 19 14:41:32 2022] GET /identity/v3/users/1b380e8f3600405aa3fdc10d224283db => generated 297 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:32.624003 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d416c346-367e-4fb2-a7be-e2ef52b63eb7 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:32.772887 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d416c346-367e-4fb2-a7be-e2ef52b63eb7 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:32.833817 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279910ed-af45-48a9-b644-ce08a0e6b5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:32.834454 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279910ed-af45-48a9-b644-ce08a0e6b5b0 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:32.834737 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279910ed-af45-48a9-b644-ce08a0e6b5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:32.835005 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279910ed-af45-48a9-b644-ce08a0e6b5b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:32.874147 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:32.927727 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279910ed-af45-48a9-b644-ce08a0e6b5b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:32.929219 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279910ed-af45-48a9-b644-ce08a0e6b5b0 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:33.053704 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 147/292] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 19 14:41:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:33.059393 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77b90ca-bedb-44cb-ae1c-4d21d5d8c88b None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:33.181743 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:33.189391 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77b90ca-bedb-44cb-ae1c-4d21d5d8c88b None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:33.240508 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac15647-549e-4ad0-b7f7-8dc6ec752d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:33.241180 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac15647-549e-4ad0-b7f7-8dc6ec752d52 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:33.241463 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac15647-549e-4ad0-b7f7-8dc6ec752d52 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:33.241735 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac15647-549e-4ad0-b7f7-8dc6ec752d52 None admin] PATH_INFO: `/v3/projects/e5026d679036436ab5fab42a948bc2a7` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:33.242880 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac15647-549e-4ad0-b7f7-8dc6ec752d52 None admin] RBAC: Authorizing `identity:get_project(project_id=e5026d679036436ab5fab42a948bc2a7)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:33.244337 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac15647-549e-4ad0-b7f7-8dc6ec752d52 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:33.246028 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 146/293] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 19 14:41:33 2022] GET /identity/v3/projects/e5026d679036436ab5fab42a948bc2a7 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:41:33.252355 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279910ed-af45-48a9-b644-ce08a0e6b5b0 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:33.376781 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:33.431874 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279910ed-af45-48a9-b644-ce08a0e6b5b0 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:33.479161 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41fecfd-30d2-4330-9e35-be1556326c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:33.479776 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41fecfd-30d2-4330-9e35-be1556326c17 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:33.480088 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41fecfd-30d2-4330-9e35-be1556326c17 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:33.480318 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41fecfd-30d2-4330-9e35-be1556326c17 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:33.481332 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41fecfd-30d2-4330-9e35-be1556326c17 None admin] RBAC: Adding query filter params (role.id=74de6794e3b3422b93d26f993d260c35, scope.project.id=e5026d679036436ab5fab42a948bc2a7, user.id=1b380e8f3600405aa3fdc10d224283db) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:41:33.481741 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41fecfd-30d2-4330-9e35-be1556326c17 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:33.483381 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41fecfd-30d2-4330-9e35-be1556326c17 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:33.489957 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 148/294] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 19 14:41:33 2022] GET /identity/v3/role_assignments?user.id=1b380e8f3600405aa3fdc10d224283db&scope.project.id=e5026d679036436ab5fab42a948bc2a7&role.id=74de6794e3b3422b93d26f993d260c35 => generated 608 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:34.051437 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96bda37-df58-4a03-a97a-bc7e57a0234b None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:34.051769 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96bda37-df58-4a03-a97a-bc7e57a0234b None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:34.051987 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96bda37-df58-4a03-a97a-bc7e57a0234b None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:34.053434 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 147/295] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:41:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:41:34.059017 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe57b4c-3504-47f0-a3e7-df04296b3efa None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:34.059299 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe57b4c-3504-47f0-a3e7-df04296b3efa None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:34.059573 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe57b4c-3504-47f0-a3e7-df04296b3efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:34.084874 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-efe57b4c-3504-47f0-a3e7-df04296b3efa None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:41:34.086099 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-efe57b4c-3504-47f0-a3e7-df04296b3efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:41:34.134102 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d515f-ffbc-4472-9605-328020adfe73 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:34.134616 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d515f-ffbc-4472-9605-328020adfe73 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:34.134616 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d515f-ffbc-4472-9605-328020adfe73 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:34.136135 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 148/296] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:41:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 14:41:34.141974 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0553354d-2434-4e59-ba02-c7707d9f5297 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:34.142533 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0553354d-2434-4e59-ba02-c7707d9f5297 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:34.143001 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0553354d-2434-4e59-ba02-c7707d9f5297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:34.162959 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-0553354d-2434-4e59-ba02-c7707d9f5297 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:41:34.164563 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-0553354d-2434-4e59-ba02-c7707d9f5297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:41:34.187694 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 149/297] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:41:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:41:34.242848 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 149/298] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:41:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 14:41:34.485843 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe57b4c-3504-47f0-a3e7-df04296b3efa None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:34.520665 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0553354d-2434-4e59-ba02-c7707d9f5297 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:34.581396 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:34.640036 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe57b4c-3504-47f0-a3e7-df04296b3efa None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:34.642853 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:34.652656 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0553354d-2434-4e59-ba02-c7707d9f5297 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:34.683801 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2d2585-ce25-4a6c-ba4e-326f1b87895e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:34.684690 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2d2585-ce25-4a6c-ba4e-326f1b87895e None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:34.685150 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2d2585-ce25-4a6c-ba4e-326f1b87895e None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:34.686001 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2d2585-ce25-4a6c-ba4e-326f1b87895e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:34.687436 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2d2585-ce25-4a6c-ba4e-326f1b87895e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:34.689122 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2d2585-ce25-4a6c-ba4e-326f1b87895e None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:34.690724 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 150/299] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:41:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:34.691875 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f336cd-d126-4a24-849f-51b86a2f2477 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:34.692154 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f336cd-d126-4a24-849f-51b86a2f2477 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:34.692423 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f336cd-d126-4a24-849f-51b86a2f2477 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:34.697043 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 151/300] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:41:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:41:34.697043 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f336cd-d126-4a24-849f-51b86a2f2477 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:34.709499 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57216c46-1954-4e79-a82f-9609606a0c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:34.710229 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57216c46-1954-4e79-a82f-9609606a0c84 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:34.710510 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57216c46-1954-4e79-a82f-9609606a0c84 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:34.710784 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57216c46-1954-4e79-a82f-9609606a0c84 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:34.727100 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57216c46-1954-4e79-a82f-9609606a0c84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:41:34.732787 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-57216c46-1954-4e79-a82f-9609606a0c84 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 14:41:34.732787 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:41:34.732787 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:41:34.732787 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:41:34.732787 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:41:34.732787 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:41:34.732787 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:41:34.732787 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:41:34.732787 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:41:34.732787 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:41:34.732787 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:41:34.732787 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:41:34.732787 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:41:34.732787 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:41:34.732787 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:41:34.732787 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:41:34.733811 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:41:34.733811 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:41:34.733811 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:41:34.733811 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:41:34.733811 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:41:34.733811 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:41:34.733811 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:41:34.733811 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:41:34.733811 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:41:34.733811 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:41:34.733811 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:41:34.733811 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:41:34.733811 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:41:34.733811 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:41:34.733811 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:41:34.733811 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:41:34.734569 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:41:34.734569 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:41:34.734569 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:41:34.734569 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:41:34.734569 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:41:34.734569 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:41:34.734569 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:41:34.734569 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:41:34.734569 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:41:34.734569 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:41:34.734569 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 14:41:34.734569 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:41:34.734569 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 150/301] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 19 14:41:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:41:34.735672 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba00b01-9bb3-4905-b47c-4ad33f5b62aa None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:34.735672 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba00b01-9bb3-4905-b47c-4ad33f5b62aa None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:34.735672 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba00b01-9bb3-4905-b47c-4ad33f5b62aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:34.754873 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-1ba00b01-9bb3-4905-b47c-4ad33f5b62aa None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:41:34.755985 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-1ba00b01-9bb3-4905-b47c-4ad33f5b62aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:41:34.823771 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f336cd-d126-4a24-849f-51b86a2f2477 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:34.838415 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 151/302] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:41:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:41:34.842924 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba00b01-9bb3-4905-b47c-4ad33f5b62aa None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:34.853943 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:34.867676 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1b0899-dbbf-4a54-b787-f00f863ef30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:34.868302 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b0899-dbbf-4a54-b787-f00f863ef30f None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:34.868577 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b0899-dbbf-4a54-b787-f00f863ef30f None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:34.868848 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b0899-dbbf-4a54-b787-f00f863ef30f None admin] PATH_INFO: `/v3/groups` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:34.869572 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1b0899-dbbf-4a54-b787-f00f863ef30f None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:34.871015 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1b0899-dbbf-4a54-b787-f00f863ef30f None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:34.889787 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 152/303] 10.222.0.26 () {60 vars in 1134 bytes} [Mon Sep 19 14:41:34 2022] POST /identity/v3/groups => generated 229 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:41:34.918466 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd64eaf8-f895-4b6e-87d7-b3636a37cb7a None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:34.918788 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd64eaf8-f895-4b6e-87d7-b3636a37cb7a None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:34.919005 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd64eaf8-f895-4b6e-87d7-b3636a37cb7a None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:34.920903 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 153/304] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:41:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 14:41:34.926633 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4edf7b-1b61-4c0c-b33a-de03c06de111 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:34.926939 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4edf7b-1b61-4c0c-b33a-de03c06de111 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:34.927158 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4edf7b-1b61-4c0c-b33a-de03c06de111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:34.948924 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-cc4edf7b-1b61-4c0c-b33a-de03c06de111 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:41:34.950369 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-cc4edf7b-1b61-4c0c-b33a-de03c06de111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:41:35.005804 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:35.017661 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba00b01-9bb3-4905-b47c-4ad33f5b62aa None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:35.057754 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 154/305] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:41:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 14:41:35.075302 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fe9df0-597b-4d40-90a6-d4f83c33cf66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:35.076638 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe9df0-597b-4d40-90a6-d4f83c33cf66 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:35.077169 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe9df0-597b-4d40-90a6-d4f83c33cf66 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:35.077686 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe9df0-597b-4d40-90a6-d4f83c33cf66 None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:35.078572 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fe9df0-597b-4d40-90a6-d4f83c33cf66 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:41:35.079075 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fe9df0-597b-4d40-90a6-d4f83c33cf66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:35.080921 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fe9df0-597b-4d40-90a6-d4f83c33cf66 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:35.091148 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 152/306] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Sep 19 14:41:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:35.097438 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4edf7b-1b61-4c0c-b33a-de03c06de111 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:35.132162 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fe9df0-597b-4d40-90a6-d4f83c33cf66 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:35.222632 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4edf7b-1b61-4c0c-b33a-de03c06de111 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:35.240830 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:35.261172 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fe9df0-597b-4d40-90a6-d4f83c33cf66 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:35.271161 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3863f75e-c1fe-41ab-9d71-02c3962cac61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:35.272575 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3863f75e-c1fe-41ab-9d71-02c3962cac61 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:35.273464 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3863f75e-c1fe-41ab-9d71-02c3962cac61 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:35.273967 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3863f75e-c1fe-41ab-9d71-02c3962cac61 None admin] PATH_INFO: `/v3/users/32598a77c186443ea57d6706038af280` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:35.294217 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3863f75e-c1fe-41ab-9d71-02c3962cac61 None admin] RBAC: Authorizing `identity:get_user(user_id=32598a77c186443ea57d6706038af280)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:35.296733 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3863f75e-c1fe-41ab-9d71-02c3962cac61 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:35.297935 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93e48c9-5ad8-4055-8d5e-b3c41b1c8cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:35.298648 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93e48c9-5ad8-4055-8d5e-b3c41b1c8cc1 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:35.298987 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93e48c9-5ad8-4055-8d5e-b3c41b1c8cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:35.299340 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93e48c9-5ad8-4055-8d5e-b3c41b1c8cc1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:35.299804 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 155/307] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 19 14:41:35 2022] GET /identity/v3/users/32598a77c186443ea57d6706038af280 => generated 293 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:35.304953 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3863f75e-c1fe-41ab-9d71-02c3962cac61 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:35.319517 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93e48c9-5ad8-4055-8d5e-b3c41b1c8cc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:41:35.327852 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-a93e48c9-5ad8-4055-8d5e-b3c41b1c8cc1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:41:35.327852 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:41:35.327852 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:41:35.327852 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:41:35.327852 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:41:35.327852 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:41:35.327852 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:41:35.327852 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:41:35.327852 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:41:35.327852 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:41:35.327852 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:41:35.327852 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:41:35.327852 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:41:35.327852 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:41:35.327852 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:41:35.327852 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:41:35.328744 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:41:35.328744 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:41:35.328744 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:41:35.328744 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:41:35.328744 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:41:35.328744 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:41:35.328744 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:41:35.328744 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:41:35.328744 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:41:35.328744 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:41:35.328744 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:41:35.328744 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:41:35.328744 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:41:35.328744 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:41:35.328744 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:41:35.328744 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:41:35.329574 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:41:35.329574 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:41:35.329574 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:41:35.329574 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:41:35.329574 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:41:35.329574 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:41:35.329574 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:41:35.329574 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:41:35.329574 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:41:35.329574 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:41:35.329574 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:41:35.329574 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:41:35.333069 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 153/308] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 19 14:41:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:41:35.336181 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93e48c9-5ad8-4055-8d5e-b3c41b1c8cc1 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:35.349707 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:35.419257 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3863f75e-c1fe-41ab-9d71-02c3962cac61 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:35.453914 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93e48c9-5ad8-4055-8d5e-b3c41b1c8cc1 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:35.457641 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac5a2b-7494-4d71-9700-3ffd1a82391b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:35.458481 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac5a2b-7494-4d71-9700-3ffd1a82391b None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:35.458948 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac5a2b-7494-4d71-9700-3ffd1a82391b None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:35.459429 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac5a2b-7494-4d71-9700-3ffd1a82391b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:35.460364 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaac5a2b-7494-4d71-9700-3ffd1a82391b None admin] RBAC: Adding query filter params (role.id=f23b6d2ba5de4bf68b75b7fa1a4f1b84, user.id=32598a77c186443ea57d6706038af280, scope.system=all) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:41:35.460859 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaac5a2b-7494-4d71-9700-3ffd1a82391b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:35.463065 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaac5a2b-7494-4d71-9700-3ffd1a82391b None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:35.470007 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 156/309] 10.222.0.26 () {56 vars in 1308 bytes} [Mon Sep 19 14:41:35 2022] GET /identity/v3/role_assignments?user.id=32598a77c186443ea57d6706038af280&scope.system=all&role.id=f23b6d2ba5de4bf68b75b7fa1a4f1b84 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:35.478390 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac5a2b-7494-4d71-9700-3ffd1a82391b None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:35.496541 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8808d3-e2f0-4bd1-8ff4-17d592cb1e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:35.497378 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8808d3-e2f0-4bd1-8ff4-17d592cb1e3f None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:35.498415 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8808d3-e2f0-4bd1-8ff4-17d592cb1e3f None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:35.498848 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8808d3-e2f0-4bd1-8ff4-17d592cb1e3f None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:35.499894 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8808d3-e2f0-4bd1-8ff4-17d592cb1e3f None admin] RBAC: Adding query filter params (name=member) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:41:35.500435 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8808d3-e2f0-4bd1-8ff4-17d592cb1e3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:35.502001 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8808d3-e2f0-4bd1-8ff4-17d592cb1e3f None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:35.515537 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 154/310] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Sep 19 14:41:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:41:35.520907 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8808d3-e2f0-4bd1-8ff4-17d592cb1e3f None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:35.530727 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:35.604914 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:35.606880 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac5a2b-7494-4d71-9700-3ffd1a82391b None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:35.645106 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8808d3-e2f0-4bd1-8ff4-17d592cb1e3f None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:35.647712 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23846a4c-cae8-41f1-a429-a3eb375c8da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:35.648818 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23846a4c-cae8-41f1-a429-a3eb375c8da5 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:35.648818 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23846a4c-cae8-41f1-a429-a3eb375c8da5 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:35.649130 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23846a4c-cae8-41f1-a429-a3eb375c8da5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:35.660840 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23846a4c-cae8-41f1-a429-a3eb375c8da5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:41:35.666875 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-23846a4c-cae8-41f1-a429-a3eb375c8da5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 14:41:35.666875 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:41:35.666875 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:41:35.666875 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:41:35.666875 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:41:35.666875 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:41:35.666875 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:41:35.666875 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:41:35.666875 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:41:35.666875 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:41:35.666875 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:41:35.666875 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:41:35.666875 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:41:35.666875 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:41:35.666875 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:41:35.666875 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:41:35.667780 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:41:35.667780 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:41:35.667780 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:41:35.667780 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:41:35.667780 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:41:35.667780 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:41:35.667780 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:41:35.667780 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:41:35.667780 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:41:35.667780 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:41:35.667780 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:41:35.667780 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:41:35.667780 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:41:35.667780 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:41:35.667780 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:41:35.667780 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:41:35.668967 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:41:35.668967 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:41:35.668967 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:41:35.668967 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:41:35.668967 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:41:35.668967 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:41:35.668967 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:41:35.668967 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:41:35.668967 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:41:35.668967 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:41:35.668967 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 14:41:35.668967 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:41:35.668967 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 157/311] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 19 14:41:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:41:35.674084 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23846a4c-cae8-41f1-a429-a3eb375c8da5 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:35.687367 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7894c62a-b467-4875-99bb-ad74eef9fe57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:35.688487 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7894c62a-b467-4875-99bb-ad74eef9fe57 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:35.689021 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7894c62a-b467-4875-99bb-ad74eef9fe57 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:35.689523 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7894c62a-b467-4875-99bb-ad74eef9fe57 None admin] PATH_INFO: `/v3/users/be8f16cf6e1545ad92005a77a4485258` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:35.690888 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7894c62a-b467-4875-99bb-ad74eef9fe57 None admin] RBAC: Authorizing `identity:get_user(user_id=be8f16cf6e1545ad92005a77a4485258)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:35.692536 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7894c62a-b467-4875-99bb-ad74eef9fe57 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:35.699213 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 155/312] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 19 14:41:35 2022] GET /identity/v3/users/be8f16cf6e1545ad92005a77a4485258 => generated 293 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:41:35.701110 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7894c62a-b467-4875-99bb-ad74eef9fe57 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:35.790089 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:35.798919 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23846a4c-cae8-41f1-a429-a3eb375c8da5 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:35.809167 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7894c62a-b467-4875-99bb-ad74eef9fe57 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:35.847512 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c0eb1e-b5e8-43b9-8003-811e7cdda617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:35.848642 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c0eb1e-b5e8-43b9-8003-811e7cdda617 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:35.849192 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c0eb1e-b5e8-43b9-8003-811e7cdda617 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:35.849628 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c0eb1e-b5e8-43b9-8003-811e7cdda617 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:35.850451 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c0eb1e-b5e8-43b9-8003-811e7cdda617 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:41:35.850911 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c0eb1e-b5e8-43b9-8003-811e7cdda617 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:35.852172 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237bba6d-bba7-461e-95d8-635e6a616759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:35.852671 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c0eb1e-b5e8-43b9-8003-811e7cdda617 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:35.852971 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237bba6d-bba7-461e-95d8-635e6a616759 None admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:35.853340 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237bba6d-bba7-461e-95d8-635e6a616759 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:35.853681 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237bba6d-bba7-461e-95d8-635e6a616759 None admin] PATH_INFO: `/v3/system/users/be8f16cf6e1545ad92005a77a4485258/roles/74de6794e3b3422b93d26f993d260c35` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:35.855300 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237bba6d-bba7-461e-95d8-635e6a616759 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=be8f16cf6e1545ad92005a77a4485258, role_id=74de6794e3b3422b93d26f993d260c35)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:35.856854 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237bba6d-bba7-461e-95d8-635e6a616759 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:35.864698 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 158/313] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Sep 19 14:41:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:41:35.871039 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c0eb1e-b5e8-43b9-8003-811e7cdda617 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:35.872227 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 156/314] 10.222.0.26 () {58 vars in 1334 bytes} [Mon Sep 19 14:41:35 2022] PUT /identity/v3/system/users/be8f16cf6e1545ad92005a77a4485258/roles/74de6794e3b3422b93d26f993d260c35 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 14:41:36.014707 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c0eb1e-b5e8-43b9-8003-811e7cdda617 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:36.057284 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0af3388-3e84-4d9a-bcca-985b819216d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:36.058017 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0af3388-3e84-4d9a-bcca-985b819216d1 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:36.058511 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0af3388-3e84-4d9a-bcca-985b819216d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:36.058974 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0af3388-3e84-4d9a-bcca-985b819216d1 None admin] PATH_INFO: `/v3/users/f2245ff2fede4c8b994b584b100d133b` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:36.061175 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0af3388-3e84-4d9a-bcca-985b819216d1 None admin] RBAC: Authorizing `identity:get_user(user_id=f2245ff2fede4c8b994b584b100d133b)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:36.063802 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0af3388-3e84-4d9a-bcca-985b819216d1 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:36.066782 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 159/315] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 19 14:41:35 2022] GET /identity/v3/users/f2245ff2fede4c8b994b584b100d133b => generated 297 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:36.072364 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237bba6d-bba7-461e-95d8-635e6a616759 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:36.075590 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:36.194326 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237bba6d-bba7-461e-95d8-635e6a616759 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:36.232668 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1a4885-4a08-4b3e-a13f-1f2280a6a6df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:36.234178 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a4885-4a08-4b3e-a13f-1f2280a6a6df None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:36.234841 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a4885-4a08-4b3e-a13f-1f2280a6a6df None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:36.235557 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a4885-4a08-4b3e-a13f-1f2280a6a6df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:36.309856 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1a4885-4a08-4b3e-a13f-1f2280a6a6df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:36.312302 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1a4885-4a08-4b3e-a13f-1f2280a6a6df None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:36.314455 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:36.422926 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 157/316] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 19 14:41:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:36.430125 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0af3388-3e84-4d9a-bcca-985b819216d1 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:36.468388 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:36.549114 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0af3388-3e84-4d9a-bcca-985b819216d1 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:36.584439 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4c8611-071d-4c45-95b1-d0fadf3ef2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:36.585051 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c8611-071d-4c45-95b1-d0fadf3ef2e6 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:36.585329 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c8611-071d-4c45-95b1-d0fadf3ef2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:36.585603 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c8611-071d-4c45-95b1-d0fadf3ef2e6 None admin] PATH_INFO: `/v3/projects/e5026d679036436ab5fab42a948bc2a7` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:36.586744 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4c8611-071d-4c45-95b1-d0fadf3ef2e6 None admin] RBAC: Authorizing `identity:get_project(project_id=e5026d679036436ab5fab42a948bc2a7)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:36.588196 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4c8611-071d-4c45-95b1-d0fadf3ef2e6 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:36.589865 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 160/317] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 19 14:41:36 2022] GET /identity/v3/projects/e5026d679036436ab5fab42a948bc2a7 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:36.596810 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1a4885-4a08-4b3e-a13f-1f2280a6a6df None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:36.703540 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1a4885-4a08-4b3e-a13f-1f2280a6a6df None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:36.705482 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:36.746235 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f450e30e-7a71-4c6f-b1b9-c8140a6320b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:36.746841 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450e30e-7a71-4c6f-b1b9-c8140a6320b0 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:36.747116 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450e30e-7a71-4c6f-b1b9-c8140a6320b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:36.747386 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450e30e-7a71-4c6f-b1b9-c8140a6320b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:36.748226 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f450e30e-7a71-4c6f-b1b9-c8140a6320b0 None admin] RBAC: Adding query filter params (role.id=f23b6d2ba5de4bf68b75b7fa1a4f1b84, scope.project.id=e5026d679036436ab5fab42a948bc2a7, user.id=f2245ff2fede4c8b994b584b100d133b) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:41:36.748764 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f450e30e-7a71-4c6f-b1b9-c8140a6320b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:36.750292 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f450e30e-7a71-4c6f-b1b9-c8140a6320b0 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:36.758522 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 158/318] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 19 14:41:36 2022] GET /identity/v3/role_assignments?user.id=f2245ff2fede4c8b994b584b100d133b&scope.project.id=e5026d679036436ab5fab42a948bc2a7&role.id=f23b6d2ba5de4bf68b75b7fa1a4f1b84 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:37.342092 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc3885b-70be-4bdc-87a6-37dabe2c16fb None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:37.342783 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc3885b-70be-4bdc-87a6-37dabe2c16fb None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:37.343251 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc3885b-70be-4bdc-87a6-37dabe2c16fb None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:37.345137 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 161/319] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:41:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:41:37.350746 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bdb062-8c32-4b50-b7b5-7840f6c0ed92 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:37.351192 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bdb062-8c32-4b50-b7b5-7840f6c0ed92 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:37.351284 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bdb062-8c32-4b50-b7b5-7840f6c0ed92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:37.371145 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-55bdb062-8c32-4b50-b7b5-7840f6c0ed92 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:41:37.372329 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-55bdb062-8c32-4b50-b7b5-7840f6c0ed92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:41:37.448507 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 159/320] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:41:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:41:37.714985 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff4b0b5-b357-4640-b79c-0b23ccf165e2 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:37.715539 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff4b0b5-b357-4640-b79c-0b23ccf165e2 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:37.715539 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff4b0b5-b357-4640-b79c-0b23ccf165e2 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:37.717205 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 162/321] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:41:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:41:37.722752 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff4b0b5-b357-4640-b79c-0b23ccf165e2 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:37.723093 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84763c7c-0c41-472a-b640-ebcb4f473fe8 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:37.723501 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84763c7c-0c41-472a-b640-ebcb4f473fe8 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:37.723884 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84763c7c-0c41-472a-b640-ebcb4f473fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:37.743402 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-84763c7c-0c41-472a-b640-ebcb4f473fe8 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:41:37.744617 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-84763c7c-0c41-472a-b640-ebcb4f473fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:41:37.818427 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 160/322] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:41:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:41:37.825634 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:37.834710 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff4b0b5-b357-4640-b79c-0b23ccf165e2 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:37.869394 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feeb8f1-ebf4-48e2-b1a5-8000da646b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:37.870133 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feeb8f1-ebf4-48e2-b1a5-8000da646b50 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:37.870411 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feeb8f1-ebf4-48e2-b1a5-8000da646b50 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:37.870682 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feeb8f1-ebf4-48e2-b1a5-8000da646b50 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:37.871867 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feeb8f1-ebf4-48e2-b1a5-8000da646b50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:37.874729 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feeb8f1-ebf4-48e2-b1a5-8000da646b50 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:37.877040 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 163/323] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:41:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:41:37.892182 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84763c7c-0c41-472a-b640-ebcb4f473fe8 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:37.921023 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:38.010315 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84763c7c-0c41-472a-b640-ebcb4f473fe8 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:38.051802 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddeb9c2-ac7f-4fc6-9945-ce292baf51ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:38.052431 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddeb9c2-ac7f-4fc6-9945-ce292baf51ab None admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:38.052703 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddeb9c2-ac7f-4fc6-9945-ce292baf51ab None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:38.052967 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddeb9c2-ac7f-4fc6-9945-ce292baf51ab None admin] PATH_INFO: `/v3/groups` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:38.053643 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddeb9c2-ac7f-4fc6-9945-ce292baf51ab None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:38.055111 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddeb9c2-ac7f-4fc6-9945-ce292baf51ab None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:38.074307 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 161/324] 10.222.0.26 () {60 vars in 1134 bytes} [Mon Sep 19 14:41:37 2022] POST /identity/v3/groups => generated 226 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:41:38.096559 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feeb8f1-ebf4-48e2-b1a5-8000da646b50 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:38.158675 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39899f27-e02b-44d3-bcbf-32fe5e51b056 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:38.159058 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39899f27-e02b-44d3-bcbf-32fe5e51b056 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:38.159205 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39899f27-e02b-44d3-bcbf-32fe5e51b056 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:38.160763 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 162/325] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:41:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 14:41:38.166917 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fdc8f3-fe82-47c8-9b91-f38e8dbb4a9e None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:38.167727 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fdc8f3-fe82-47c8-9b91-f38e8dbb4a9e None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:38.168008 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fdc8f3-fe82-47c8-9b91-f38e8dbb4a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:38.190093 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-72fdc8f3-fe82-47c8-9b91-f38e8dbb4a9e None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:41:38.191181 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-72fdc8f3-fe82-47c8-9b91-f38e8dbb4a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:41:38.215745 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feeb8f1-ebf4-48e2-b1a5-8000da646b50 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:38.254664 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235257c0-cb99-482d-b166-df9ab671e806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:38.255221 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235257c0-cb99-482d-b166-df9ab671e806 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:38.255503 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235257c0-cb99-482d-b166-df9ab671e806 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:38.255803 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235257c0-cb99-482d-b166-df9ab671e806 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:38.267904 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235257c0-cb99-482d-b166-df9ab671e806 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:41:38.272532 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 163/326] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:41:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:41:38.273999 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-235257c0-cb99-482d-b166-df9ab671e806 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 14:41:38.273999 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:41:38.273999 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:41:38.273999 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:41:38.273999 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:41:38.273999 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:41:38.273999 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:41:38.273999 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:41:38.273999 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:41:38.273999 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:41:38.273999 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:41:38.273999 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:41:38.273999 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:41:38.273999 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:41:38.273999 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:41:38.273999 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:41:38.274866 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:41:38.274866 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:41:38.274866 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:41:38.274866 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:41:38.274866 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:41:38.274866 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:41:38.274866 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:41:38.274866 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:41:38.274866 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:41:38.274866 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:41:38.274866 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:41:38.274866 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:41:38.274866 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:41:38.274866 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:41:38.274866 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:41:38.274866 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:41:38.276483 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:41:38.276483 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:41:38.276483 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:41:38.276483 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:41:38.276483 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:41:38.276483 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:41:38.276483 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:41:38.276483 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:41:38.276483 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:41:38.276483 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:41:38.276483 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 14:41:38.276483 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:41:38.276483 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 164/327] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 19 14:41:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:41:38.282128 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fdc8f3-fe82-47c8-9b91-f38e8dbb4a9e None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:38.303293 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:38.402491 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fdc8f3-fe82-47c8-9b91-f38e8dbb4a9e None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:38.452393 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca9e21f-22fe-4763-b195-a13c24eaca87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:38.454153 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca9e21f-22fe-4763-b195-a13c24eaca87 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:38.454153 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca9e21f-22fe-4763-b195-a13c24eaca87 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:38.454153 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca9e21f-22fe-4763-b195-a13c24eaca87 None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:38.454153 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca9e21f-22fe-4763-b195-a13c24eaca87 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:41:38.455635 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca9e21f-22fe-4763-b195-a13c24eaca87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:38.456655 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca9e21f-22fe-4763-b195-a13c24eaca87 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:38.467904 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 164/328] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Sep 19 14:41:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:38.474088 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235257c0-cb99-482d-b166-df9ab671e806 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:38.507295 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:38.552458 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca9e21f-22fe-4763-b195-a13c24eaca87 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:38.607306 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235257c0-cb99-482d-b166-df9ab671e806 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:38.652908 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3a9797-374e-4ea2-9e5b-fdcab8c70c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:38.653583 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a9797-374e-4ea2-9e5b-fdcab8c70c4d None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:38.654146 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a9797-374e-4ea2-9e5b-fdcab8c70c4d None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:38.654146 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a9797-374e-4ea2-9e5b-fdcab8c70c4d None admin] PATH_INFO: `/v3/users/32598a77c186443ea57d6706038af280` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:38.655322 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3a9797-374e-4ea2-9e5b-fdcab8c70c4d None admin] RBAC: Authorizing `identity:get_user(user_id=32598a77c186443ea57d6706038af280)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:38.656805 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3a9797-374e-4ea2-9e5b-fdcab8c70c4d None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:38.658634 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 165/329] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 19 14:41:38 2022] GET /identity/v3/users/32598a77c186443ea57d6706038af280 => generated 293 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:38.665921 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3a9797-374e-4ea2-9e5b-fdcab8c70c4d None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:38.678763 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:38.713787 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca9e21f-22fe-4763-b195-a13c24eaca87 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:38.764531 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d0b6ad-ac3e-48e5-bb49-acca877826d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:38.765882 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d0b6ad-ac3e-48e5-bb49-acca877826d2 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:38.765882 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d0b6ad-ac3e-48e5-bb49-acca877826d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:38.765882 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d0b6ad-ac3e-48e5-bb49-acca877826d2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:38.777190 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d0b6ad-ac3e-48e5-bb49-acca877826d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:41:38.783050 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-60d0b6ad-ac3e-48e5-bb49-acca877826d2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:41:38.783050 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:41:38.783050 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:41:38.783050 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:41:38.783050 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:41:38.783050 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:41:38.783050 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:41:38.783050 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:41:38.783050 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:41:38.783050 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:41:38.783050 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:41:38.783050 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:41:38.783050 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:41:38.783050 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:41:38.783050 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:41:38.783050 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:41:38.783995 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:41:38.783995 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:41:38.783995 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:41:38.783995 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:41:38.783995 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:41:38.783995 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:41:38.783995 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:41:38.783995 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:41:38.783995 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:41:38.783995 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:41:38.783995 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:41:38.783995 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:41:38.783995 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:41:38.783995 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:41:38.783995 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:41:38.783995 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:41:38.784824 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:41:38.784824 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:41:38.784824 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:41:38.784824 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:41:38.784824 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:41:38.784824 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:41:38.784824 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:41:38.784824 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:41:38.784824 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:41:38.784824 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:41:38.784824 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:41:38.784824 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:41:38.784824 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 165/330] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 19 14:41:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:41:38.790524 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d0b6ad-ac3e-48e5-bb49-acca877826d2 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:38.796952 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:38.806889 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3a9797-374e-4ea2-9e5b-fdcab8c70c4d None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:38.855930 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e844f45-a45a-493f-ad21-7f46f240367e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:38.857870 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e844f45-a45a-493f-ad21-7f46f240367e None admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:38.858009 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e844f45-a45a-493f-ad21-7f46f240367e None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:38.858286 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e844f45-a45a-493f-ad21-7f46f240367e None admin] PATH_INFO: `/v3/system/users/32598a77c186443ea57d6706038af280/roles/f23b6d2ba5de4bf68b75b7fa1a4f1b84` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:38.860395 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e844f45-a45a-493f-ad21-7f46f240367e None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=32598a77c186443ea57d6706038af280, role_id=f23b6d2ba5de4bf68b75b7fa1a4f1b84)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:38.861829 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e844f45-a45a-493f-ad21-7f46f240367e None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:38.875116 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 166/331] 10.222.0.26 () {58 vars in 1334 bytes} [Mon Sep 19 14:41:38 2022] PUT /identity/v3/system/users/32598a77c186443ea57d6706038af280/roles/f23b6d2ba5de4bf68b75b7fa1a4f1b84 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 14:41:38.923348 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d0b6ad-ac3e-48e5-bb49-acca877826d2 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:38.962174 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dbd169-dca8-41df-b452-e0b6652f7439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:38.962812 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dbd169-dca8-41df-b452-e0b6652f7439 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:38.963116 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dbd169-dca8-41df-b452-e0b6652f7439 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:38.963390 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dbd169-dca8-41df-b452-e0b6652f7439 None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:38.964070 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dbd169-dca8-41df-b452-e0b6652f7439 None admin] RBAC: Adding query filter params (name=member) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:41:38.964372 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dbd169-dca8-41df-b452-e0b6652f7439 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:38.965813 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dbd169-dca8-41df-b452-e0b6652f7439 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:38.972442 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:38.978062 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 166/332] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Sep 19 14:41:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:41:38.984334 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e844f45-a45a-493f-ad21-7f46f240367e None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:39.141349 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e844f45-a45a-493f-ad21-7f46f240367e None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:39.184512 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef42d65-045d-4dc4-84c2-49870e11d7ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:39.185360 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef42d65-045d-4dc4-84c2-49870e11d7ea None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:39.185723 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef42d65-045d-4dc4-84c2-49870e11d7ea None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:39.186001 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef42d65-045d-4dc4-84c2-49870e11d7ea None admin] PATH_INFO: `/v3/users/be8f16cf6e1545ad92005a77a4485258` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:39.187594 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef42d65-045d-4dc4-84c2-49870e11d7ea None admin] RBAC: Authorizing `identity:get_user(user_id=be8f16cf6e1545ad92005a77a4485258)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:39.189340 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef42d65-045d-4dc4-84c2-49870e11d7ea None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:39.191406 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 167/333] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 19 14:41:38 2022] GET /identity/v3/users/be8f16cf6e1545ad92005a77a4485258 => generated 293 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:39.197392 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dbd169-dca8-41df-b452-e0b6652f7439 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:39.383932 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dbd169-dca8-41df-b452-e0b6652f7439 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:39.430380 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a1ecfc-53ef-4506-bb4d-066c160f31c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:39.431680 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a1ecfc-53ef-4506-bb4d-066c160f31c3 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:39.432096 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a1ecfc-53ef-4506-bb4d-066c160f31c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:39.432516 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a1ecfc-53ef-4506-bb4d-066c160f31c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:39.433501 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a1ecfc-53ef-4506-bb4d-066c160f31c3 None admin] RBAC: Adding query filter params (role.id=74de6794e3b3422b93d26f993d260c35, user.id=be8f16cf6e1545ad92005a77a4485258, scope.system=all) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:41:39.433944 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a1ecfc-53ef-4506-bb4d-066c160f31c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:39.435983 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a1ecfc-53ef-4506-bb4d-066c160f31c3 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:39.453507 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 167/334] 10.222.0.26 () {56 vars in 1308 bytes} [Mon Sep 19 14:41:39 2022] GET /identity/v3/role_assignments?user.id=be8f16cf6e1545ad92005a77a4485258&scope.system=all&role.id=74de6794e3b3422b93d26f993d260c35 => generated 510 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:40.841712 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0657125b-1111-43ee-8c25-a9c535f2ebdd None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:40.842295 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0657125b-1111-43ee-8c25-a9c535f2ebdd None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:40.842656 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0657125b-1111-43ee-8c25-a9c535f2ebdd None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:40.845019 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 168/335] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:41:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:41:40.853650 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf3b1c3-3c08-4a37-b8ee-8385ee2014cb None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:40.854458 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf3b1c3-3c08-4a37-b8ee-8385ee2014cb None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:40.854458 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf3b1c3-3c08-4a37-b8ee-8385ee2014cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:40.878514 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-bcf3b1c3-3c08-4a37-b8ee-8385ee2014cb None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:41:40.879710 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-bcf3b1c3-3c08-4a37-b8ee-8385ee2014cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:41:40.942564 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:40.961089 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 168/336] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:41:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:41:41.563595 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0657125b-1111-43ee-8c25-a9c535f2ebdd None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:41.574587 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764e498-14b1-4e2a-8da3-1a768682b27d None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:41.574915 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764e498-14b1-4e2a-8da3-1a768682b27d None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:41.575142 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764e498-14b1-4e2a-8da3-1a768682b27d None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:41.577166 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 169/337] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:41:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 14:41:41.584564 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f88f2b-8dae-4865-8fe8-121b60dccd8e None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:41.584863 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f88f2b-8dae-4865-8fe8-121b60dccd8e None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:41.585143 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f88f2b-8dae-4865-8fe8-121b60dccd8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:41.598733 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:41.610876 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-82f88f2b-8dae-4865-8fe8-121b60dccd8e None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:41:41.612432 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-82f88f2b-8dae-4865-8fe8-121b60dccd8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:41:41.709517 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0657125b-1111-43ee-8c25-a9c535f2ebdd None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:41.719669 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 170/338] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:41:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 14:41:41.761752 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e645f4b-9436-439c-b2b0-c82afe91f9a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:41.762448 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e645f4b-9436-439c-b2b0-c82afe91f9a6 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:41.762741 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e645f4b-9436-439c-b2b0-c82afe91f9a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:41.763146 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e645f4b-9436-439c-b2b0-c82afe91f9a6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:41.780392 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e645f4b-9436-439c-b2b0-c82afe91f9a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:41:41.785376 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-4e645f4b-9436-439c-b2b0-c82afe91f9a6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:41:41.785376 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:41:41.785376 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:41:41.785376 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:41:41.785376 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:41:41.785376 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:41:41.785376 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:41:41.785376 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:41:41.785376 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:41:41.785376 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:41:41.785376 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:41:41.785376 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:41:41.785376 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:41:41.785376 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:41:41.785376 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:41:41.785376 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:41:41.786235 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:41:41.786235 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:41:41.786235 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:41:41.786235 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:41:41.786235 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:41:41.786235 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:41:41.786235 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:41:41.786235 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:41:41.786235 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:41:41.786235 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:41:41.786235 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:41:41.786235 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:41:41.786235 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:41:41.786235 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:41:41.786235 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:41:41.786235 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:41:41.787004 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:41:41.787004 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:41:41.787004 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:41:41.787004 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:41:41.787004 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:41:41.787004 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:41:41.787004 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:41:41.787004 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:41:41.787004 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:41:41.787004 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:41:41.787004 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:41:41.787004 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:41:41.787004 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 169/339] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 19 14:41:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:41:41.792864 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f88f2b-8dae-4865-8fe8-121b60dccd8e None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:41.949732 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f88f2b-8dae-4865-8fe8-121b60dccd8e None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:41.976404 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:42.005020 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4212d9-2643-4e81-acc8-e75fa0b620c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:42.005020 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4212d9-2643-4e81-acc8-e75fa0b620c0 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:42.005020 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4212d9-2643-4e81-acc8-e75fa0b620c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:42.005020 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4212d9-2643-4e81-acc8-e75fa0b620c0 None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:42.005371 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4212d9-2643-4e81-acc8-e75fa0b620c0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:41:42.005371 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4212d9-2643-4e81-acc8-e75fa0b620c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:42.005506 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4212d9-2643-4e81-acc8-e75fa0b620c0 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:42.019610 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 171/340] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Sep 19 14:41:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:42.025390 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e645f4b-9436-439c-b2b0-c82afe91f9a6 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:42.113985 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc993394-6517-410b-b849-66848eb42273 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:42.114659 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc993394-6517-410b-b849-66848eb42273 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:42.115204 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc993394-6517-410b-b849-66848eb42273 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:42.117338 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 172/341] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:41:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:41:42.127926 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b99526-d070-4ed8-b60b-80424921a413 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:42.128268 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b99526-d070-4ed8-b60b-80424921a413 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:42.128490 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b99526-d070-4ed8-b60b-80424921a413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:42.156189 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-80b99526-d070-4ed8-b60b-80424921a413 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:41:42.158078 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-80b99526-d070-4ed8-b60b-80424921a413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:41:42.159555 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:42.207278 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e645f4b-9436-439c-b2b0-c82afe91f9a6 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:42.256841 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 173/342] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:41:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 14:41:42.297333 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb861bdd-47a4-478d-a8c5-91e656796bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:42.297963 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb861bdd-47a4-478d-a8c5-91e656796bf2 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:42.298237 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb861bdd-47a4-478d-a8c5-91e656796bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:42.298501 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb861bdd-47a4-478d-a8c5-91e656796bf2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:42.342979 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b99526-d070-4ed8-b60b-80424921a413 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:42.439975 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb861bdd-47a4-478d-a8c5-91e656796bf2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:42.441581 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb861bdd-47a4-478d-a8c5-91e656796bf2 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:42.539203 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b99526-d070-4ed8-b60b-80424921a413 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:42.555660 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:42.597755 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec7b51f-f787-43fb-9953-38ce6f021864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:42.598726 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec7b51f-f787-43fb-9953-38ce6f021864 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:42.599143 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec7b51f-f787-43fb-9953-38ce6f021864 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:42.599760 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec7b51f-f787-43fb-9953-38ce6f021864 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:42.629024 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec7b51f-f787-43fb-9953-38ce6f021864 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:41:42.637055 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-eec7b51f-f787-43fb-9953-38ce6f021864 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:41:42.637055 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:41:42.637055 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:41:42.637055 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:41:42.637055 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:41:42.637055 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:41:42.637055 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:41:42.637055 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:41:42.637055 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:41:42.637055 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:41:42.637055 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:41:42.637055 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:41:42.637055 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:41:42.637055 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:41:42.637055 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:41:42.637055 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:41:42.638527 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:41:42.638527 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:41:42.638527 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:41:42.638527 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:41:42.638527 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:41:42.638527 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:41:42.638527 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:41:42.638527 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:41:42.638527 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:41:42.638527 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:41:42.638527 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:41:42.638527 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:41:42.638527 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:41:42.638527 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:41:42.638527 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:41:42.638527 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:41:42.640050 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:41:42.640050 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:41:42.640050 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:41:42.640050 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:41:42.640050 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:41:42.640050 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:41:42.640050 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:41:42.640050 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:41:42.640050 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:41:42.640050 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:41:42.640050 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:41:42.640050 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:41:42.644895 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:42.649131 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 174/343] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 19 14:41:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:41:42.653153 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec7b51f-f787-43fb-9953-38ce6f021864 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:42.693456 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 170/344] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 19 14:41:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 668 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:42.701595 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb861bdd-47a4-478d-a8c5-91e656796bf2 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:42.787365 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec7b51f-f787-43fb-9953-38ce6f021864 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:42.831885 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095bf581-451c-4c11-9b66-4c98ceb313ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:42.832833 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095bf581-451c-4c11-9b66-4c98ceb313ea None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:42.833269 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095bf581-451c-4c11-9b66-4c98ceb313ea None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:42.833696 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095bf581-451c-4c11-9b66-4c98ceb313ea None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:42.834506 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095bf581-451c-4c11-9b66-4c98ceb313ea None admin] RBAC: Adding query filter params (name=member) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:41:42.834943 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095bf581-451c-4c11-9b66-4c98ceb313ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:42.836574 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095bf581-451c-4c11-9b66-4c98ceb313ea None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:42.851704 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 175/345] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Sep 19 14:41:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:41:42.852914 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095bf581-451c-4c11-9b66-4c98ceb313ea None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:42.890706 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:42.899295 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb861bdd-47a4-478d-a8c5-91e656796bf2 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:42.940473 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b20d76-f417-4617-bfc4-a107d50cddd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:42.941099 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b20d76-f417-4617-bfc4-a107d50cddd1 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:42.941382 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b20d76-f417-4617-bfc4-a107d50cddd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:42.941651 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b20d76-f417-4617-bfc4-a107d50cddd1 None admin] PATH_INFO: `/v3/projects/ef8c601e5bc64c818990445d938bb592` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:42.942798 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b20d76-f417-4617-bfc4-a107d50cddd1 None admin] RBAC: Authorizing `identity:get_project(project_id=ef8c601e5bc64c818990445d938bb592)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:42.944255 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b20d76-f417-4617-bfc4-a107d50cddd1 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:42.950676 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 171/346] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 19 14:41:42 2022] GET /identity/v3/projects/ef8c601e5bc64c818990445d938bb592 => generated 298 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:41:42.951977 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b20d76-f417-4617-bfc4-a107d50cddd1 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:42.977368 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095bf581-451c-4c11-9b66-4c98ceb313ea None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:43.014283 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:43.023773 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8f65d8-ad29-4660-ab79-ed552c3cbfa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:43.024689 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8f65d8-ad29-4660-ab79-ed552c3cbfa7 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:43.025190 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8f65d8-ad29-4660-ab79-ed552c3cbfa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:43.025628 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8f65d8-ad29-4660-ab79-ed552c3cbfa7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:43.037613 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8f65d8-ad29-4660-ab79-ed552c3cbfa7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:41:43.043349 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-2a8f65d8-ad29-4660-ab79-ed552c3cbfa7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 14:41:43.043349 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:41:43.043349 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:41:43.043349 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:41:43.043349 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:41:43.043349 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:41:43.043349 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:41:43.043349 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:41:43.043349 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:41:43.043349 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:41:43.043349 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:41:43.043349 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:41:43.043349 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:41:43.043349 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:41:43.043349 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:41:43.043349 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:41:43.044435 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:41:43.044435 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:41:43.044435 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:41:43.044435 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:41:43.044435 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:41:43.044435 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:41:43.044435 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:41:43.044435 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:41:43.044435 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:41:43.044435 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:41:43.044435 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:41:43.044435 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:41:43.044435 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:41:43.044435 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:41:43.044435 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:41:43.044435 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:41:43.045451 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:41:43.045451 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:41:43.045451 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:41:43.045451 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:41:43.045451 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:41:43.045451 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:41:43.045451 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:41:43.045451 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:41:43.045451 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:41:43.045451 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:41:43.045451 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 14:41:43.045451 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:41:43.047857 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 176/347] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Sep 19 14:41:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:41:43.054195 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b55331a-c54e-42e7-97d0-62cf9c5129b1 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:43.054824 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b55331a-c54e-42e7-97d0-62cf9c5129b1 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:43.055288 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b55331a-c54e-42e7-97d0-62cf9c5129b1 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:43.057607 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 177/348] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:41:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:41:43.058748 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b55331a-c54e-42e7-97d0-62cf9c5129b1 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:43.090852 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b20d76-f417-4617-bfc4-a107d50cddd1 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:43.136896 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06296ef3-12b4-496c-acf3-b4981956bc13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:43.138098 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06296ef3-12b4-496c-acf3-b4981956bc13 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:43.138703 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06296ef3-12b4-496c-acf3-b4981956bc13 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:43.139254 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06296ef3-12b4-496c-acf3-b4981956bc13 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:43.191591 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:43.212094 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b55331a-c54e-42e7-97d0-62cf9c5129b1 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:43.262220 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6e2e03-ed43-4544-827e-284580739c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:43.263391 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e2e03-ed43-4544-827e-284580739c29 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:43.264059 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e2e03-ed43-4544-827e-284580739c29 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:43.264677 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e2e03-ed43-4544-827e-284580739c29 None admin] PATH_INFO: `/v3/groups/44f044a65fa84a77b6d8ad594b808df3` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:43.272918 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6e2e03-ed43-4544-827e-284580739c29 None admin] RBAC: Authorizing `identity:get_group(group_id=44f044a65fa84a77b6d8ad594b808df3)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:43.274957 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6e2e03-ed43-4544-827e-284580739c29 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:43.281134 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 178/349] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Sep 19 14:41:43 2022] GET /identity/v3/groups/44f044a65fa84a77b6d8ad594b808df3 => generated 226 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:43.282629 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6e2e03-ed43-4544-827e-284580739c29 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:43.298731 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06296ef3-12b4-496c-acf3-b4981956bc13 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:43.302225 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06296ef3-12b4-496c-acf3-b4981956bc13 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:43.384768 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:43.408958 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6e2e03-ed43-4544-827e-284580739c29 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:43.460722 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 172/350] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 19 14:41:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:43.462557 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e51d5b-831c-4f43-90b2-a2dcf190d84b None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:43.462904 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e51d5b-831c-4f43-90b2-a2dcf190d84b None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:43.463175 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e51d5b-831c-4f43-90b2-a2dcf190d84b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:43.463441 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709ee685-53d8-4f21-876a-21b1915a6b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:43.464058 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709ee685-53d8-4f21-876a-21b1915a6b2d None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:43.464328 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709ee685-53d8-4f21-876a-21b1915a6b2d None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:43.464593 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709ee685-53d8-4f21-876a-21b1915a6b2d None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:43.465602 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709ee685-53d8-4f21-876a-21b1915a6b2d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:41:43.466020 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709ee685-53d8-4f21-876a-21b1915a6b2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:43.467728 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709ee685-53d8-4f21-876a-21b1915a6b2d None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:43.479756 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 179/351] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 19 14:41:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:43.481766 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709ee685-53d8-4f21-876a-21b1915a6b2d None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:43.487828 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-b1e51d5b-831c-4f43-90b2-a2dcf190d84b None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:41:43.489417 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b1e51d5b-831c-4f43-90b2-a2dcf190d84b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:41:43.509850 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:43.615283 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 173/352] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:41:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:41:43.617788 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b9e3d-5488-48f9-8529-6787d21e8f7a None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:43.618221 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b9e3d-5488-48f9-8529-6787d21e8f7a None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:43.618636 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b9e3d-5488-48f9-8529-6787d21e8f7a None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:43.622344 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 174/353] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:41:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:41:43.625949 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14b9e3d-5488-48f9-8529-6787d21e8f7a None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:43.645663 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709ee685-53d8-4f21-876a-21b1915a6b2d None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:43.696114 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f623c9-21a3-4475-b4c5-0f569c20dcd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:43.697558 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f623c9-21a3-4475-b4c5-0f569c20dcd5 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:43.698122 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f623c9-21a3-4475-b4c5-0f569c20dcd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:43.698573 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f623c9-21a3-4475-b4c5-0f569c20dcd5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:43.699649 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f623c9-21a3-4475-b4c5-0f569c20dcd5 None admin] RBAC: Adding query filter params (group.id=44f044a65fa84a77b6d8ad594b808df3, role.id=74de6794e3b3422b93d26f993d260c35, scope.project.id=ef8c601e5bc64c818990445d938bb592) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:41:43.700519 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f623c9-21a3-4475-b4c5-0f569c20dcd5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:43.703107 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f623c9-21a3-4475-b4c5-0f569c20dcd5 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:43.711037 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 180/354] 10.222.0.26 () {56 vars in 1376 bytes} [Mon Sep 19 14:41:43 2022] GET /identity/v3/role_assignments?group.id=44f044a65fa84a77b6d8ad594b808df3&scope.project.id=ef8c601e5bc64c818990445d938bb592&role.id=74de6794e3b3422b93d26f993d260c35 => generated 260 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:43.712458 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f623c9-21a3-4475-b4c5-0f569c20dcd5 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:43.738515 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:43.782980 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14b9e3d-5488-48f9-8529-6787d21e8f7a None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:43.830943 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:43.837976 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e1fedf-fad9-4d89-bec6-27d0747d2b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:43.840421 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e1fedf-fad9-4d89-bec6-27d0747d2b48 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:43.841057 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e1fedf-fad9-4d89-bec6-27d0747d2b48 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:43.841728 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e1fedf-fad9-4d89-bec6-27d0747d2b48 None admin] PATH_INFO: `/v3/projects/e5026d679036436ab5fab42a948bc2a7` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:43.844265 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e1fedf-fad9-4d89-bec6-27d0747d2b48 None admin] RBAC: Authorizing `identity:get_project(project_id=e5026d679036436ab5fab42a948bc2a7)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:43.846840 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e1fedf-fad9-4d89-bec6-27d0747d2b48 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:43.849637 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 175/355] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 19 14:41:43 2022] GET /identity/v3/projects/e5026d679036436ab5fab42a948bc2a7 => generated 302 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:43.851732 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15208b8-e3f9-4e72-8d88-bb5f56765e48 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:43.852188 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15208b8-e3f9-4e72-8d88-bb5f56765e48 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:43.853078 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15208b8-e3f9-4e72-8d88-bb5f56765e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:43.855582 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f623c9-21a3-4475-b4c5-0f569c20dcd5 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:43.880883 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-b15208b8-e3f9-4e72-8d88-bb5f56765e48 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:41:43.883258 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b15208b8-e3f9-4e72-8d88-bb5f56765e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:41:43.900722 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e085fe2-4d69-4b42-9f75-86311ff6c14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:43.901320 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e085fe2-4d69-4b42-9f75-86311ff6c14e None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:43.901593 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e085fe2-4d69-4b42-9f75-86311ff6c14e None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:43.901859 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e085fe2-4d69-4b42-9f75-86311ff6c14e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:43.989059 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 176/356] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:41:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:41:43.989059 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbed426-e54c-4baa-9f33-b415d9e2a129 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:43.989059 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbed426-e54c-4baa-9f33-b415d9e2a129 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:43.989059 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbed426-e54c-4baa-9f33-b415d9e2a129 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:43.992323 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 177/357] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:41:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:41:43.992323 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbed426-e54c-4baa-9f33-b415d9e2a129 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:44.032014 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e085fe2-4d69-4b42-9f75-86311ff6c14e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:44.033510 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e085fe2-4d69-4b42-9f75-86311ff6c14e None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:44.105602 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:44.130889 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:44.132223 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbed426-e54c-4baa-9f33-b415d9e2a129 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:44.152357 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 181/358] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 19 14:41:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:44.153652 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e085fe2-4d69-4b42-9f75-86311ff6c14e None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:44.170111 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9483bc-d01f-4c48-b4f8-2251fc3d22aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:44.171132 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9483bc-d01f-4c48-b4f8-2251fc3d22aa None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:44.171604 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9483bc-d01f-4c48-b4f8-2251fc3d22aa None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:44.172090 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9483bc-d01f-4c48-b4f8-2251fc3d22aa None admin] PATH_INFO: `/v3/groups/44f044a65fa84a77b6d8ad594b808df3` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:44.173553 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9483bc-d01f-4c48-b4f8-2251fc3d22aa None admin] RBAC: Authorizing `identity:get_group(group_id=44f044a65fa84a77b6d8ad594b808df3)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:44.175312 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9483bc-d01f-4c48-b4f8-2251fc3d22aa None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:44.177214 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 178/359] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Sep 19 14:41:43 2022] GET /identity/v3/groups/44f044a65fa84a77b6d8ad594b808df3 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:44.178613 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1021f08a-5bab-4a32-b3e4-bd31b18dacfe None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:44.179093 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1021f08a-5bab-4a32-b3e4-bd31b18dacfe None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:44.179557 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1021f08a-5bab-4a32-b3e4-bd31b18dacfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:44.199133 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-1021f08a-5bab-4a32-b3e4-bd31b18dacfe None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:41:44.201149 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-1021f08a-5bab-4a32-b3e4-bd31b18dacfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:41:44.267279 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e085fe2-4d69-4b42-9f75-86311ff6c14e None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:44.287803 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 179/360] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:41:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:41:44.293227 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1021f08a-5bab-4a32-b3e4-bd31b18dacfe None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:44.317649 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56431a30-4673-448b-9026-5c1ac901c839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:44.318347 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56431a30-4673-448b-9026-5c1ac901c839 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:44.318622 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56431a30-4673-448b-9026-5c1ac901c839 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:44.318890 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56431a30-4673-448b-9026-5c1ac901c839 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:44.341293 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56431a30-4673-448b-9026-5c1ac901c839 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:41:44.350575 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-56431a30-4673-448b-9026-5c1ac901c839 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 14:41:44.350575 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:41:44.350575 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:41:44.350575 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:41:44.350575 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:41:44.350575 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:41:44.350575 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:41:44.350575 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:41:44.350575 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:41:44.350575 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:41:44.350575 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:41:44.350575 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:41:44.350575 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:41:44.350575 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:41:44.350575 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:41:44.350575 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:41:44.352320 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:41:44.352320 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:41:44.352320 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:41:44.352320 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:41:44.352320 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:41:44.352320 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:41:44.352320 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:41:44.352320 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:41:44.352320 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:41:44.352320 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:41:44.352320 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:41:44.352320 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:41:44.352320 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:41:44.352320 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:41:44.352320 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:41:44.352320 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:41:44.353941 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:41:44.353941 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:41:44.353941 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:41:44.353941 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:41:44.353941 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:41:44.353941 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:41:44.353941 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:41:44.353941 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:41:44.353941 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:41:44.353941 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:41:44.353941 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 14:41:44.353941 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:41:44.357982 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 182/361] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 19 14:41:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:41:44.359388 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56431a30-4673-448b-9026-5c1ac901c839 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:44.416459 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:44.448767 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:44.451938 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1021f08a-5bab-4a32-b3e4-bd31b18dacfe None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:44.503357 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dece48b6-9691-4376-ad5d-d5f53bc6f494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:44.504302 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece48b6-9691-4376-ad5d-d5f53bc6f494 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:44.504747 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece48b6-9691-4376-ad5d-d5f53bc6f494 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:44.505223 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece48b6-9691-4376-ad5d-d5f53bc6f494 None admin] PATH_INFO: `/v3/projects/ef8c601e5bc64c818990445d938bb592` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:44.507267 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dece48b6-9691-4376-ad5d-d5f53bc6f494 None admin] RBAC: Authorizing `identity:get_project(project_id=ef8c601e5bc64c818990445d938bb592)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:44.509607 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dece48b6-9691-4376-ad5d-d5f53bc6f494 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:44.512218 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 180/362] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 19 14:41:44 2022] GET /identity/v3/projects/ef8c601e5bc64c818990445d938bb592 => generated 298 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:44.513404 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dece48b6-9691-4376-ad5d-d5f53bc6f494 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:44.539857 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56431a30-4673-448b-9026-5c1ac901c839 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:44.586379 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2ab9f9-ccfa-4979-bcc2-ab13d39c5c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:44.587342 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2ab9f9-ccfa-4979-bcc2-ab13d39c5c1c None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:44.587830 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2ab9f9-ccfa-4979-bcc2-ab13d39c5c1c None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:44.588290 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2ab9f9-ccfa-4979-bcc2-ab13d39c5c1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:44.589268 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2ab9f9-ccfa-4979-bcc2-ab13d39c5c1c None admin] RBAC: Adding query filter params (group.id=44f044a65fa84a77b6d8ad594b808df3, role.id=74de6794e3b3422b93d26f993d260c35, scope.project.id=e5026d679036436ab5fab42a948bc2a7) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:41:44.589817 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2ab9f9-ccfa-4979-bcc2-ab13d39c5c1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:44.591827 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2ab9f9-ccfa-4979-bcc2-ab13d39c5c1c None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:44.599981 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 183/363] 10.222.0.26 () {56 vars in 1376 bytes} [Mon Sep 19 14:41:44 2022] GET /identity/v3/role_assignments?group.id=44f044a65fa84a77b6d8ad594b808df3&scope.project.id=e5026d679036436ab5fab42a948bc2a7&role.id=74de6794e3b3422b93d26f993d260c35 => generated 260 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:44.601209 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2ab9f9-ccfa-4979-bcc2-ab13d39c5c1c None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:44.657437 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dece48b6-9691-4376-ad5d-d5f53bc6f494 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:44.708929 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86955494-460c-41f4-acc6-bdb50f1b4843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:44.710317 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86955494-460c-41f4-acc6-bdb50f1b4843 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:44.711016 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86955494-460c-41f4-acc6-bdb50f1b4843 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:44.711429 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86955494-460c-41f4-acc6-bdb50f1b4843 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:44.729973 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86955494-460c-41f4-acc6-bdb50f1b4843 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:41:44.737082 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-86955494-460c-41f4-acc6-bdb50f1b4843 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 14:41:44.737082 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:41:44.737082 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:41:44.737082 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:41:44.737082 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:41:44.737082 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:41:44.737082 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:41:44.737082 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:41:44.737082 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:41:44.737082 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:41:44.737082 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:41:44.737082 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:41:44.737082 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:41:44.737082 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:41:44.737082 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:41:44.737082 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:41:44.738318 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:41:44.738318 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:41:44.738318 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:41:44.738318 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:41:44.738318 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:41:44.738318 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:41:44.738318 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:41:44.738318 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:41:44.738318 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:41:44.738318 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:41:44.738318 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:41:44.738318 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:41:44.738318 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:41:44.738318 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:41:44.738318 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:41:44.738318 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:41:44.739293 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:41:44.739293 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:41:44.739293 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:41:44.739293 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:41:44.739293 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:41:44.739293 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:41:44.739293 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:41:44.739293 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:41:44.739293 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:41:44.739293 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:41:44.739293 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 14:41:44.739293 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:41:44.742286 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 181/364] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Sep 19 14:41:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:41:44.743849 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86955494-460c-41f4-acc6-bdb50f1b4843 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:44.751560 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:44.775451 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2ab9f9-ccfa-4979-bcc2-ab13d39c5c1c None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:44.786781 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:44.827859 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a1a629-74f3-4b85-823c-0c2c9c22cf10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:44.828855 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a1a629-74f3-4b85-823c-0c2c9c22cf10 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:44.829402 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a1a629-74f3-4b85-823c-0c2c9c22cf10 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:44.829918 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a1a629-74f3-4b85-823c-0c2c9c22cf10 None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:44.831196 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a1a629-74f3-4b85-823c-0c2c9c22cf10 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:41:44.832316 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a1a629-74f3-4b85-823c-0c2c9c22cf10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:44.834460 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a1a629-74f3-4b85-823c-0c2c9c22cf10 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:44.850438 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 184/365] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Sep 19 14:41:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:44.851624 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a1a629-74f3-4b85-823c-0c2c9c22cf10 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:44.911749 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86955494-460c-41f4-acc6-bdb50f1b4843 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:44.960644 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc572ac-a6f1-45c0-a6f8-7a6394ddc5d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:44.961260 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc572ac-a6f1-45c0-a6f8-7a6394ddc5d3 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:44.961544 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc572ac-a6f1-45c0-a6f8-7a6394ddc5d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:44.961810 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc572ac-a6f1-45c0-a6f8-7a6394ddc5d3 None admin] PATH_INFO: `/v3/groups/44f044a65fa84a77b6d8ad594b808df3` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:44.962988 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc572ac-a6f1-45c0-a6f8-7a6394ddc5d3 None admin] RBAC: Authorizing `identity:get_group(group_id=44f044a65fa84a77b6d8ad594b808df3)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:44.965495 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc572ac-a6f1-45c0-a6f8-7a6394ddc5d3 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:44.968121 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 182/366] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Sep 19 14:41:44 2022] GET /identity/v3/groups/44f044a65fa84a77b6d8ad594b808df3 => generated 226 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:44.968725 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc572ac-a6f1-45c0-a6f8-7a6394ddc5d3 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:45.013214 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a1a629-74f3-4b85-823c-0c2c9c22cf10 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:45.057943 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18b1179-dfdb-4c6f-ae07-38d1c7cadb6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:45.059257 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18b1179-dfdb-4c6f-ae07-38d1c7cadb6a None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:45.059744 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18b1179-dfdb-4c6f-ae07-38d1c7cadb6a None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:45.060155 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18b1179-dfdb-4c6f-ae07-38d1c7cadb6a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:45.072854 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18b1179-dfdb-4c6f-ae07-38d1c7cadb6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:41:45.073532 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:45.081067 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-f18b1179-dfdb-4c6f-ae07-38d1c7cadb6a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:41:45.081067 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:41:45.081067 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:41:45.081067 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:41:45.081067 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:41:45.081067 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:41:45.081067 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:41:45.081067 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:41:45.081067 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:41:45.081067 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:41:45.081067 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:41:45.081067 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:41:45.081067 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:41:45.081067 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:41:45.081067 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:41:45.081067 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:41:45.082192 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:41:45.082192 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:41:45.082192 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:41:45.082192 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:41:45.082192 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:41:45.082192 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:41:45.082192 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:41:45.082192 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:41:45.082192 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:41:45.082192 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:41:45.082192 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:41:45.082192 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:41:45.082192 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:41:45.082192 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:41:45.082192 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:41:45.082192 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:41:45.083145 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:41:45.083145 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:41:45.083145 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:41:45.083145 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:41:45.083145 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:41:45.083145 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:41:45.083145 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:41:45.083145 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:41:45.083145 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:41:45.083145 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:41:45.083145 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:41:45.083145 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:41:45.085354 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 185/367] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 19 14:41:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:41:45.086358 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18b1179-dfdb-4c6f-ae07-38d1c7cadb6a None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:45.110310 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc572ac-a6f1-45c0-a6f8-7a6394ddc5d3 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:45.118935 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:45.151600 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e7223f-7f0d-4211-a4e3-057eb310c125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:45.152479 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e7223f-7f0d-4211-a4e3-057eb310c125 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:45.152893 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e7223f-7f0d-4211-a4e3-057eb310c125 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:45.153418 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e7223f-7f0d-4211-a4e3-057eb310c125 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:45.154232 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e7223f-7f0d-4211-a4e3-057eb310c125 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:41:45.154848 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e7223f-7f0d-4211-a4e3-057eb310c125 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:45.156407 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e7223f-7f0d-4211-a4e3-057eb310c125 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:45.167221 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 183/368] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 19 14:41:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:45.168307 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e7223f-7f0d-4211-a4e3-057eb310c125 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:45.205842 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18b1179-dfdb-4c6f-ae07-38d1c7cadb6a None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:45.255557 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb5f961-a783-43d8-8c49-fd2a49996ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:45.256488 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb5f961-a783-43d8-8c49-fd2a49996ea9 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:45.256898 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb5f961-a783-43d8-8c49-fd2a49996ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:45.257332 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb5f961-a783-43d8-8c49-fd2a49996ea9 None admin] PATH_INFO: `/v3/users/32598a77c186443ea57d6706038af280` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:45.258653 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb5f961-a783-43d8-8c49-fd2a49996ea9 None admin] RBAC: Authorizing `identity:get_user(user_id=32598a77c186443ea57d6706038af280)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:45.260518 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb5f961-a783-43d8-8c49-fd2a49996ea9 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:45.262863 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 186/369] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 19 14:41:45 2022] GET /identity/v3/users/32598a77c186443ea57d6706038af280 => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:45.263810 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb5f961-a783-43d8-8c49-fd2a49996ea9 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:45.319095 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e7223f-7f0d-4211-a4e3-057eb310c125 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:45.363386 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c665463b-7538-47b2-a991-971bd926ffcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:45.363993 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c665463b-7538-47b2-a991-971bd926ffcc None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:45.364270 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c665463b-7538-47b2-a991-971bd926ffcc None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:45.364537 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c665463b-7538-47b2-a991-971bd926ffcc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:45.365480 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c665463b-7538-47b2-a991-971bd926ffcc None admin] RBAC: Adding query filter params (group.id=44f044a65fa84a77b6d8ad594b808df3, role.id=ae7ed67e62684598a31185ab16c971ce, scope.project.id=ef8c601e5bc64c818990445d938bb592) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:41:45.365590 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c665463b-7538-47b2-a991-971bd926ffcc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:45.367155 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c665463b-7538-47b2-a991-971bd926ffcc None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:45.369119 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:45.381722 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 184/370] 10.222.0.26 () {56 vars in 1376 bytes} [Mon Sep 19 14:41:45 2022] GET /identity/v3/role_assignments?group.id=44f044a65fa84a77b6d8ad594b808df3&scope.project.id=ef8c601e5bc64c818990445d938bb592&role.id=ae7ed67e62684598a31185ab16c971ce => generated 260 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:45.382710 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c665463b-7538-47b2-a991-971bd926ffcc None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:45.383204 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb5f961-a783-43d8-8c49-fd2a49996ea9 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:45.391732 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:45.426943 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e203af62-303c-4207-b14a-fefe53a087f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:45.427647 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e203af62-303c-4207-b14a-fefe53a087f4 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:45.427928 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e203af62-303c-4207-b14a-fefe53a087f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:45.428206 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e203af62-303c-4207-b14a-fefe53a087f4 None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:45.428881 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e203af62-303c-4207-b14a-fefe53a087f4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:41:45.429214 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e203af62-303c-4207-b14a-fefe53a087f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:45.430793 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e203af62-303c-4207-b14a-fefe53a087f4 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:45.442331 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 187/371] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 19 14:41:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:45.443213 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e203af62-303c-4207-b14a-fefe53a087f4 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:45.573047 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e203af62-303c-4207-b14a-fefe53a087f4 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:45.619343 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356c72c5-7386-468d-8eb4-614a4190f6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:45.619961 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c72c5-7386-468d-8eb4-614a4190f6dd None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:45.620235 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c72c5-7386-468d-8eb4-614a4190f6dd None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:45.620498 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c72c5-7386-468d-8eb4-614a4190f6dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:45.621290 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356c72c5-7386-468d-8eb4-614a4190f6dd None admin] RBAC: Adding query filter params (role.id=f23b6d2ba5de4bf68b75b7fa1a4f1b84, user.id=32598a77c186443ea57d6706038af280, scope.system=all) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:41:45.621591 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356c72c5-7386-468d-8eb4-614a4190f6dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:45.623330 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356c72c5-7386-468d-8eb4-614a4190f6dd None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:45.636881 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 188/372] 10.222.0.26 () {56 vars in 1308 bytes} [Mon Sep 19 14:41:45 2022] GET /identity/v3/role_assignments?user.id=32598a77c186443ea57d6706038af280&scope.system=all&role.id=f23b6d2ba5de4bf68b75b7fa1a4f1b84 => generated 510 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:45.637847 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356c72c5-7386-468d-8eb4-614a4190f6dd None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:45.665377 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:45.692234 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c665463b-7538-47b2-a991-971bd926ffcc None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:45.762149 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc17b69-5262-4ab0-99ca-ea53b8d28ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:45.762892 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc17b69-5262-4ab0-99ca-ea53b8d28ef4 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:45.763168 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc17b69-5262-4ab0-99ca-ea53b8d28ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:45.763441 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc17b69-5262-4ab0-99ca-ea53b8d28ef4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:45.812807 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356c72c5-7386-468d-8eb4-614a4190f6dd None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:45.879149 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:45.884353 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc17b69-5262-4ab0-99ca-ea53b8d28ef4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:45.885869 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc17b69-5262-4ab0-99ca-ea53b8d28ef4 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:45.901890 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e065ebd6-8c10-4f56-9a7b-16df53a72d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:45.902591 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e065ebd6-8c10-4f56-9a7b-16df53a72d81 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:45.902869 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e065ebd6-8c10-4f56-9a7b-16df53a72d81 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:45.903169 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e065ebd6-8c10-4f56-9a7b-16df53a72d81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:46.038311 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e065ebd6-8c10-4f56-9a7b-16df53a72d81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:46.039791 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e065ebd6-8c10-4f56-9a7b-16df53a72d81 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:46.075508 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:46.100832 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 185/373] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 19 14:41:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 718 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:46.105436 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc17b69-5262-4ab0-99ca-ea53b8d28ef4 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:46.222557 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 189/374] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 19 14:41:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 585 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:46.229335 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e065ebd6-8c10-4f56-9a7b-16df53a72d81 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:46.284980 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:46.296903 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc17b69-5262-4ab0-99ca-ea53b8d28ef4 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:46.362670 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96700021-d10c-4f29-89b8-97803478b87b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:46.363320 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96700021-d10c-4f29-89b8-97803478b87b None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:46.363596 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96700021-d10c-4f29-89b8-97803478b87b None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:46.363862 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96700021-d10c-4f29-89b8-97803478b87b None admin] PATH_INFO: `/v3/projects/e5026d679036436ab5fab42a948bc2a7` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:46.369759 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96700021-d10c-4f29-89b8-97803478b87b None admin] RBAC: Authorizing `identity:get_project(project_id=e5026d679036436ab5fab42a948bc2a7)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:46.371249 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96700021-d10c-4f29-89b8-97803478b87b None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:46.373795 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 186/375] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 19 14:41:46 2022] GET /identity/v3/projects/e5026d679036436ab5fab42a948bc2a7 => generated 302 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:46.379197 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96700021-d10c-4f29-89b8-97803478b87b None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:46.388893 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e065ebd6-8c10-4f56-9a7b-16df53a72d81 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:46.422847 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:46.430494 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d0a746-ae7e-449a-99ed-65e3d74a8875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:46.431329 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0a746-ae7e-449a-99ed-65e3d74a8875 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:46.431679 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0a746-ae7e-449a-99ed-65e3d74a8875 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:46.432045 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0a746-ae7e-449a-99ed-65e3d74a8875 None admin] PATH_INFO: `/v3/projects/d638629494b04280b2ba0fc11da818cf` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:46.433610 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d0a746-ae7e-449a-99ed-65e3d74a8875 None admin] RBAC: Authorizing `identity:get_project(project_id=d638629494b04280b2ba0fc11da818cf)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:46.435566 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d0a746-ae7e-449a-99ed-65e3d74a8875 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:46.439240 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 190/376] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 19 14:41:46 2022] GET /identity/v3/projects/d638629494b04280b2ba0fc11da818cf => generated 344 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:46.444974 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d0a746-ae7e-449a-99ed-65e3d74a8875 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:46.588297 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d0a746-ae7e-449a-99ed-65e3d74a8875 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:46.622523 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96700021-d10c-4f29-89b8-97803478b87b None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:46.662099 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38a3590-7772-4e2d-8be0-f11e26080566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:46.662748 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a3590-7772-4e2d-8be0-f11e26080566 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:46.663025 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a3590-7772-4e2d-8be0-f11e26080566 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:46.663295 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a3590-7772-4e2d-8be0-f11e26080566 None admin] PATH_INFO: `/v3/groups/7357d3b663b14418ada834c01a432376` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:46.677888 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38a3590-7772-4e2d-8be0-f11e26080566 None admin] RBAC: Authorizing `identity:get_group(group_id=7357d3b663b14418ada834c01a432376)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:46.679665 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38a3590-7772-4e2d-8be0-f11e26080566 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:46.682398 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 191/377] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Sep 19 14:41:46 2022] GET /identity/v3/groups/7357d3b663b14418ada834c01a432376 => generated 229 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:41:46.688687 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38a3590-7772-4e2d-8be0-f11e26080566 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:46.695524 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1bbf92-b7c1-41b8-8beb-6f8ae0ced244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:46.696168 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1bbf92-b7c1-41b8-8beb-6f8ae0ced244 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:46.696445 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1bbf92-b7c1-41b8-8beb-6f8ae0ced244 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:46.696715 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1bbf92-b7c1-41b8-8beb-6f8ae0ced244 None admin] PATH_INFO: `/v3/groups/44f044a65fa84a77b6d8ad594b808df3` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:46.697928 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1bbf92-b7c1-41b8-8beb-6f8ae0ced244 None admin] RBAC: Authorizing `identity:get_group(group_id=44f044a65fa84a77b6d8ad594b808df3)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:46.699419 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1bbf92-b7c1-41b8-8beb-6f8ae0ced244 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:46.701118 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 187/378] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Sep 19 14:41:46 2022] GET /identity/v3/groups/44f044a65fa84a77b6d8ad594b808df3 => generated 226 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:41:46.704315 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eed85e-0fb0-440f-8b16-2b27b104812d None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:46.704315 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eed85e-0fb0-440f-8b16-2b27b104812d None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:46.704315 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eed85e-0fb0-440f-8b16-2b27b104812d None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:46.704315 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 188/379] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:41:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:41:46.710804 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f5269-c125-4ba7-adeb-0730a0f2e597 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:46.711077 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f5269-c125-4ba7-adeb-0730a0f2e597 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:46.711347 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f5269-c125-4ba7-adeb-0730a0f2e597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:46.736950 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-d88f5269-c125-4ba7-adeb-0730a0f2e597 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:41:46.738429 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d88f5269-c125-4ba7-adeb-0730a0f2e597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:41:46.762092 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:46.776862 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:46.829799 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38a3590-7772-4e2d-8be0-f11e26080566 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:46.833510 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 189/380] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:41:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 14:41:46.834408 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88f5269-c125-4ba7-adeb-0730a0f2e597 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:46.897168 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2f2c06-24f7-4f87-94dc-2c44ae11536a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:46.897882 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f2c06-24f7-4f87-94dc-2c44ae11536a None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:46.898152 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f2c06-24f7-4f87-94dc-2c44ae11536a None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:46.898422 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f2c06-24f7-4f87-94dc-2c44ae11536a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:46.899161 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2f2c06-24f7-4f87-94dc-2c44ae11536a None admin] RBAC: Adding query filter params (group.id=7357d3b663b14418ada834c01a432376, role.id=019bde1756cb40de8ce06cef6b261f79, scope.project.id=d638629494b04280b2ba0fc11da818cf) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:41:46.899462 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2f2c06-24f7-4f87-94dc-2c44ae11536a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:46.901220 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2f2c06-24f7-4f87-94dc-2c44ae11536a None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:46.910416 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 192/381] 10.222.0.26 () {56 vars in 1376 bytes} [Mon Sep 19 14:41:46 2022] GET /identity/v3/role_assignments?group.id=7357d3b663b14418ada834c01a432376&scope.project.id=d638629494b04280b2ba0fc11da818cf&role.id=019bde1756cb40de8ce06cef6b261f79 => generated 260 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:41:47.032260 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88f5269-c125-4ba7-adeb-0730a0f2e597 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:47.079863 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeaf014-a671-40ee-87d2-6adb69dd95b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:47.080490 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeaf014-a671-40ee-87d2-6adb69dd95b0 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:47.080769 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeaf014-a671-40ee-87d2-6adb69dd95b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:47.081093 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeaf014-a671-40ee-87d2-6adb69dd95b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:47.081840 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeaf014-a671-40ee-87d2-6adb69dd95b0 None admin] RBAC: Adding query filter params (group.id=44f044a65fa84a77b6d8ad594b808df3, role.id=ae7ed67e62684598a31185ab16c971ce, scope.project.id=e5026d679036436ab5fab42a948bc2a7) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:41:47.082145 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeaf014-a671-40ee-87d2-6adb69dd95b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:47.083618 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeaf014-a671-40ee-87d2-6adb69dd95b0 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:47.090055 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 190/382] 10.222.0.26 () {56 vars in 1376 bytes} [Mon Sep 19 14:41:46 2022] GET /identity/v3/role_assignments?group.id=44f044a65fa84a77b6d8ad594b808df3&scope.project.id=e5026d679036436ab5fab42a948bc2a7&role.id=ae7ed67e62684598a31185ab16c971ce => generated 260 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:47.290695 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2f2c06-24f7-4f87-94dc-2c44ae11536a None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:47.379041 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae8acba-5f2d-4625-a2b4-7a8386642eec None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:47.379565 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae8acba-5f2d-4625-a2b4-7a8386642eec None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:47.379647 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae8acba-5f2d-4625-a2b4-7a8386642eec None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:47.380978 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 191/383] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:41:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 14:41:47.390029 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e087865-d5fd-4c88-a92c-e9b4c12dfece None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:47.390311 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e087865-d5fd-4c88-a92c-e9b4c12dfece None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:47.390580 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e087865-d5fd-4c88-a92c-e9b4c12dfece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:47.415136 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2f2c06-24f7-4f87-94dc-2c44ae11536a None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:47.416729 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-1e087865-d5fd-4c88-a92c-e9b4c12dfece None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:41:47.418688 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-1e087865-d5fd-4c88-a92c-e9b4c12dfece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:41:47.430900 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:47.458165 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef13c0a8-0758-450b-8db3-4c3902046d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:47.458842 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef13c0a8-0758-450b-8db3-4c3902046d0a None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:47.459037 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef13c0a8-0758-450b-8db3-4c3902046d0a None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:47.459303 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef13c0a8-0758-450b-8db3-4c3902046d0a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:47.465395 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:47.471956 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef13c0a8-0758-450b-8db3-4c3902046d0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:41:47.477401 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-ef13c0a8-0758-450b-8db3-4c3902046d0a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:41:47.477401 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:41:47.477401 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:41:47.477401 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:41:47.477401 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:41:47.477401 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:41:47.477401 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:41:47.477401 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:41:47.477401 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:41:47.477401 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:41:47.477401 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:41:47.477401 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:41:47.477401 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:41:47.477401 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:41:47.477401 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:41:47.477401 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:41:47.478258 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:41:47.478258 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:41:47.478258 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:41:47.478258 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:41:47.478258 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:41:47.478258 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:41:47.478258 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:41:47.478258 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:41:47.478258 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:41:47.478258 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:41:47.478258 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:41:47.478258 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:41:47.478258 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:41:47.478258 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:41:47.478258 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:41:47.478258 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:41:47.479167 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:41:47.479167 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:41:47.479167 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:41:47.479167 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:41:47.479167 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:41:47.479167 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:41:47.479167 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:41:47.479167 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:41:47.479167 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:41:47.479167 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:41:47.479167 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:41:47.479167 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:41:47.479167 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 193/384] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 19 14:41:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:41:47.485368 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef13c0a8-0758-450b-8db3-4c3902046d0a None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:47.549694 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 192/385] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:41:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:41:47.595675 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef13c0a8-0758-450b-8db3-4c3902046d0a None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:47.635973 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61f8c81-f8fe-4cd4-b5dd-5fe59522d523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:47.636585 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f8c81-f8fe-4cd4-b5dd-5fe59522d523 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:47.636865 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f8c81-f8fe-4cd4-b5dd-5fe59522d523 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:47.637168 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f8c81-f8fe-4cd4-b5dd-5fe59522d523 None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:47.637893 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61f8c81-f8fe-4cd4-b5dd-5fe59522d523 None admin] RBAC: Adding query filter params (name=member) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:41:47.638194 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61f8c81-f8fe-4cd4-b5dd-5fe59522d523 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:47.639594 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61f8c81-f8fe-4cd4-b5dd-5fe59522d523 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:47.651351 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 194/386] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Sep 19 14:41:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:41:47.658064 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e087865-d5fd-4c88-a92c-e9b4c12dfece None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:47.802488 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e087865-d5fd-4c88-a92c-e9b4c12dfece None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:47.852049 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536cda5b-930d-4eb8-9ee7-f177c1714886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:47.852701 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536cda5b-930d-4eb8-9ee7-f177c1714886 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:47.852980 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536cda5b-930d-4eb8-9ee7-f177c1714886 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:47.853275 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536cda5b-930d-4eb8-9ee7-f177c1714886 None admin] PATH_INFO: `/v3/groups/44f044a65fa84a77b6d8ad594b808df3` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:47.854423 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536cda5b-930d-4eb8-9ee7-f177c1714886 None admin] RBAC: Authorizing `identity:get_group(group_id=44f044a65fa84a77b6d8ad594b808df3)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:47.855884 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536cda5b-930d-4eb8-9ee7-f177c1714886 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:47.858035 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 193/387] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Sep 19 14:41:47 2022] GET /identity/v3/groups/44f044a65fa84a77b6d8ad594b808df3 => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:47.864105 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61f8c81-f8fe-4cd4-b5dd-5fe59522d523 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:47.930389 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:47.994160 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536cda5b-930d-4eb8-9ee7-f177c1714886 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:48.010120 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61f8c81-f8fe-4cd4-b5dd-5fe59522d523 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:48.047284 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:48.050910 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8e5e99-322d-4872-a15b-c452e38fce1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:48.051719 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e5e99-322d-4872-a15b-c452e38fce1b None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:48.052136 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e5e99-322d-4872-a15b-c452e38fce1b None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:48.052630 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e5e99-322d-4872-a15b-c452e38fce1b None admin] PATH_INFO: `/v3/projects/ef8c601e5bc64c818990445d938bb592` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:48.055143 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8e5e99-322d-4872-a15b-c452e38fce1b None admin] RBAC: Authorizing `identity:get_project(project_id=ef8c601e5bc64c818990445d938bb592)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:48.057033 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8e5e99-322d-4872-a15b-c452e38fce1b None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:48.059146 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 195/388] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 19 14:41:47 2022] GET /identity/v3/projects/ef8c601e5bc64c818990445d938bb592 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:48.066056 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8e5e99-322d-4872-a15b-c452e38fce1b None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:48.200512 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536cda5b-930d-4eb8-9ee7-f177c1714886 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:48.241889 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8e5e99-322d-4872-a15b-c452e38fce1b None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:48.243630 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:48.277694 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8ae34e-1345-4201-9aca-b41bbc5a671a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:48.278484 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8ae34e-1345-4201-9aca-b41bbc5a671a None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:48.278760 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8ae34e-1345-4201-9aca-b41bbc5a671a None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:48.279024 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8ae34e-1345-4201-9aca-b41bbc5a671a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:48.316652 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8ae34e-1345-4201-9aca-b41bbc5a671a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:41:48.322270 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-ac8ae34e-1345-4201-9aca-b41bbc5a671a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:41:48.322270 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:41:48.322270 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:41:48.322270 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:41:48.322270 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:41:48.322270 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:41:48.322270 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:41:48.322270 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:41:48.322270 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:41:48.322270 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:41:48.322270 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:41:48.322270 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:41:48.322270 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:41:48.322270 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:41:48.322270 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:41:48.322270 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:41:48.323146 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:41:48.323146 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:41:48.323146 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:41:48.323146 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:41:48.323146 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:41:48.323146 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:41:48.323146 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:41:48.323146 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:41:48.323146 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:41:48.323146 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:41:48.323146 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:41:48.323146 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:41:48.323146 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:41:48.323146 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:41:48.323146 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:41:48.323146 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:41:48.324000 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:41:48.324000 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:41:48.324000 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:41:48.324000 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:41:48.324000 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:41:48.324000 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:41:48.324000 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:41:48.324000 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:41:48.324000 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:41:48.324000 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:41:48.324000 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:41:48.324000 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:41:48.324000 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 194/389] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 19 14:41:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:41:48.330355 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a935b1-b1be-4a44-81fb-777da64147c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:48.331218 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8ae34e-1345-4201-9aca-b41bbc5a671a None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:48.331978 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a935b1-b1be-4a44-81fb-777da64147c1 None admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:48.332450 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a935b1-b1be-4a44-81fb-777da64147c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:48.332912 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a935b1-b1be-4a44-81fb-777da64147c1 None admin] PATH_INFO: `/v3/projects/ef8c601e5bc64c818990445d938bb592/groups/44f044a65fa84a77b6d8ad594b808df3/roles/74de6794e3b3422b93d26f993d260c35` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:48.335054 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a935b1-b1be-4a44-81fb-777da64147c1 None admin] RBAC: Authorizing `identity:create_grant(project_id=ef8c601e5bc64c818990445d938bb592, group_id=44f044a65fa84a77b6d8ad594b808df3, role_id=74de6794e3b3422b93d26f993d260c35)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:48.337422 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a935b1-b1be-4a44-81fb-777da64147c1 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:48.359434 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 196/390] 10.222.0.26 () {58 vars in 1442 bytes} [Mon Sep 19 14:41:48 2022] PUT /identity/v3/projects/ef8c601e5bc64c818990445d938bb592/groups/44f044a65fa84a77b6d8ad594b808df3/roles/74de6794e3b3422b93d26f993d260c35 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:41:48.395823 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f380bdc-c134-4339-9146-76dca5fb1f03 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:48.396395 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f380bdc-c134-4339-9146-76dca5fb1f03 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:48.396671 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f380bdc-c134-4339-9146-76dca5fb1f03 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:48.398414 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 197/391] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:41:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 14:41:48.410296 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a1fcb-62a6-4f1a-8cf4-e6d9b290a5ba None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:48.410616 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a1fcb-62a6-4f1a-8cf4-e6d9b290a5ba None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:48.410838 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a1fcb-62a6-4f1a-8cf4-e6d9b290a5ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:48.448292 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-3e8a1fcb-62a6-4f1a-8cf4-e6d9b290a5ba None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:41:48.450047 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-3e8a1fcb-62a6-4f1a-8cf4-e6d9b290a5ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:41:48.485830 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:48.516811 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8ae34e-1345-4201-9aca-b41bbc5a671a None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:48.591478 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 198/392] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:41:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 14:41:48.596331 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e13cab2-d7b6-47a8-b043-285219f7879b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:48.597071 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e13cab2-d7b6-47a8-b043-285219f7879b None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:48.597409 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e13cab2-d7b6-47a8-b043-285219f7879b None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:48.597684 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e13cab2-d7b6-47a8-b043-285219f7879b None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:48.598355 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e13cab2-d7b6-47a8-b043-285219f7879b None admin] RBAC: Adding query filter params (name=member) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:41:48.598658 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e13cab2-d7b6-47a8-b043-285219f7879b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:48.600076 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e13cab2-d7b6-47a8-b043-285219f7879b None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:48.617069 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 195/393] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Sep 19 14:41:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:41:48.623107 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8a1fcb-62a6-4f1a-8cf4-e6d9b290a5ba None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:48.740428 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:48.756650 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8a1fcb-62a6-4f1a-8cf4-e6d9b290a5ba None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:48.802802 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f724045-2f7a-45af-bc09-23ad015abaa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:48.803432 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f724045-2f7a-45af-bc09-23ad015abaa5 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:48.803708 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f724045-2f7a-45af-bc09-23ad015abaa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:48.803975 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f724045-2f7a-45af-bc09-23ad015abaa5 None admin] PATH_INFO: `/v3/groups/44f044a65fa84a77b6d8ad594b808df3` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:48.805228 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f724045-2f7a-45af-bc09-23ad015abaa5 None admin] RBAC: Authorizing `identity:get_group(group_id=44f044a65fa84a77b6d8ad594b808df3)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:48.806674 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f724045-2f7a-45af-bc09-23ad015abaa5 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:48.808562 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 199/394] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Sep 19 14:41:48 2022] GET /identity/v3/groups/44f044a65fa84a77b6d8ad594b808df3 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:48.813925 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e13cab2-d7b6-47a8-b043-285219f7879b None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:48.919679 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f724045-2f7a-45af-bc09-23ad015abaa5 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:48.967126 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e13cab2-d7b6-47a8-b043-285219f7879b None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:49.013867 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aa3e20-8d34-4986-a12e-0265320174a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:49.015051 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aa3e20-8d34-4986-a12e-0265320174a0 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:49.015543 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aa3e20-8d34-4986-a12e-0265320174a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:49.016056 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aa3e20-8d34-4986-a12e-0265320174a0 None admin] PATH_INFO: `/v3/projects/e5026d679036436ab5fab42a948bc2a7` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:49.017457 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aa3e20-8d34-4986-a12e-0265320174a0 None admin] RBAC: Authorizing `identity:get_project(project_id=e5026d679036436ab5fab42a948bc2a7)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:49.019371 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aa3e20-8d34-4986-a12e-0265320174a0 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:49.021656 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 196/395] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 19 14:41:48 2022] GET /identity/v3/projects/e5026d679036436ab5fab42a948bc2a7 => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:49.027326 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aa3e20-8d34-4986-a12e-0265320174a0 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:49.054220 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:49.077866 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f724045-2f7a-45af-bc09-23ad015abaa5 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:49.153955 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730b78a4-9812-4307-b571-3fc81e9907c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:49.154656 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b78a4-9812-4307-b571-3fc81e9907c3 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:49.155016 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b78a4-9812-4307-b571-3fc81e9907c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:49.155483 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b78a4-9812-4307-b571-3fc81e9907c3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:49.180725 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730b78a4-9812-4307-b571-3fc81e9907c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:41:49.187245 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aa3e20-8d34-4986-a12e-0265320174a0 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:49.197291 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-730b78a4-9812-4307-b571-3fc81e9907c3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 14:41:49.197291 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:41:49.197291 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:41:49.197291 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:41:49.197291 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:41:49.197291 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:41:49.197291 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:41:49.197291 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:41:49.197291 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:41:49.197291 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:41:49.197291 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:41:49.197291 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:41:49.197291 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:41:49.197291 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:41:49.197291 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:41:49.197291 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:41:49.198296 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:41:49.198296 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:41:49.198296 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:41:49.198296 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:41:49.198296 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:41:49.198296 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:41:49.198296 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:41:49.198296 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:41:49.198296 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:41:49.198296 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:41:49.198296 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:41:49.198296 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:41:49.198296 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:41:49.198296 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:41:49.198296 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:41:49.198296 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:41:49.199072 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:41:49.199072 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:41:49.199072 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:41:49.199072 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:41:49.199072 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:41:49.199072 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:41:49.199072 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:41:49.199072 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:41:49.199072 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:41:49.199072 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:41:49.199072 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 14:41:49.199072 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:41:49.200638 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 200/396] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Sep 19 14:41:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:41:49.205270 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730b78a4-9812-4307-b571-3fc81e9907c3 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:49.249358 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:49.268928 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0c6a0b-f9e0-411f-a0a1-4485e60cf20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:49.269626 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c6a0b-f9e0-411f-a0a1-4485e60cf20d None admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:49.269905 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c6a0b-f9e0-411f-a0a1-4485e60cf20d None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:49.270181 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c6a0b-f9e0-411f-a0a1-4485e60cf20d None admin] PATH_INFO: `/v3/projects/e5026d679036436ab5fab42a948bc2a7/groups/44f044a65fa84a77b6d8ad594b808df3/roles/74de6794e3b3422b93d26f993d260c35` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:49.276980 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0c6a0b-f9e0-411f-a0a1-4485e60cf20d None admin] RBAC: Authorizing `identity:create_grant(project_id=e5026d679036436ab5fab42a948bc2a7, group_id=44f044a65fa84a77b6d8ad594b808df3, role_id=74de6794e3b3422b93d26f993d260c35)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:49.281527 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0c6a0b-f9e0-411f-a0a1-4485e60cf20d None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:49.302624 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 197/397] 10.222.0.26 () {58 vars in 1442 bytes} [Mon Sep 19 14:41:49 2022] PUT /identity/v3/projects/e5026d679036436ab5fab42a948bc2a7/groups/44f044a65fa84a77b6d8ad594b808df3/roles/74de6794e3b3422b93d26f993d260c35 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 14:41:49.366205 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730b78a4-9812-4307-b571-3fc81e9907c3 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:49.422685 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca3ae5b-00d3-480f-b32b-18f797321b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:49.423359 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca3ae5b-00d3-480f-b32b-18f797321b90 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:49.423642 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca3ae5b-00d3-480f-b32b-18f797321b90 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:49.423906 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca3ae5b-00d3-480f-b32b-18f797321b90 None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:49.424645 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca3ae5b-00d3-480f-b32b-18f797321b90 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:41:49.424945 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca3ae5b-00d3-480f-b32b-18f797321b90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:49.426353 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca3ae5b-00d3-480f-b32b-18f797321b90 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:49.436481 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 201/398] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 19 14:41:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:41:49.442062 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0c6a0b-f9e0-411f-a0a1-4485e60cf20d None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:49.581281 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:49.617415 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0c6a0b-f9e0-411f-a0a1-4485e60cf20d None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:49.657054 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111b0674-b249-470c-9fe8-cbf41c94e033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:49.657764 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b0674-b249-470c-9fe8-cbf41c94e033 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:49.658037 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b0674-b249-470c-9fe8-cbf41c94e033 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:49.658311 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b0674-b249-470c-9fe8-cbf41c94e033 None admin] PATH_INFO: `/v3/groups/44f044a65fa84a77b6d8ad594b808df3` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:49.659534 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111b0674-b249-470c-9fe8-cbf41c94e033 None admin] RBAC: Authorizing `identity:get_group(group_id=44f044a65fa84a77b6d8ad594b808df3)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:49.661125 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111b0674-b249-470c-9fe8-cbf41c94e033 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:49.663158 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 198/399] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Sep 19 14:41:49 2022] GET /identity/v3/groups/44f044a65fa84a77b6d8ad594b808df3 => generated 226 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:49.669115 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca3ae5b-00d3-480f-b32b-18f797321b90 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:49.816756 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4decb3dc-0f75-45ec-be1a-9c1b4b943348 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:49.817128 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4decb3dc-0f75-45ec-be1a-9c1b4b943348 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:49.817258 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4decb3dc-0f75-45ec-be1a-9c1b4b943348 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:49.818902 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 199/400] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:41:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:41:49.822215 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:49.824826 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f9890b-d151-4a7c-99ce-4ead621dde40 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:49.825221 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f9890b-d151-4a7c-99ce-4ead621dde40 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:49.825545 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f9890b-d151-4a7c-99ce-4ead621dde40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:49.852371 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-43f9890b-d151-4a7c-99ce-4ead621dde40 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:41:49.853639 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-43f9890b-d151-4a7c-99ce-4ead621dde40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:41:49.862696 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca3ae5b-00d3-480f-b32b-18f797321b90 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:49.935520 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94ad904-05f4-46af-b0ba-4edbbf31b03d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:49.936165 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ad904-05f4-46af-b0ba-4edbbf31b03d None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:49.936444 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ad904-05f4-46af-b0ba-4edbbf31b03d None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:49.936717 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ad904-05f4-46af-b0ba-4edbbf31b03d None admin] PATH_INFO: `/v3/projects/ef8c601e5bc64c818990445d938bb592` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:49.940379 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94ad904-05f4-46af-b0ba-4edbbf31b03d None admin] RBAC: Authorizing `identity:get_project(project_id=ef8c601e5bc64c818990445d938bb592)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:49.941867 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94ad904-05f4-46af-b0ba-4edbbf31b03d None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:49.943843 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 202/401] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 19 14:41:49 2022] GET /identity/v3/projects/ef8c601e5bc64c818990445d938bb592 => generated 298 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:49.951044 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94ad904-05f4-46af-b0ba-4edbbf31b03d None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:49.992652 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 200/402] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:41:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 14:41:50.117378 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94ad904-05f4-46af-b0ba-4edbbf31b03d None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:50.165501 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbab053-c1ba-4234-8676-43e7a0548181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:50.166543 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbab053-c1ba-4234-8676-43e7a0548181 None admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:50.167000 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbab053-c1ba-4234-8676-43e7a0548181 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:50.167415 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbab053-c1ba-4234-8676-43e7a0548181 None admin] PATH_INFO: `/v3/projects/ef8c601e5bc64c818990445d938bb592/groups/44f044a65fa84a77b6d8ad594b808df3/roles/ae7ed67e62684598a31185ab16c971ce` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:50.170437 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbab053-c1ba-4234-8676-43e7a0548181 None admin] RBAC: Authorizing `identity:create_grant(project_id=ef8c601e5bc64c818990445d938bb592, group_id=44f044a65fa84a77b6d8ad594b808df3, role_id=ae7ed67e62684598a31185ab16c971ce)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:50.172214 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbab053-c1ba-4234-8676-43e7a0548181 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:50.203726 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 203/403] 10.222.0.26 () {58 vars in 1442 bytes} [Mon Sep 19 14:41:49 2022] PUT /identity/v3/projects/ef8c601e5bc64c818990445d938bb592/groups/44f044a65fa84a77b6d8ad594b808df3/roles/ae7ed67e62684598a31185ab16c971ce => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 14:41:50.308533 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f9890b-d151-4a7c-99ce-4ead621dde40 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:50.393386 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1a68b5-eb1f-43bd-bfe5-efda18a1b491 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:50.393921 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1a68b5-eb1f-43bd-bfe5-efda18a1b491 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:50.393921 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1a68b5-eb1f-43bd-bfe5-efda18a1b491 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:50.395398 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 204/404] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:41:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:41:50.401264 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b45dd-76be-4c09-b329-02be24e09ec3 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:50.402479 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b45dd-76be-4c09-b329-02be24e09ec3 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:50.402997 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b45dd-76be-4c09-b329-02be24e09ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:50.414525 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:50.423973 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-d81b45dd-76be-4c09-b329-02be24e09ec3 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:41:50.425694 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-d81b45dd-76be-4c09-b329-02be24e09ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:41:50.429896 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:50.463481 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f9890b-d151-4a7c-99ce-4ead621dde40 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:50.507812 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683df8d3-bdba-42ad-8f24-2dde5b70c8a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:50.508925 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683df8d3-bdba-42ad-8f24-2dde5b70c8a4 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:50.509485 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683df8d3-bdba-42ad-8f24-2dde5b70c8a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:50.509956 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683df8d3-bdba-42ad-8f24-2dde5b70c8a4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:50.524127 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683df8d3-bdba-42ad-8f24-2dde5b70c8a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:41:50.530839 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-683df8d3-bdba-42ad-8f24-2dde5b70c8a4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:41:50.530839 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:41:50.530839 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:41:50.530839 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:41:50.530839 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:41:50.530839 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:41:50.530839 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:41:50.530839 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:41:50.530839 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:41:50.530839 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:41:50.530839 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:41:50.530839 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:41:50.530839 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:41:50.530839 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:41:50.530839 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:41:50.530839 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:41:50.531778 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:41:50.531778 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:41:50.531778 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:41:50.531778 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:41:50.531778 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:41:50.531778 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:41:50.531778 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:41:50.531778 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:41:50.531778 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:41:50.531778 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:41:50.531778 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:41:50.531778 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:41:50.531778 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:41:50.531778 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:41:50.531778 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:41:50.531778 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:41:50.532552 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:41:50.532552 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:41:50.532552 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:41:50.532552 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:41:50.532552 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:41:50.532552 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:41:50.532552 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:41:50.532552 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:41:50.532552 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:41:50.532552 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:41:50.532552 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:41:50.532552 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:41:50.535385 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 201/405] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 19 14:41:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:41:50.541755 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683df8d3-bdba-42ad-8f24-2dde5b70c8a4 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:50.542308 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 205/406] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:41:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 14:41:50.691282 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683df8d3-bdba-42ad-8f24-2dde5b70c8a4 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:50.745293 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03806024-9089-4341-9dcb-135eef8920e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:50.745886 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03806024-9089-4341-9dcb-135eef8920e3 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:50.746163 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03806024-9089-4341-9dcb-135eef8920e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:50.746433 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03806024-9089-4341-9dcb-135eef8920e3 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:50.747296 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03806024-9089-4341-9dcb-135eef8920e3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:41:50.747598 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03806024-9089-4341-9dcb-135eef8920e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:50.749146 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03806024-9089-4341-9dcb-135eef8920e3 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:50.750846 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:50.761886 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 202/407] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 19 14:41:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:50.767252 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81b45dd-76be-4c09-b329-02be24e09ec3 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:50.900433 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81b45dd-76be-4c09-b329-02be24e09ec3 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:50.902149 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03806024-9089-4341-9dcb-135eef8920e3 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:50.939492 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4823d8-e3d7-4e03-b7fe-48daec2a72f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:50.940388 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4823d8-e3d7-4e03-b7fe-48daec2a72f2 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:50.940808 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4823d8-e3d7-4e03-b7fe-48daec2a72f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:50.941251 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4823d8-e3d7-4e03-b7fe-48daec2a72f2 None admin] PATH_INFO: `/v3/groups/7357d3b663b14418ada834c01a432376` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:50.942645 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4823d8-e3d7-4e03-b7fe-48daec2a72f2 None admin] RBAC: Authorizing `identity:get_group(group_id=7357d3b663b14418ada834c01a432376)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:50.944288 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4823d8-e3d7-4e03-b7fe-48daec2a72f2 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:50.946431 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 206/408] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Sep 19 14:41:50 2022] GET /identity/v3/groups/7357d3b663b14418ada834c01a432376 => generated 229 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:50.954990 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4823d8-e3d7-4e03-b7fe-48daec2a72f2 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:50.981521 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:51.146338 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4823d8-e3d7-4e03-b7fe-48daec2a72f2 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:51.157745 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03806024-9089-4341-9dcb-135eef8920e3 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:51.187666 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610e9a32-a0f3-4703-a3fb-f197de55db97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:51.188584 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e9a32-a0f3-4703-a3fb-f197de55db97 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:51.189048 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e9a32-a0f3-4703-a3fb-f197de55db97 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:51.189608 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e9a32-a0f3-4703-a3fb-f197de55db97 None admin] PATH_INFO: `/v3/projects/d638629494b04280b2ba0fc11da818cf` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:51.191181 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610e9a32-a0f3-4703-a3fb-f197de55db97 None admin] RBAC: Authorizing `identity:get_project(project_id=d638629494b04280b2ba0fc11da818cf)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:51.192909 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610e9a32-a0f3-4703-a3fb-f197de55db97 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:51.195115 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 207/409] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 19 14:41:50 2022] GET /identity/v3/projects/d638629494b04280b2ba0fc11da818cf => generated 344 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:51.202611 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610e9a32-a0f3-4703-a3fb-f197de55db97 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:51.240842 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3993e70-79d0-4d2f-be02-8a9175e8b9e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:51.241526 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3993e70-79d0-4d2f-be02-8a9175e8b9e1 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:51.241809 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3993e70-79d0-4d2f-be02-8a9175e8b9e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:51.242080 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3993e70-79d0-4d2f-be02-8a9175e8b9e1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:51.271682 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3993e70-79d0-4d2f-be02-8a9175e8b9e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:41:51.277347 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-a3993e70-79d0-4d2f-be02-8a9175e8b9e1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 14:41:51.277347 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:41:51.277347 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:41:51.277347 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:41:51.277347 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:41:51.277347 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:41:51.277347 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:41:51.277347 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:41:51.277347 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:41:51.277347 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:41:51.277347 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:41:51.277347 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:41:51.277347 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:41:51.277347 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:41:51.277347 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:41:51.277347 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:41:51.278418 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:41:51.278418 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:41:51.278418 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:41:51.278418 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:41:51.278418 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:41:51.278418 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:41:51.278418 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:41:51.278418 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:41:51.278418 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:41:51.278418 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:41:51.278418 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:41:51.278418 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:41:51.278418 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:41:51.278418 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:41:51.278418 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:41:51.278418 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:41:51.279205 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:41:51.279205 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:41:51.279205 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:41:51.279205 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:41:51.279205 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:41:51.279205 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:41:51.279205 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:41:51.279205 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:41:51.279205 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:41:51.279205 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:41:51.279205 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 14:41:51.279205 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:41:51.279205 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 203/410] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Sep 19 14:41:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 377 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:41:51.292481 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3993e70-79d0-4d2f-be02-8a9175e8b9e1 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:51.378056 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:51.401935 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:51.414580 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610e9a32-a0f3-4703-a3fb-f197de55db97 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:51.455740 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3993e70-79d0-4d2f-be02-8a9175e8b9e1 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:51.464143 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b06b41-3aed-4091-9a61-70dae4473b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:51.465248 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b06b41-3aed-4091-9a61-70dae4473b1e None admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:51.466505 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b06b41-3aed-4091-9a61-70dae4473b1e None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:51.467013 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b06b41-3aed-4091-9a61-70dae4473b1e None admin] PATH_INFO: `/v3/projects/d638629494b04280b2ba0fc11da818cf/groups/7357d3b663b14418ada834c01a432376/roles/019bde1756cb40de8ce06cef6b261f79` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:51.470360 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b06b41-3aed-4091-9a61-70dae4473b1e None admin] RBAC: Authorizing `identity:create_grant(project_id=d638629494b04280b2ba0fc11da818cf, group_id=7357d3b663b14418ada834c01a432376, role_id=019bde1756cb40de8ce06cef6b261f79)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:51.472225 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b06b41-3aed-4091-9a61-70dae4473b1e None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:51.490229 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 208/411] 10.222.0.26 () {58 vars in 1442 bytes} [Mon Sep 19 14:41:51 2022] PUT /identity/v3/projects/d638629494b04280b2ba0fc11da818cf/groups/7357d3b663b14418ada834c01a432376/roles/019bde1756cb40de8ce06cef6b261f79 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:41:51.491921 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3c8a52-80af-4643-a03a-d9c36be34676 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:51.492475 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3c8a52-80af-4643-a03a-d9c36be34676 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:51.492947 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3c8a52-80af-4643-a03a-d9c36be34676 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:51.494660 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 209/412] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:41:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:41:51.500964 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2ec1a-904f-4ff0-b097-2b83058db553 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:51.501610 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2ec1a-904f-4ff0-b097-2b83058db553 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:51.502097 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2ec1a-904f-4ff0-b097-2b83058db553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:51.508809 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10708fc8-6359-41b7-9cfa-4b3a8343874f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:51.509629 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10708fc8-6359-41b7-9cfa-4b3a8343874f None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:51.509735 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10708fc8-6359-41b7-9cfa-4b3a8343874f None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:51.510005 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10708fc8-6359-41b7-9cfa-4b3a8343874f None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:51.510809 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10708fc8-6359-41b7-9cfa-4b3a8343874f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:41:51.511117 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10708fc8-6359-41b7-9cfa-4b3a8343874f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:51.512624 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10708fc8-6359-41b7-9cfa-4b3a8343874f None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:51.528736 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-46f2ec1a-904f-4ff0-b097-2b83058db553 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:41:51.531060 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-46f2ec1a-904f-4ff0-b097-2b83058db553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:41:51.532333 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 204/413] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 19 14:41:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:51.552802 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10708fc8-6359-41b7-9cfa-4b3a8343874f None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:51.644474 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 210/414] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:41:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:41:51.715692 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10708fc8-6359-41b7-9cfa-4b3a8343874f None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:51.739789 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:51.759156 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e35f86-41cf-484a-a287-cd5b062ec9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:51.759805 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e35f86-41cf-484a-a287-cd5b062ec9c8 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:51.760082 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e35f86-41cf-484a-a287-cd5b062ec9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:51.760351 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e35f86-41cf-484a-a287-cd5b062ec9c8 None admin] PATH_INFO: `/v3/groups/44f044a65fa84a77b6d8ad594b808df3` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:51.761526 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e35f86-41cf-484a-a287-cd5b062ec9c8 None admin] RBAC: Authorizing `identity:get_group(group_id=44f044a65fa84a77b6d8ad594b808df3)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:51.763146 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e35f86-41cf-484a-a287-cd5b062ec9c8 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:51.765160 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 205/415] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Sep 19 14:41:51 2022] GET /identity/v3/groups/44f044a65fa84a77b6d8ad594b808df3 => generated 226 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:41:51.771146 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f2ec1a-904f-4ff0-b097-2b83058db553 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:51.872857 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:51.933985 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f2ec1a-904f-4ff0-b097-2b83058db553 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:51.981590 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29abd757-5076-444f-84e7-7124c09ccc33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:51.982189 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29abd757-5076-444f-84e7-7124c09ccc33 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:51.982466 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29abd757-5076-444f-84e7-7124c09ccc33 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:51.982742 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29abd757-5076-444f-84e7-7124c09ccc33 None admin] PATH_INFO: `/v3/projects/e5026d679036436ab5fab42a948bc2a7` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:51.983950 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29abd757-5076-444f-84e7-7124c09ccc33 None admin] RBAC: Authorizing `identity:get_project(project_id=e5026d679036436ab5fab42a948bc2a7)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:51.985509 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29abd757-5076-444f-84e7-7124c09ccc33 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:51.987523 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 211/416] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 19 14:41:51 2022] GET /identity/v3/projects/e5026d679036436ab5fab42a948bc2a7 => generated 302 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:51.995272 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e35f86-41cf-484a-a287-cd5b062ec9c8 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:52.018738 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29abd757-5076-444f-84e7-7124c09ccc33 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:52.148562 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29abd757-5076-444f-84e7-7124c09ccc33 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:52.182449 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e35f86-41cf-484a-a287-cd5b062ec9c8 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:52.188970 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2fd16d-b6cf-404b-8eaf-60b9c850a2b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:52.189719 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2fd16d-b6cf-404b-8eaf-60b9c850a2b2 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:52.189997 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2fd16d-b6cf-404b-8eaf-60b9c850a2b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:52.190265 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2fd16d-b6cf-404b-8eaf-60b9c850a2b2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:52.192802 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:52.203426 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2fd16d-b6cf-404b-8eaf-60b9c850a2b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:41:52.208780 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-cc2fd16d-b6cf-404b-8eaf-60b9c850a2b2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:41:52.208780 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:41:52.208780 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:41:52.208780 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:41:52.208780 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:41:52.208780 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:41:52.208780 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:41:52.208780 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:41:52.208780 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:41:52.208780 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:41:52.208780 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:41:52.208780 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:41:52.208780 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:41:52.208780 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:41:52.208780 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:41:52.208780 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:41:52.209807 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:41:52.209807 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:41:52.209807 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:41:52.209807 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:41:52.209807 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:41:52.209807 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:41:52.209807 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:41:52.209807 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:41:52.209807 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:41:52.209807 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:41:52.209807 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:41:52.209807 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:41:52.209807 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:41:52.209807 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:41:52.209807 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:41:52.209807 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:41:52.210575 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:41:52.210575 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:41:52.210575 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:41:52.210575 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:41:52.210575 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:41:52.210575 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:41:52.210575 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:41:52.210575 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:41:52.210575 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:41:52.210575 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:41:52.210575 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:41:52.210575 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:41:52.210575 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 212/417] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 19 14:41:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:41:52.211207 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08abef27-14da-4015-82e7-a5041ca2d909 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:52.211771 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08abef27-14da-4015-82e7-a5041ca2d909 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:52.211771 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08abef27-14da-4015-82e7-a5041ca2d909 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:52.213638 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 213/418] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:41:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:41:52.219276 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08abef27-14da-4015-82e7-a5041ca2d909 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:52.227507 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbe6714-cef9-4795-b098-2480e05da197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:52.228730 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe6714-cef9-4795-b098-2480e05da197 None admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:52.229040 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe6714-cef9-4795-b098-2480e05da197 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:52.229313 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe6714-cef9-4795-b098-2480e05da197 None admin] PATH_INFO: `/v3/projects/e5026d679036436ab5fab42a948bc2a7/groups/44f044a65fa84a77b6d8ad594b808df3/roles/ae7ed67e62684598a31185ab16c971ce` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:52.232093 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbe6714-cef9-4795-b098-2480e05da197 None admin] RBAC: Authorizing `identity:create_grant(project_id=e5026d679036436ab5fab42a948bc2a7, group_id=44f044a65fa84a77b6d8ad594b808df3, role_id=ae7ed67e62684598a31185ab16c971ce)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:52.234313 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbe6714-cef9-4795-b098-2480e05da197 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:52.254784 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 206/419] 10.222.0.26 () {58 vars in 1442 bytes} [Mon Sep 19 14:41:51 2022] PUT /identity/v3/projects/e5026d679036436ab5fab42a948bc2a7/groups/44f044a65fa84a77b6d8ad594b808df3/roles/ae7ed67e62684598a31185ab16c971ce => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:41:52.256066 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec9e672-3a6c-4fb4-a223-fb21c564c33c None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:52.256349 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec9e672-3a6c-4fb4-a223-fb21c564c33c None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:52.256622 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec9e672-3a6c-4fb4-a223-fb21c564c33c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:52.279574 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-5ec9e672-3a6c-4fb4-a223-fb21c564c33c None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:41:52.281580 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-5ec9e672-3a6c-4fb4-a223-fb21c564c33c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:41:52.384279 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08abef27-14da-4015-82e7-a5041ca2d909 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:52.421440 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:52.467417 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30914d9d-91e8-4d21-acec-f0e27e1e272e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:52.468446 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30914d9d-91e8-4d21-acec-f0e27e1e272e None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:52.468872 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30914d9d-91e8-4d21-acec-f0e27e1e272e None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:52.469176 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30914d9d-91e8-4d21-acec-f0e27e1e272e None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:52.471253 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30914d9d-91e8-4d21-acec-f0e27e1e272e None admin] RBAC: Adding query filter params (name=member) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:41:52.471976 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30914d9d-91e8-4d21-acec-f0e27e1e272e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:52.473441 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30914d9d-91e8-4d21-acec-f0e27e1e272e None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:52.476900 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 207/420] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:41:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:41:52.491895 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 214/421] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Sep 19 14:41:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:52.493606 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec9e672-3a6c-4fb4-a223-fb21c564c33c None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:52.623918 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec9e672-3a6c-4fb4-a223-fb21c564c33c None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:52.686890 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51d5c17-b699-4285-9ac6-f2f8919553ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:52.687631 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51d5c17-b699-4285-9ac6-f2f8919553ee None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:52.687974 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51d5c17-b699-4285-9ac6-f2f8919553ee None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:52.688251 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51d5c17-b699-4285-9ac6-f2f8919553ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:52.745947 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:52.777348 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51d5c17-b699-4285-9ac6-f2f8919553ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:52.778968 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51d5c17-b699-4285-9ac6-f2f8919553ee None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:52.841392 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30914d9d-91e8-4d21-acec-f0e27e1e272e None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:52.932959 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 208/422] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 19 14:41:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:52.934674 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51d5c17-b699-4285-9ac6-f2f8919553ee None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:52.983319 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:53.038007 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30914d9d-91e8-4d21-acec-f0e27e1e272e None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:53.040441 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:53.072434 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51d5c17-b699-4285-9ac6-f2f8919553ee None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:53.088759 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e822f3-3851-4ba3-ad8e-f5c7878e028f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:53.089521 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e822f3-3851-4ba3-ad8e-f5c7878e028f None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:53.089866 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e822f3-3851-4ba3-ad8e-f5c7878e028f None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:53.090203 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e822f3-3851-4ba3-ad8e-f5c7878e028f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:53.106185 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e822f3-3851-4ba3-ad8e-f5c7878e028f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:41:53.114151 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-d3e822f3-3851-4ba3-ad8e-f5c7878e028f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:41:53.114151 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:41:53.114151 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:41:53.114151 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:41:53.114151 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:41:53.114151 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:41:53.114151 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:41:53.114151 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:41:53.114151 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:41:53.114151 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:41:53.114151 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:41:53.114151 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:41:53.114151 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:41:53.114151 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:41:53.114151 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:41:53.114151 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:41:53.115185 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:41:53.115185 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:41:53.115185 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:41:53.115185 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:41:53.115185 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:41:53.115185 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:41:53.115185 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:41:53.115185 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:41:53.115185 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:41:53.115185 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:41:53.115185 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:41:53.115185 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:41:53.115185 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:41:53.115185 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:41:53.115185 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:41:53.115185 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:41:53.116152 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:41:53.116152 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:41:53.116152 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:41:53.116152 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:41:53.116152 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:41:53.116152 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:41:53.116152 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:41:53.116152 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:41:53.116152 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:41:53.116152 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:41:53.116152 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 14:41:53.116152 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:41:53.120622 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 215/423] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 19 14:41:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:41:53.122444 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c88d9ad-1d26-4f9f-87db-15e05bd7efcd None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:53.122739 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c88d9ad-1d26-4f9f-87db-15e05bd7efcd None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:53.123009 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c88d9ad-1d26-4f9f-87db-15e05bd7efcd None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:53.124536 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 216/424] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:41:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:41:53.125281 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecb5b5b-2434-4125-b48c-b69bdcbd56af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:53.125433 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c88d9ad-1d26-4f9f-87db-15e05bd7efcd None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:53.126561 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb5b5b-2434-4125-b48c-b69bdcbd56af None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:53.127049 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb5b5b-2434-4125-b48c-b69bdcbd56af None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:53.127506 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb5b5b-2434-4125-b48c-b69bdcbd56af None admin] PATH_INFO: `/v3/projects/ef8c601e5bc64c818990445d938bb592` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:53.130573 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecb5b5b-2434-4125-b48c-b69bdcbd56af None admin] RBAC: Authorizing `identity:get_project(project_id=ef8c601e5bc64c818990445d938bb592)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:53.132435 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecb5b5b-2434-4125-b48c-b69bdcbd56af None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:53.134737 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 209/425] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 19 14:41:52 2022] GET /identity/v3/projects/ef8c601e5bc64c818990445d938bb592 => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:41:53.137489 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468dff8-b1af-4a31-b782-ccf222259a3b None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:53.138196 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468dff8-b1af-4a31-b782-ccf222259a3b None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:53.139127 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468dff8-b1af-4a31-b782-ccf222259a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:53.160216 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-e468dff8-b1af-4a31-b782-ccf222259a3b None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:41:53.161799 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e468dff8-b1af-4a31-b782-ccf222259a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:41:53.241725 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 210/426] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:41:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:41:53.243175 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e468dff8-b1af-4a31-b782-ccf222259a3b None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:53.249168 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c88d9ad-1d26-4f9f-87db-15e05bd7efcd None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:53.267472 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:53.288070 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c2378d-4cab-49b6-a1a7-344d4e0655bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:53.288768 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c2378d-4cab-49b6-a1a7-344d4e0655bf None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:53.289147 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c2378d-4cab-49b6-a1a7-344d4e0655bf None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:53.289484 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c2378d-4cab-49b6-a1a7-344d4e0655bf None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:53.290308 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c2378d-4cab-49b6-a1a7-344d4e0655bf None admin] RBAC: Adding query filter params (name=member) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:41:53.290745 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c2378d-4cab-49b6-a1a7-344d4e0655bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:53.292183 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c2378d-4cab-49b6-a1a7-344d4e0655bf None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:53.302469 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 217/427] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Sep 19 14:41:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:53.308716 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c2378d-4cab-49b6-a1a7-344d4e0655bf None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:53.363108 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:53.392891 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e468dff8-b1af-4a31-b782-ccf222259a3b None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:53.451861 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1aa12f-bac3-4948-9616-cf17f60de9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:53.452516 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1aa12f-bac3-4948-9616-cf17f60de9a9 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:53.452862 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1aa12f-bac3-4948-9616-cf17f60de9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:53.453074 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1aa12f-bac3-4948-9616-cf17f60de9a9 None admin] PATH_INFO: `/v3/groups/44f044a65fa84a77b6d8ad594b808df3` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:53.457962 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1aa12f-bac3-4948-9616-cf17f60de9a9 None admin] RBAC: Authorizing `identity:get_group(group_id=44f044a65fa84a77b6d8ad594b808df3)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:53.459857 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1aa12f-bac3-4948-9616-cf17f60de9a9 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:53.463405 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 211/428] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Sep 19 14:41:53 2022] GET /identity/v3/groups/44f044a65fa84a77b6d8ad594b808df3 => generated 226 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:53.469943 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1aa12f-bac3-4948-9616-cf17f60de9a9 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:53.536059 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c2378d-4cab-49b6-a1a7-344d4e0655bf None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:53.597922 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fb0936-263c-446d-b5a8-e4f0d2f2a303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:53.598805 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb0936-263c-446d-b5a8-e4f0d2f2a303 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:53.599231 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb0936-263c-446d-b5a8-e4f0d2f2a303 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:53.599758 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb0936-263c-446d-b5a8-e4f0d2f2a303 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:53.654481 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:53.658559 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1aa12f-bac3-4948-9616-cf17f60de9a9 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:53.681484 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fb0936-263c-446d-b5a8-e4f0d2f2a303 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:53.683437 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fb0936-263c-446d-b5a8-e4f0d2f2a303 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:53.711543 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a328c6fe-2c7a-4cba-a3f4-8b668e2c08d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:53.712734 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a328c6fe-2c7a-4cba-a3f4-8b668e2c08d4 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:53.713219 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a328c6fe-2c7a-4cba-a3f4-8b668e2c08d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:53.713848 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a328c6fe-2c7a-4cba-a3f4-8b668e2c08d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:53.715824 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a328c6fe-2c7a-4cba-a3f4-8b668e2c08d4 None admin] RBAC: Adding query filter params (group.id=44f044a65fa84a77b6d8ad594b808df3, role.id=74de6794e3b3422b93d26f993d260c35, scope.project.id=ef8c601e5bc64c818990445d938bb592) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:41:53.716477 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a328c6fe-2c7a-4cba-a3f4-8b668e2c08d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:53.719514 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a328c6fe-2c7a-4cba-a3f4-8b668e2c08d4 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:53.728590 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 212/429] 10.222.0.26 () {56 vars in 1376 bytes} [Mon Sep 19 14:41:53 2022] GET /identity/v3/role_assignments?group.id=44f044a65fa84a77b6d8ad594b808df3&scope.project.id=ef8c601e5bc64c818990445d938bb592&role.id=74de6794e3b3422b93d26f993d260c35 => generated 611 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:41:53.729948 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a328c6fe-2c7a-4cba-a3f4-8b668e2c08d4 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:53.741765 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:53.887482 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 218/430] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 19 14:41:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 579 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 19 14:41:53.894394 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fb0936-263c-446d-b5a8-e4f0d2f2a303 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:53.921668 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a328c6fe-2c7a-4cba-a3f4-8b668e2c08d4 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:54.003354 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:54.015892 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617d4372-51c8-4dbc-8a18-66a8dbb21086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:54.016949 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617d4372-51c8-4dbc-8a18-66a8dbb21086 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:54.017495 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617d4372-51c8-4dbc-8a18-66a8dbb21086 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:54.018013 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617d4372-51c8-4dbc-8a18-66a8dbb21086 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:54.031444 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fb0936-263c-446d-b5a8-e4f0d2f2a303 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:54.036126 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617d4372-51c8-4dbc-8a18-66a8dbb21086 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:41:54.043018 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-617d4372-51c8-4dbc-8a18-66a8dbb21086 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 14:41:54.043018 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:41:54.043018 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:41:54.043018 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:41:54.043018 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:41:54.043018 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:41:54.043018 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:41:54.043018 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:41:54.043018 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:41:54.043018 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:41:54.043018 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:41:54.043018 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:41:54.043018 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:41:54.043018 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:41:54.043018 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:41:54.043018 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:41:54.044399 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:41:54.044399 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:41:54.044399 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:41:54.044399 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:41:54.044399 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:41:54.044399 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:41:54.044399 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:41:54.044399 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:41:54.044399 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:41:54.044399 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:41:54.044399 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:41:54.044399 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:41:54.044399 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:41:54.044399 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:41:54.044399 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:41:54.044399 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:41:54.045352 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:41:54.045352 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:41:54.045352 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:41:54.045352 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:41:54.045352 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:41:54.045352 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:41:54.045352 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:41:54.045352 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:41:54.045352 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:41:54.045352 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:41:54.045352 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 14:41:54.045352 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:41:54.047727 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 213/431] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Sep 19 14:41:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:41:54.053661 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617d4372-51c8-4dbc-8a18-66a8dbb21086 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:54.069020 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d2ca2-80b8-4298-a6c8-a57887d05f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:54.069671 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d2ca2-80b8-4298-a6c8-a57887d05f0f None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:54.069946 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d2ca2-80b8-4298-a6c8-a57887d05f0f None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:54.070212 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d2ca2-80b8-4298-a6c8-a57887d05f0f None admin] PATH_INFO: `/v3/projects/e5026d679036436ab5fab42a948bc2a7` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:54.072319 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029d2ca2-80b8-4298-a6c8-a57887d05f0f None admin] RBAC: Authorizing `identity:get_project(project_id=e5026d679036436ab5fab42a948bc2a7)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:54.075179 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029d2ca2-80b8-4298-a6c8-a57887d05f0f None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:54.077662 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 219/432] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 19 14:41:53 2022] GET /identity/v3/projects/e5026d679036436ab5fab42a948bc2a7 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:41:54.083658 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d2ca2-80b8-4298-a6c8-a57887d05f0f None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:54.150218 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:54.205056 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617d4372-51c8-4dbc-8a18-66a8dbb21086 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:54.218857 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d2ca2-80b8-4298-a6c8-a57887d05f0f None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:54.254876 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97caa2a4-3637-4e67-b92c-bc6248c2271d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:54.255483 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97caa2a4-3637-4e67-b92c-bc6248c2271d None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:54.255757 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97caa2a4-3637-4e67-b92c-bc6248c2271d None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:54.256020 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97caa2a4-3637-4e67-b92c-bc6248c2271d None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:54.256682 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97caa2a4-3637-4e67-b92c-bc6248c2271d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:41:54.257198 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97caa2a4-3637-4e67-b92c-bc6248c2271d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:54.259101 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97caa2a4-3637-4e67-b92c-bc6248c2271d None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:54.269309 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d24eca-216b-4735-88e8-3cf79f7c58af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:54.269950 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d24eca-216b-4735-88e8-3cf79f7c58af None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:54.270065 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 214/433] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 19 14:41:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:54.270288 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d24eca-216b-4735-88e8-3cf79f7c58af None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:54.270487 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d24eca-216b-4735-88e8-3cf79f7c58af None admin] PATH_INFO: `/v3/groups/44f044a65fa84a77b6d8ad594b808df3` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:54.271761 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d24eca-216b-4735-88e8-3cf79f7c58af None admin] RBAC: Authorizing `identity:get_group(group_id=44f044a65fa84a77b6d8ad594b808df3)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:54.271889 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cf57f8-c5a7-433e-8b66-3cfd95195aed None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:54.272082 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cf57f8-c5a7-433e-8b66-3cfd95195aed None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:54.272354 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cf57f8-c5a7-433e-8b66-3cfd95195aed None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:54.273310 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d24eca-216b-4735-88e8-3cf79f7c58af None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:54.273945 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 215/434] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:41:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:41:54.275354 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 220/435] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Sep 19 14:41:54 2022] GET /identity/v3/groups/44f044a65fa84a77b6d8ad594b808df3 => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:41:54.275918 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cf57f8-c5a7-433e-8b66-3cfd95195aed None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:54.280448 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a5cbf-a729-4c01-81c3-4bd0d138e323 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:54.280721 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a5cbf-a729-4c01-81c3-4bd0d138e323 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:54.281021 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a5cbf-a729-4c01-81c3-4bd0d138e323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:54.303720 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-d15a5cbf-a729-4c01-81c3-4bd0d138e323 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:41:54.304970 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-d15a5cbf-a729-4c01-81c3-4bd0d138e323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:41:54.319014 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:54.425138 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 221/436] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:41:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:41:54.425138 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15a5cbf-a729-4c01-81c3-4bd0d138e323 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:54.430284 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cf57f8-c5a7-433e-8b66-3cfd95195aed None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:54.476807 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:54.487143 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6784761-7fac-42d5-a433-2cdd9870b413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:54.488174 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6784761-7fac-42d5-a433-2cdd9870b413 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:54.488589 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6784761-7fac-42d5-a433-2cdd9870b413 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:54.489014 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6784761-7fac-42d5-a433-2cdd9870b413 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:54.560128 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15a5cbf-a729-4c01-81c3-4bd0d138e323 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:54.590763 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6784761-7fac-42d5-a433-2cdd9870b413 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:54.592330 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6784761-7fac-42d5-a433-2cdd9870b413 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:54.609722 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0419bd0c-d3d1-474f-a2b8-b201bf65b30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:54.610344 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0419bd0c-d3d1-474f-a2b8-b201bf65b30f None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:54.610620 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0419bd0c-d3d1-474f-a2b8-b201bf65b30f None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:54.610887 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0419bd0c-d3d1-474f-a2b8-b201bf65b30f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:54.611624 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0419bd0c-d3d1-474f-a2b8-b201bf65b30f None admin] RBAC: Adding query filter params (group.id=44f044a65fa84a77b6d8ad594b808df3, role.id=74de6794e3b3422b93d26f993d260c35, scope.project.id=e5026d679036436ab5fab42a948bc2a7) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:41:54.611924 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0419bd0c-d3d1-474f-a2b8-b201bf65b30f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:54.614070 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0419bd0c-d3d1-474f-a2b8-b201bf65b30f None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:54.622526 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 222/437] 10.222.0.26 () {56 vars in 1376 bytes} [Mon Sep 19 14:41:54 2022] GET /identity/v3/role_assignments?group.id=44f044a65fa84a77b6d8ad594b808df3&scope.project.id=e5026d679036436ab5fab42a948bc2a7&role.id=74de6794e3b3422b93d26f993d260c35 => generated 611 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:54.720958 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 216/438] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 19 14:41:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:54.727010 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0419bd0c-d3d1-474f-a2b8-b201bf65b30f None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:54.739557 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:54.776049 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6784761-7fac-42d5-a433-2cdd9870b413 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:54.809412 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:54.869018 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0419bd0c-d3d1-474f-a2b8-b201bf65b30f None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:54.904345 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6784761-7fac-42d5-a433-2cdd9870b413 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:54.924863 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c72a9cd-a9a3-422f-836a-1723f0d9e9d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:54.925537 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c72a9cd-a9a3-422f-836a-1723f0d9e9d6 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:54.926373 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c72a9cd-a9a3-422f-836a-1723f0d9e9d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:54.926373 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c72a9cd-a9a3-422f-836a-1723f0d9e9d6 None admin] PATH_INFO: `/v3/projects/ef8c601e5bc64c818990445d938bb592` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:54.930753 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c72a9cd-a9a3-422f-836a-1723f0d9e9d6 None admin] RBAC: Authorizing `identity:get_project(project_id=ef8c601e5bc64c818990445d938bb592)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:54.930753 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c72a9cd-a9a3-422f-836a-1723f0d9e9d6 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:54.933521 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 223/439] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 19 14:41:54 2022] GET /identity/v3/projects/ef8c601e5bc64c818990445d938bb592 => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:54.937840 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c72a9cd-a9a3-422f-836a-1723f0d9e9d6 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:54.945434 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be7cd99-31ac-4976-b516-e9f2306c53a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:54.946062 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be7cd99-31ac-4976-b516-e9f2306c53a7 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:54.946353 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be7cd99-31ac-4976-b516-e9f2306c53a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:54.946687 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be7cd99-31ac-4976-b516-e9f2306c53a7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:54.958777 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be7cd99-31ac-4976-b516-e9f2306c53a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:41:54.964289 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-0be7cd99-31ac-4976-b516-e9f2306c53a7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:41:54.964289 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:41:54.964289 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:41:54.964289 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:41:54.964289 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:41:54.964289 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:41:54.964289 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:41:54.964289 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:41:54.964289 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:41:54.964289 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:41:54.964289 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:41:54.964289 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:41:54.964289 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:41:54.964289 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:41:54.964289 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:41:54.964289 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:41:54.965636 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:41:54.965636 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:41:54.965636 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:41:54.965636 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:41:54.965636 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:41:54.965636 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:41:54.965636 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:41:54.965636 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:41:54.965636 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:41:54.965636 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:41:54.965636 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:41:54.965636 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:41:54.965636 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:41:54.965636 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:41:54.965636 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:41:54.965636 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:41:54.966689 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:41:54.966689 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:41:54.966689 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:41:54.966689 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:41:54.966689 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:41:54.966689 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:41:54.966689 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:41:54.966689 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:41:54.966689 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:41:54.966689 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:41:54.966689 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:41:54.966689 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:41:54.966689 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 217/440] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 19 14:41:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:41:54.972834 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be7cd99-31ac-4976-b516-e9f2306c53a7 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:55.043179 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:55.068931 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c72a9cd-a9a3-422f-836a-1723f0d9e9d6 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:55.081779 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:55.097553 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be7cd99-31ac-4976-b516-e9f2306c53a7 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:55.111055 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb43ae6-d08b-414e-8fcf-9e7a889249f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:55.111729 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb43ae6-d08b-414e-8fcf-9e7a889249f5 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:55.112000 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb43ae6-d08b-414e-8fcf-9e7a889249f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:55.112262 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb43ae6-d08b-414e-8fcf-9e7a889249f5 None admin] PATH_INFO: `/v3/groups/44f044a65fa84a77b6d8ad594b808df3` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:55.113412 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb43ae6-d08b-414e-8fcf-9e7a889249f5 None admin] RBAC: Authorizing `identity:get_group(group_id=44f044a65fa84a77b6d8ad594b808df3)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:55.114851 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb43ae6-d08b-414e-8fcf-9e7a889249f5 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:55.116415 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 224/441] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Sep 19 14:41:54 2022] GET /identity/v3/groups/44f044a65fa84a77b6d8ad594b808df3 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:41:55.117543 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0414df0b-7a68-4b2a-9b4d-96e14d6fa2b0 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:55.117820 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0414df0b-7a68-4b2a-9b4d-96e14d6fa2b0 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:55.118084 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0414df0b-7a68-4b2a-9b4d-96e14d6fa2b0 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:55.119310 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 225/442] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:41:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:41:55.122521 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0414df0b-7a68-4b2a-9b4d-96e14d6fa2b0 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:55.134550 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6915a07a-5477-41e4-a64e-249ff3830354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:55.135142 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915a07a-5477-41e4-a64e-249ff3830354 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:55.135416 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915a07a-5477-41e4-a64e-249ff3830354 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:55.135680 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915a07a-5477-41e4-a64e-249ff3830354 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:55.136337 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6915a07a-5477-41e4-a64e-249ff3830354 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:41:55.136634 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6915a07a-5477-41e4-a64e-249ff3830354 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:55.138495 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6915a07a-5477-41e4-a64e-249ff3830354 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:55.147080 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 218/443] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 19 14:41:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:41:55.148283 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b03685a-539d-4252-b19d-2d4ee734293d None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:55.148580 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b03685a-539d-4252-b19d-2d4ee734293d None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:55.148850 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b03685a-539d-4252-b19d-2d4ee734293d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:55.169438 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-5b03685a-539d-4252-b19d-2d4ee734293d None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:41:55.170869 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-5b03685a-539d-4252-b19d-2d4ee734293d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:41:55.234964 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0414df0b-7a68-4b2a-9b4d-96e14d6fa2b0 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:55.239531 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 219/444] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:41:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:41:55.240361 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b03685a-539d-4252-b19d-2d4ee734293d None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:55.270774 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f4b24f-2dfa-4566-b483-ab02a166c902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:55.271380 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f4b24f-2dfa-4566-b483-ab02a166c902 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:55.271657 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f4b24f-2dfa-4566-b483-ab02a166c902 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:55.271927 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f4b24f-2dfa-4566-b483-ab02a166c902 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:55.272655 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f4b24f-2dfa-4566-b483-ab02a166c902 None admin] RBAC: Adding query filter params (group.id=44f044a65fa84a77b6d8ad594b808df3, role.id=ae7ed67e62684598a31185ab16c971ce, scope.project.id=ef8c601e5bc64c818990445d938bb592) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:41:55.272963 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f4b24f-2dfa-4566-b483-ab02a166c902 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:55.274426 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f4b24f-2dfa-4566-b483-ab02a166c902 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:55.281269 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 226/445] 10.222.0.26 () {56 vars in 1376 bytes} [Mon Sep 19 14:41:55 2022] GET /identity/v3/role_assignments?group.id=44f044a65fa84a77b6d8ad594b808df3&scope.project.id=ef8c601e5bc64c818990445d938bb592&role.id=ae7ed67e62684598a31185ab16c971ce => generated 611 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:55.355221 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:55.379426 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b03685a-539d-4252-b19d-2d4ee734293d None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:55.421092 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13ada3c-4425-47c3-a31f-3ad5f9bb0a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:55.421714 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ada3c-4425-47c3-a31f-3ad5f9bb0a43 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:55.421993 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ada3c-4425-47c3-a31f-3ad5f9bb0a43 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:55.422331 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ada3c-4425-47c3-a31f-3ad5f9bb0a43 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:55.510467 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13ada3c-4425-47c3-a31f-3ad5f9bb0a43 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:55.511857 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13ada3c-4425-47c3-a31f-3ad5f9bb0a43 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:55.526170 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f4b24f-2dfa-4566-b483-ab02a166c902 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:55.538444 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:55.603496 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:55.628427 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 220/446] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 19 14:41:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:41:55.634026 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13ada3c-4425-47c3-a31f-3ad5f9bb0a43 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:55.666275 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f4b24f-2dfa-4566-b483-ab02a166c902 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:55.705311 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e9fd99-54a6-4345-b1d0-4495bce22726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:55.706305 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e9fd99-54a6-4345-b1d0-4495bce22726 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:55.706828 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e9fd99-54a6-4345-b1d0-4495bce22726 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:55.707095 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e9fd99-54a6-4345-b1d0-4495bce22726 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:55.720484 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e9fd99-54a6-4345-b1d0-4495bce22726 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:41:55.725873 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-03e9fd99-54a6-4345-b1d0-4495bce22726 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 14:41:55.725873 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:41:55.725873 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:41:55.725873 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:41:55.725873 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:41:55.725873 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:41:55.725873 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:41:55.725873 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:41:55.725873 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:41:55.725873 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:41:55.725873 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:41:55.725873 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:41:55.725873 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:41:55.725873 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:41:55.725873 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:41:55.725873 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:41:55.726755 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:41:55.726755 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:41:55.726755 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:41:55.726755 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:41:55.726755 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:41:55.726755 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:41:55.726755 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:41:55.726755 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:41:55.726755 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:41:55.726755 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:41:55.726755 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:41:55.726755 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:41:55.726755 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:41:55.726755 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:41:55.726755 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:41:55.726755 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:41:55.727552 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:41:55.727552 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:41:55.727552 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:41:55.727552 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:41:55.727552 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:41:55.727552 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:41:55.727552 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:41:55.727552 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:41:55.727552 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:41:55.727552 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:41:55.727552 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 14:41:55.727552 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:41:55.728759 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 227/447] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Sep 19 14:41:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:41:55.735438 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e9fd99-54a6-4345-b1d0-4495bce22726 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:55.764662 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13ada3c-4425-47c3-a31f-3ad5f9bb0a43 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:55.804322 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77518d9-7bf4-4520-bff3-bedb302e0bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:55.804958 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77518d9-7bf4-4520-bff3-bedb302e0bc8 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:55.805270 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77518d9-7bf4-4520-bff3-bedb302e0bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:55.805558 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77518d9-7bf4-4520-bff3-bedb302e0bc8 None admin] PATH_INFO: `/v3/projects/d638629494b04280b2ba0fc11da818cf` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:55.807195 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77518d9-7bf4-4520-bff3-bedb302e0bc8 None admin] RBAC: Authorizing `identity:get_project(project_id=d638629494b04280b2ba0fc11da818cf)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:55.808690 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77518d9-7bf4-4520-bff3-bedb302e0bc8 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:55.811065 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 221/448] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 19 14:41:55 2022] GET /identity/v3/projects/d638629494b04280b2ba0fc11da818cf => generated 344 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:55.816871 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77518d9-7bf4-4520-bff3-bedb302e0bc8 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:55.826442 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:55.865025 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e9fd99-54a6-4345-b1d0-4495bce22726 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:55.874255 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:55.900472 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ffc4db-0f51-415f-bb62-e6806a000771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:55.901132 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ffc4db-0f51-415f-bb62-e6806a000771 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:55.901409 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ffc4db-0f51-415f-bb62-e6806a000771 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:55.901680 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ffc4db-0f51-415f-bb62-e6806a000771 None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:55.902345 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ffc4db-0f51-415f-bb62-e6806a000771 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:41:55.902653 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ffc4db-0f51-415f-bb62-e6806a000771 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:55.904188 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ffc4db-0f51-415f-bb62-e6806a000771 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:55.912211 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 228/449] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 19 14:41:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:41:55.917964 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ffc4db-0f51-415f-bb62-e6806a000771 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:55.925277 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77518d9-7bf4-4520-bff3-bedb302e0bc8 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:55.960289 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b79b4-3e44-468b-bb62-4cee7d57c275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:55.960949 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b79b4-3e44-468b-bb62-4cee7d57c275 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:55.961206 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b79b4-3e44-468b-bb62-4cee7d57c275 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:55.961472 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b79b4-3e44-468b-bb62-4cee7d57c275 None admin] PATH_INFO: `/v3/groups/7357d3b663b14418ada834c01a432376` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:55.962583 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2b79b4-3e44-468b-bb62-4cee7d57c275 None admin] RBAC: Authorizing `identity:get_group(group_id=7357d3b663b14418ada834c01a432376)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:55.964024 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2b79b4-3e44-468b-bb62-4cee7d57c275 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:55.969141 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 222/450] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Sep 19 14:41:55 2022] GET /identity/v3/groups/7357d3b663b14418ada834c01a432376 => generated 229 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:41:55.972000 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b79b4-3e44-468b-bb62-4cee7d57c275 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:56.026833 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ffc4db-0f51-415f-bb62-e6806a000771 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:56.057486 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:56.063960 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dfdf27-53dc-4b64-af50-8255f40d4b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:56.064584 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dfdf27-53dc-4b64-af50-8255f40d4b22 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:56.064862 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dfdf27-53dc-4b64-af50-8255f40d4b22 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:56.065168 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dfdf27-53dc-4b64-af50-8255f40d4b22 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:56.070616 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b79b4-3e44-468b-bb62-4cee7d57c275 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:56.087635 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:56.105056 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a038621-1d26-4c59-8b8d-3ef5107f97ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:56.105654 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a038621-1d26-4c59-8b8d-3ef5107f97ee None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:56.106101 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a038621-1d26-4c59-8b8d-3ef5107f97ee None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:56.106415 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a038621-1d26-4c59-8b8d-3ef5107f97ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:56.107246 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a038621-1d26-4c59-8b8d-3ef5107f97ee None admin] RBAC: Adding query filter params (group.id=7357d3b663b14418ada834c01a432376, role.id=019bde1756cb40de8ce06cef6b261f79, scope.project.id=d638629494b04280b2ba0fc11da818cf) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:41:56.107569 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a038621-1d26-4c59-8b8d-3ef5107f97ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:56.109060 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a038621-1d26-4c59-8b8d-3ef5107f97ee None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:56.115057 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 223/451] 10.222.0.26 () {56 vars in 1376 bytes} [Mon Sep 19 14:41:55 2022] GET /identity/v3/role_assignments?group.id=7357d3b663b14418ada834c01a432376&scope.project.id=d638629494b04280b2ba0fc11da818cf&role.id=019bde1756cb40de8ce06cef6b261f79 => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:56.135768 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dfdf27-53dc-4b64-af50-8255f40d4b22 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:56.137376 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dfdf27-53dc-4b64-af50-8255f40d4b22 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:56.257709 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 229/452] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 19 14:41:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 19 14:41:56.263956 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a038621-1d26-4c59-8b8d-3ef5107f97ee None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:56.370744 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a038621-1d26-4c59-8b8d-3ef5107f97ee None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:56.408415 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03912ce-b953-4da3-a08e-c56cf54559a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:56.409041 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03912ce-b953-4da3-a08e-c56cf54559a0 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:56.409350 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03912ce-b953-4da3-a08e-c56cf54559a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:56.409622 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03912ce-b953-4da3-a08e-c56cf54559a0 None admin] PATH_INFO: `/v3/projects/e5026d679036436ab5fab42a948bc2a7` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:56.410875 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03912ce-b953-4da3-a08e-c56cf54559a0 None admin] RBAC: Authorizing `identity:get_project(project_id=e5026d679036436ab5fab42a948bc2a7)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:56.412355 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03912ce-b953-4da3-a08e-c56cf54559a0 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:56.414062 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 224/453] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 19 14:41:56 2022] GET /identity/v3/projects/e5026d679036436ab5fab42a948bc2a7 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:56.420839 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dfdf27-53dc-4b64-af50-8255f40d4b22 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:56.457791 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:56.542842 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dfdf27-53dc-4b64-af50-8255f40d4b22 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:56.582313 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a46c60-998f-48e2-9526-fb62ed508556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:56.582969 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a46c60-998f-48e2-9526-fb62ed508556 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:56.583244 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a46c60-998f-48e2-9526-fb62ed508556 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:56.583506 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a46c60-998f-48e2-9526-fb62ed508556 None admin] PATH_INFO: `/v3/groups/44f044a65fa84a77b6d8ad594b808df3` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:56.584709 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a46c60-998f-48e2-9526-fb62ed508556 None admin] RBAC: Authorizing `identity:get_group(group_id=44f044a65fa84a77b6d8ad594b808df3)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:56.586307 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a46c60-998f-48e2-9526-fb62ed508556 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:56.587873 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 230/454] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Sep 19 14:41:56 2022] GET /identity/v3/groups/44f044a65fa84a77b6d8ad594b808df3 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:56.595123 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03912ce-b953-4da3-a08e-c56cf54559a0 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:41:56.658227 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:41:56.722631 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03912ce-b953-4da3-a08e-c56cf54559a0 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:41:56.760230 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d8b758-aeff-4ae2-8409-43cd23f1f6de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:41:56.760818 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d8b758-aeff-4ae2-8409-43cd23f1f6de None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:56.761123 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d8b758-aeff-4ae2-8409-43cd23f1f6de None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:56.761392 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d8b758-aeff-4ae2-8409-43cd23f1f6de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:56.762123 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d8b758-aeff-4ae2-8409-43cd23f1f6de None admin] RBAC: Adding query filter params (group.id=44f044a65fa84a77b6d8ad594b808df3, role.id=ae7ed67e62684598a31185ab16c971ce, scope.project.id=e5026d679036436ab5fab42a948bc2a7) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:41:56.762548 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d8b758-aeff-4ae2-8409-43cd23f1f6de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:41:56.763975 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d8b758-aeff-4ae2-8409-43cd23f1f6de None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:41:56.769883 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 225/455] 10.222.0.26 () {56 vars in 1376 bytes} [Mon Sep 19 14:41:56 2022] GET /identity/v3/role_assignments?group.id=44f044a65fa84a77b6d8ad594b808df3&scope.project.id=e5026d679036436ab5fab42a948bc2a7&role.id=ae7ed67e62684598a31185ab16c971ce => generated 611 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:41:59.497827 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed710e81-e33c-4cce-b401-d6e61a7aefcc None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:59.499659 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed710e81-e33c-4cce-b401-d6e61a7aefcc None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:59.500133 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed710e81-e33c-4cce-b401-d6e61a7aefcc None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:59.501776 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 231/456] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:41:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:41:59.510515 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca781d79-c960-45fc-947a-395258cc22ae None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:59.510515 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca781d79-c960-45fc-947a-395258cc22ae None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:59.510515 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca781d79-c960-45fc-947a-395258cc22ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:59.538084 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-ca781d79-c960-45fc-947a-395258cc22ae None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:41:59.539653 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ca781d79-c960-45fc-947a-395258cc22ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:41:59.614801 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 226/457] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:41:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:41:59.962657 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed18646-f750-4843-941d-e594382d893a None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:59.963036 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed18646-f750-4843-941d-e594382d893a None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:59.963235 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed18646-f750-4843-941d-e594382d893a None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:59.964783 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 232/458] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:41:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:41:59.973491 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a9e739-be2d-4028-b589-1fc000316ed6 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:41:59.973771 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a9e739-be2d-4028-b589-1fc000316ed6 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:41:59.974041 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a9e739-be2d-4028-b589-1fc000316ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:41:59.992399 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-c9a9e739-be2d-4028-b589-1fc000316ed6 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:41:59.993597 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-c9a9e739-be2d-4028-b589-1fc000316ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:42:00.022914 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed18646-f750-4843-941d-e594382d893a None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:00.054588 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:00.099130 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 227/459] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:41:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:42:00.101514 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc1bce3-fb09-4eec-a21d-47123351bab2 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:00.101967 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc1bce3-fb09-4eec-a21d-47123351bab2 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:00.102409 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc1bce3-fb09-4eec-a21d-47123351bab2 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:00.103848 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 228/460] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:42:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:42:00.122987 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b81a65-205d-4542-a098-302605e6fd0d None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:00.123558 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b81a65-205d-4542-a098-302605e6fd0d None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:00.123999 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b81a65-205d-4542-a098-302605e6fd0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:00.158118 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-41b81a65-205d-4542-a098-302605e6fd0d None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:42:00.162680 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-41b81a65-205d-4542-a098-302605e6fd0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:42:00.191501 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:00.202727 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed18646-f750-4843-941d-e594382d893a None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:00.276003 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2132fe4d-20d1-430e-8ac2-f3246aaf852f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:00.276617 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2132fe4d-20d1-430e-8ac2-f3246aaf852f None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:00.276892 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2132fe4d-20d1-430e-8ac2-f3246aaf852f None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:00.277179 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2132fe4d-20d1-430e-8ac2-f3246aaf852f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:00.298240 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2132fe4d-20d1-430e-8ac2-f3246aaf852f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:00.301921 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2132fe4d-20d1-430e-8ac2-f3246aaf852f None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:00.315171 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 229/461] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:42:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 14:42:00.327219 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-2132fe4d-20d1-430e-8ac2-f3246aaf852f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:00.327219 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:00.327219 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:00.327219 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:00.327219 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:00.327219 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:00.327219 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:00.327219 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:00.327219 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:00.327219 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:00.327219 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:00.327219 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:00.327219 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:42:00.327219 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:42:00.327219 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:42:00.327219 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:42:00.328120 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:00.328120 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:00.328120 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:00.328120 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:00.328120 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:00.328120 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:00.328120 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:00.328120 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:00.328120 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:00.328120 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:00.328120 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:00.328120 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:00.328120 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:00.328120 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:00.328120 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:00.328120 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:00.328120 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:42:00.328943 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:42:00.328943 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:00.328943 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:00.328943 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 233/462] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:42:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:00.334353 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b81a65-205d-4542-a098-302605e6fd0d None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:00.415612 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a45320-f0fb-424b-917e-feebea629683 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:00.416301 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a45320-f0fb-424b-917e-feebea629683 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:00.416793 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a45320-f0fb-424b-917e-feebea629683 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:00.418882 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 234/463] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:42:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 14:42:00.424347 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf168c5-2720-4fc4-8921-2ab227da2e94 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:00.424863 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf168c5-2720-4fc4-8921-2ab227da2e94 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:00.425376 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf168c5-2720-4fc4-8921-2ab227da2e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:00.445080 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-3bf168c5-2720-4fc4-8921-2ab227da2e94 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:42:00.446582 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-3bf168c5-2720-4fc4-8921-2ab227da2e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:42:00.466149 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b81a65-205d-4542-a098-302605e6fd0d None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:00.477125 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:00.515997 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e6ad3f-d626-4743-aae3-cbd2aa00a89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:00.517450 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e6ad3f-d626-4743-aae3-cbd2aa00a89a None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:00.517925 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e6ad3f-d626-4743-aae3-cbd2aa00a89a None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:00.518408 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e6ad3f-d626-4743-aae3-cbd2aa00a89a None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:00.519284 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e6ad3f-d626-4743-aae3-cbd2aa00a89a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:00.519776 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e6ad3f-d626-4743-aae3-cbd2aa00a89a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:00.521386 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e6ad3f-d626-4743-aae3-cbd2aa00a89a None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:00.533104 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 235/464] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:42:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:42:00.533104 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf168c5-2720-4fc4-8921-2ab227da2e94 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:00.542277 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 230/465] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 19 14:42:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:00.548147 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e6ad3f-d626-4743-aae3-cbd2aa00a89a None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:00.623531 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:00.647944 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf168c5-2720-4fc4-8921-2ab227da2e94 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:00.682238 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e6ad3f-d626-4743-aae3-cbd2aa00a89a None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:00.695954 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063d12b0-7669-4d0c-bd93-fa0bd6509f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:00.697212 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063d12b0-7669-4d0c-bd93-fa0bd6509f56 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:00.697913 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063d12b0-7669-4d0c-bd93-fa0bd6509f56 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:00.698387 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063d12b0-7669-4d0c-bd93-fa0bd6509f56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:00.711429 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063d12b0-7669-4d0c-bd93-fa0bd6509f56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:00.713556 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063d12b0-7669-4d0c-bd93-fa0bd6509f56 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:00.718525 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e27ab16-84a5-4551-833c-9dbb01d762de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:00.719316 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e27ab16-84a5-4551-833c-9dbb01d762de None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:00.719764 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e27ab16-84a5-4551-833c-9dbb01d762de None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:00.720174 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e27ab16-84a5-4551-833c-9dbb01d762de None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:00.720963 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e27ab16-84a5-4551-833c-9dbb01d762de None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:00.722578 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e27ab16-84a5-4551-833c-9dbb01d762de None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:00.729383 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-063d12b0-7669-4d0c-bd93-fa0bd6509f56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:00.729383 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:00.729383 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:00.729383 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:00.729383 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:00.729383 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:00.729383 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:00.729383 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:00.729383 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:00.729383 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:00.729383 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:00.729383 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:00.729383 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:42:00.729383 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:42:00.729383 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:42:00.729383 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:42:00.730467 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:00.730467 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:00.730467 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:00.730467 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:00.730467 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:00.730467 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:00.730467 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:00.730467 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:00.730467 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:00.730467 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:00.730467 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:00.730467 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:00.730467 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:00.730467 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:00.730467 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:00.730467 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:00.730467 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:42:00.731587 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:42:00.731587 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:00.731587 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:00.731747 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 236/466] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:42:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:00.733313 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063d12b0-7669-4d0c-bd93-fa0bd6509f56 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:00.749664 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 231/467] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Sep 19 14:42:00 2022] POST /identity/v3/users => generated 246 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 14:42:00.750827 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e27ab16-84a5-4551-833c-9dbb01d762de None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:00.775862 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:00.879485 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063d12b0-7669-4d0c-bd93-fa0bd6509f56 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:00.900157 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e27ab16-84a5-4551-833c-9dbb01d762de None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:00.915481 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:00.923805 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0521e7-6bd3-49f6-90c2-da32e5fc820e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:00.924861 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0521e7-6bd3-49f6-90c2-da32e5fc820e None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:00.925365 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0521e7-6bd3-49f6-90c2-da32e5fc820e None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:00.925838 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0521e7-6bd3-49f6-90c2-da32e5fc820e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:00.938518 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0521e7-6bd3-49f6-90c2-da32e5fc820e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:00.940634 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0521e7-6bd3-49f6-90c2-da32e5fc820e None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:00.940897 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c1c56-77e3-4ba4-910b-7ca3cd54dcb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:00.941623 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c1c56-77e3-4ba4-910b-7ca3cd54dcb9 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:00.941923 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c1c56-77e3-4ba4-910b-7ca3cd54dcb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:00.942185 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c1c56-77e3-4ba4-910b-7ca3cd54dcb9 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:00.942929 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63c1c56-77e3-4ba4-910b-7ca3cd54dcb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:00.943235 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63c1c56-77e3-4ba4-910b-7ca3cd54dcb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:00.944821 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63c1c56-77e3-4ba4-910b-7ca3cd54dcb9 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:00.958252 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-3a0521e7-6bd3-49f6-90c2-da32e5fc820e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:00.958252 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:00.958252 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:00.958252 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:00.958252 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:00.958252 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:00.958252 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:00.958252 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:00.958252 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:00.958252 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:00.958252 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:00.958252 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:00.958252 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:42:00.958252 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:42:00.958252 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:42:00.958252 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:42:00.959230 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:00.959230 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:00.959230 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:00.959230 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:00.959230 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:00.959230 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:00.959230 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:00.959230 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:00.959230 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:00.959230 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:00.959230 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:00.959230 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:00.959230 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:00.959230 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:00.959230 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:00.959230 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:00.959230 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:42:00.960109 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:42:00.960109 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:00.960109 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:00.961979 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 237/469] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:42:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:00.962105 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 232/469] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 19 14:42:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:00.962989 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c1c56-77e3-4ba4-910b-7ca3cd54dcb9 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:00.971264 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0521e7-6bd3-49f6-90c2-da32e5fc820e None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:01.079517 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:01.095884 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0521e7-6bd3-49f6-90c2-da32e5fc820e None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:01.105116 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c1c56-77e3-4ba4-910b-7ca3cd54dcb9 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:01.137225 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc40f5bd-530b-46d0-af75-2550034c0c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:01.138091 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc40f5bd-530b-46d0-af75-2550034c0c8f None admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:01.138518 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc40f5bd-530b-46d0-af75-2550034c0c8f None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:01.138923 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc40f5bd-530b-46d0-af75-2550034c0c8f None admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:01.139695 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc40f5bd-530b-46d0-af75-2550034c0c8f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:01.141276 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc40f5bd-530b-46d0-af75-2550034c0c8f None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:01.141707 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6de6c1-6032-48ac-8264-776c164f20f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:01.142339 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6de6c1-6032-48ac-8264-776c164f20f6 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:01.142614 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6de6c1-6032-48ac-8264-776c164f20f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:01.142881 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6de6c1-6032-48ac-8264-776c164f20f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:01.154207 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6de6c1-6032-48ac-8264-776c164f20f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:01.155809 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6de6c1-6032-48ac-8264-776c164f20f6 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:01.167614 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 238/470] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Sep 19 14:42:00 2022] POST /identity/v3/users => generated 248 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:42:01.169186 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc40f5bd-530b-46d0-af75-2550034c0c8f None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:01.178513 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-ee6de6c1-6032-48ac-8264-776c164f20f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:01.178513 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:01.178513 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:01.178513 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:01.178513 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:01.178513 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:01.178513 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:01.178513 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:01.178513 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:01.178513 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:01.178513 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:01.178513 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:01.178513 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:42:01.178513 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:42:01.178513 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:42:01.178513 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:42:01.179483 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:01.179483 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:01.179483 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:01.179483 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:01.179483 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:01.179483 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:01.179483 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:01.179483 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:01.179483 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:01.179483 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:01.179483 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:01.179483 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:01.179483 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:01.179483 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:01.179483 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:01.179483 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:01.179483 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:42:01.180286 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:42:01.180286 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:01.180286 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:42:01.185121 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 233/471] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:42:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:01.186586 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6de6c1-6032-48ac-8264-776c164f20f6 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:01.225611 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:01.296835 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc40f5bd-530b-46d0-af75-2550034c0c8f None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:01.337118 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d31a07-616d-49d9-a65c-7d18578c57b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:01.338017 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d31a07-616d-49d9-a65c-7d18578c57b1 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:01.338439 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d31a07-616d-49d9-a65c-7d18578c57b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:01.338847 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d31a07-616d-49d9-a65c-7d18578c57b1 None admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:01.339638 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d31a07-616d-49d9-a65c-7d18578c57b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:01.340133 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d31a07-616d-49d9-a65c-7d18578c57b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:01.341719 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d31a07-616d-49d9-a65c-7d18578c57b1 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:01.363180 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 239/472] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 19 14:42:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:01.369431 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d31a07-616d-49d9-a65c-7d18578c57b1 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:01.388235 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6de6c1-6032-48ac-8264-776c164f20f6 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:01.429326 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:01.437240 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e86d6c7-b8a6-4deb-8cff-05ea31ebf1e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:01.438387 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e86d6c7-b8a6-4deb-8cff-05ea31ebf1e7 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:01.438866 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e86d6c7-b8a6-4deb-8cff-05ea31ebf1e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:01.439339 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e86d6c7-b8a6-4deb-8cff-05ea31ebf1e7 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:01.440194 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e86d6c7-b8a6-4deb-8cff-05ea31ebf1e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:01.440693 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e86d6c7-b8a6-4deb-8cff-05ea31ebf1e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:01.443062 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e86d6c7-b8a6-4deb-8cff-05ea31ebf1e7 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:01.459179 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 234/473] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 19 14:42:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:42:01.472096 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e86d6c7-b8a6-4deb-8cff-05ea31ebf1e7 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:01.554670 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:01.558579 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d31a07-616d-49d9-a65c-7d18578c57b1 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:01.594499 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e86d6c7-b8a6-4deb-8cff-05ea31ebf1e7 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:01.597606 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a21f6f-4e59-4307-bc8a-03acba347edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:01.598223 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a21f6f-4e59-4307-bc8a-03acba347edc None admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:01.598501 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a21f6f-4e59-4307-bc8a-03acba347edc None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:01.598773 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a21f6f-4e59-4307-bc8a-03acba347edc None admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:01.599433 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a21f6f-4e59-4307-bc8a-03acba347edc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:01.600880 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a21f6f-4e59-4307-bc8a-03acba347edc None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:01.626448 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 240/474] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Sep 19 14:42:01 2022] POST /identity/v3/users => generated 248 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:42:01.628013 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c91f4f-844b-41b8-8248-61b00dc2fe53 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:01.628365 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c91f4f-844b-41b8-8248-61b00dc2fe53 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:01.628762 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c91f4f-844b-41b8-8248-61b00dc2fe53 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:01.634674 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 241/475] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:42:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:42:01.639738 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a928276-8642-4e24-b293-e0ad4add9617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:01.639738 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a928276-8642-4e24-b293-e0ad4add9617 None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:01.639738 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a928276-8642-4e24-b293-e0ad4add9617 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:01.639738 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a928276-8642-4e24-b293-e0ad4add9617 None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:01.640106 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a928276-8642-4e24-b293-e0ad4add9617 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:01.641335 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45efcf4-afa2-4ad4-950a-0979dc747c9b None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:01.641616 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45efcf4-afa2-4ad4-950a-0979dc747c9b None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:01.641888 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45efcf4-afa2-4ad4-950a-0979dc747c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:01.642687 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a928276-8642-4e24-b293-e0ad4add9617 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:01.665857 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-f45efcf4-afa2-4ad4-950a-0979dc747c9b None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:42:01.667263 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-f45efcf4-afa2-4ad4-950a-0979dc747c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:42:01.670623 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 235/476] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Sep 19 14:42:01 2022] POST /identity/v3/users => generated 249 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:42:01.761988 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 242/477] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:42:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 14:42:02.088978 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a928276-8642-4e24-b293-e0ad4add9617 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:02.145244 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:02.204634 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a928276-8642-4e24-b293-e0ad4add9617 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:02.242730 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c1cddf-c586-4284-bc83-377587ca78b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:02.243712 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c1cddf-c586-4284-bc83-377587ca78b4 None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:02.244176 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c1cddf-c586-4284-bc83-377587ca78b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:02.244628 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c1cddf-c586-4284-bc83-377587ca78b4 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:02.245511 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c1cddf-c586-4284-bc83-377587ca78b4 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:02.247513 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c1cddf-c586-4284-bc83-377587ca78b4 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:02.259321 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.sql.core [None req-15c1cddf-c586-4284-bc83-377587ca78b4 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 19 14:42:02.259321 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 19 14:42:02.259321 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [parameters: {'id': 'c636b0838ec641058e41017dedb5d196', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 19 14:42:02.259321 dv-cinder-756709-7-smb devstack@keystone.service[81472]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81472) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 19 14:42:02.279791 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-15c1cddf-c586-4284-bc83-377587ca78b4 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 19 14:42:02.279791 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:02.279791 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 19 14:42:02.279791 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 19 14:42:02.279791 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 19 14:42:02.279791 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 19 14:42:02.279791 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 19 14:42:02.279791 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application result = self._query(query) Sep 19 14:42:02.279791 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 19 14:42:02.279791 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application conn.query(q) Sep 19 14:42:02.279791 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 19 14:42:02.279791 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 19 14:42:02.279791 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 19 14:42:02.279791 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application result.read() Sep 19 14:42:02.279791 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 19 14:42:02.280682 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 19 14:42:02.280682 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 19 14:42:02.280682 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 19 14:42:02.280682 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 19 14:42:02.280682 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 19 14:42:02.280682 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 19 14:42:02.280682 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 19 14:42:02.280682 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 19 14:42:02.280682 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:42:02.280682 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 19 14:42:02.280682 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:42:02.280682 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:02.280682 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 19 14:42:02.280682 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 19 14:42:02.280682 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 19 14:42:02.280682 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return ref.to_dict() Sep 19 14:42:02.280682 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 19 14:42:02.280682 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application next(self.gen) Sep 19 14:42:02.281598 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 19 14:42:02.281598 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application yield resource Sep 19 14:42:02.281598 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 19 14:42:02.281598 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application next(self.gen) Sep 19 14:42:02.281598 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 19 14:42:02.281598 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self.session.rollback() Sep 19 14:42:02.281598 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 19 14:42:02.281598 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self.force_reraise() Sep 19 14:42:02.281598 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 19 14:42:02.281598 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise self.value Sep 19 14:42:02.281598 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 19 14:42:02.281598 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 19 14:42:02.281598 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 19 14:42:02.281598 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application session.commit() Sep 19 14:42:02.281598 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 19 14:42:02.281598 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 19 14:42:02.281598 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 19 14:42:02.282410 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._prepare_impl() Sep 19 14:42:02.282410 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 19 14:42:02.282410 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self.session.flush() Sep 19 14:42:02.282410 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 19 14:42:02.282410 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._flush(objects) Sep 19 14:42:02.282410 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 19 14:42:02.282410 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 19 14:42:02.282410 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 19 14:42:02.282410 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application compat.raise_( Sep 19 14:42:02.282410 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 19 14:42:02.282410 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception Sep 19 14:42:02.282410 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 19 14:42:02.282410 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application flush_context.execute() Sep 19 14:42:02.282410 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 19 14:42:02.282410 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rec.execute(self) Sep 19 14:42:02.282410 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 19 14:42:02.282410 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 19 14:42:02.283251 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 19 14:42:02.283251 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 19 14:42:02.283251 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 19 14:42:02.283251 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 19 14:42:02.283251 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 19 14:42:02.283251 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 19 14:42:02.283251 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 19 14:42:02.283251 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 19 14:42:02.283251 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 19 14:42:02.283251 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 19 14:42:02.283251 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 19 14:42:02.283251 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 19 14:42:02.283251 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 19 14:42:02.283251 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 19 14:42:02.283251 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 19 14:42:02.283251 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception Sep 19 14:42:02.284027 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 19 14:42:02.284027 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 19 14:42:02.284027 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 19 14:42:02.284027 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 19 14:42:02.284027 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 19 14:42:02.284027 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application result = self._query(query) Sep 19 14:42:02.284027 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 19 14:42:02.284027 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application conn.query(q) Sep 19 14:42:02.284027 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 19 14:42:02.284027 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 19 14:42:02.284027 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 19 14:42:02.284027 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application result.read() Sep 19 14:42:02.284027 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 19 14:42:02.284027 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 19 14:42:02.284027 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 19 14:42:02.284027 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 19 14:42:02.284791 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 19 14:42:02.284791 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 19 14:42:02.284791 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 19 14:42:02.284791 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 19 14:42:02.284791 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 19 14:42:02.284791 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 19 14:42:02.284791 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [parameters: {'id': 'c636b0838ec641058e41017dedb5d196', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 19 14:42:02.284791 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 19 14:42:02.284791 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:42:02.284791 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 14:42:02.284791 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:42:02.284791 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:02.284791 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:02.284791 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:02.284791 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:02.284791 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:02.285613 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:02.285613 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:02.285613 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:02.285613 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:02.285613 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:02.285613 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:02.285613 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 19 14:42:02.285613 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 19 14:42:02.285613 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:02.285613 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:02.285613 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 19 14:42:02.285613 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 19 14:42:02.285613 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 19 14:42:02.285613 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 19 14:42:02.285613 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 19 14:42:02.285613 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:42:02.286460 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 236/478] 10.222.0.26 () {60 vars in 1131 bytes} [Mon Sep 19 14:42:02 2022] POST /identity/v3/roles => generated 144 bytes in 193 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:02.287872 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45efcf4-afa2-4ad4-950a-0979dc747c9b None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:02.405770 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:02.422790 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45efcf4-afa2-4ad4-950a-0979dc747c9b None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:02.460783 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bd2f16-a0f4-4e6a-b60b-ad1b3c50a79d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:02.461463 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bd2f16-a0f4-4e6a-b60b-ad1b3c50a79d None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:02.461738 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bd2f16-a0f4-4e6a-b60b-ad1b3c50a79d None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:02.462007 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bd2f16-a0f4-4e6a-b60b-ad1b3c50a79d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:02.473444 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bd2f16-a0f4-4e6a-b60b-ad1b3c50a79d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:42:02.478296 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-46bd2f16-a0f4-4e6a-b60b-ad1b3c50a79d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 14:42:02.478296 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:02.478296 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:02.478296 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:02.478296 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:02.478296 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:02.478296 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:02.478296 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:02.478296 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:02.478296 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:02.478296 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:02.478296 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:02.478296 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:42:02.478296 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:42:02.478296 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:42:02.478296 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:42:02.480338 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:42:02.480338 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:42:02.480338 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:42:02.480338 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:42:02.480338 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:02.480338 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:02.480338 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:02.480338 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:02.480338 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:02.480338 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:02.480338 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:02.480338 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:02.480338 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:02.480338 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:02.480338 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:02.480338 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:02.482262 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:02.482262 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:02.482262 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:02.482262 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:02.482262 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:42:02.482262 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:42:02.482262 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:42:02.482262 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:42:02.482262 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:42:02.482262 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:42:02.482262 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 14:42:02.482262 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:02.482262 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 243/479] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Sep 19 14:42:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:02.488197 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c1cddf-c586-4284-bc83-377587ca78b4 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:02.660793 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c1cddf-c586-4284-bc83-377587ca78b4 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:02.672320 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:02.707953 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7c7c38-8a86-4eb1-8794-f1b3726d241c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:02.708563 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c7c38-8a86-4eb1-8794-f1b3726d241c None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:02.708835 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c7c38-8a86-4eb1-8794-f1b3726d241c None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:02.709128 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c7c38-8a86-4eb1-8794-f1b3726d241c None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:02.709795 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7c7c38-8a86-4eb1-8794-f1b3726d241c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:02.710092 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7c7c38-8a86-4eb1-8794-f1b3726d241c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:02.711514 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7c7c38-8a86-4eb1-8794-f1b3726d241c None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:02.725111 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 237/480] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 19 14:42:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:03.421032 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a6b70-ea03-4eaa-96d0-e24e710085d2 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:03.421032 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a6b70-ea03-4eaa-96d0-e24e710085d2 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:03.421032 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a6b70-ea03-4eaa-96d0-e24e710085d2 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:03.422951 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 244/481] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:42:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:42:03.429672 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5866946-67e5-453b-aa55-79ea91b3a074 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:03.430206 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5866946-67e5-453b-aa55-79ea91b3a074 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:03.430688 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5866946-67e5-453b-aa55-79ea91b3a074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:03.450988 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-e5866946-67e5-453b-aa55-79ea91b3a074 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:42:03.452511 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e5866946-67e5-453b-aa55-79ea91b3a074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:42:03.548192 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 238/482] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:42:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 14:42:03.825953 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3a6b70-ea03-4eaa-96d0-e24e710085d2 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:03.942366 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3a6b70-ea03-4eaa-96d0-e24e710085d2 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:03.979351 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd4410-0aab-4e84-a611-62c3fa11fe69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:03.980349 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd4410-0aab-4e84-a611-62c3fa11fe69 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:03.981252 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd4410-0aab-4e84-a611-62c3fa11fe69 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:03.981723 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd4410-0aab-4e84-a611-62c3fa11fe69 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:03.993700 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcd4410-0aab-4e84-a611-62c3fa11fe69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:42:04.000147 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-1dcd4410-0aab-4e84-a611-62c3fa11fe69 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:42:04.000147 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:04.000147 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:04.000147 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:04.000147 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:04.000147 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:04.000147 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:04.000147 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:04.000147 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:04.000147 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:04.000147 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:04.000147 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:04.000147 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:42:04.000147 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:42:04.000147 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:42:04.000147 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:42:04.001076 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:42:04.001076 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:42:04.001076 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:42:04.001076 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:42:04.001076 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:04.001076 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:04.001076 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:04.001076 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:04.001076 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:04.001076 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:04.001076 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:04.001076 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:04.001076 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:04.001076 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:04.001076 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:04.001076 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:04.001875 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:04.001875 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:04.001875 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:04.001875 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:04.001875 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:42:04.001875 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:42:04.001875 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:42:04.001875 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:42:04.001875 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:42:04.001875 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:42:04.001875 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:42:04.001875 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:04.004965 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 245/483] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Sep 19 14:42:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:04.011234 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5866946-67e5-453b-aa55-79ea91b3a074 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:04.025617 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b98f2-3557-4ec4-b20d-ffe13abd1305 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:04.026233 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b98f2-3557-4ec4-b20d-ffe13abd1305 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:04.026693 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b98f2-3557-4ec4-b20d-ffe13abd1305 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:04.029393 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 246/484] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:42:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:42:04.034277 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ee668-c206-4738-82ab-71e4d44e3560 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:04.035421 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ee668-c206-4738-82ab-71e4d44e3560 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:04.035969 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ee668-c206-4738-82ab-71e4d44e3560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:04.066212 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:04.075614 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-374ee668-c206-4738-82ab-71e4d44e3560 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:42:04.077237 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-374ee668-c206-4738-82ab-71e4d44e3560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:42:04.173711 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5866946-67e5-453b-aa55-79ea91b3a074 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:04.177108 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:04.209743 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 247/485] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:42:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 14:42:04.237712 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee07146-372e-49e6-b867-269f97b97a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:04.238334 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee07146-372e-49e6-b867-269f97b97a2c None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:04.238609 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee07146-372e-49e6-b867-269f97b97a2c None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:04.238873 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee07146-372e-49e6-b867-269f97b97a2c None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:04.239539 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee07146-372e-49e6-b867-269f97b97a2c None admin] RBAC: Adding query filter params (name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:04.239841 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee07146-372e-49e6-b867-269f97b97a2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:04.241242 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee07146-372e-49e6-b867-269f97b97a2c None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:04.255705 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 239/486] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Sep 19 14:42:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:04.257130 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374ee668-c206-4738-82ab-71e4d44e3560 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:04.394123 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086825fa-2fa3-423b-b3ef-0db209dd900e None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:04.394454 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086825fa-2fa3-423b-b3ef-0db209dd900e None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:04.394667 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086825fa-2fa3-423b-b3ef-0db209dd900e None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:04.396155 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 240/487] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:42:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 14:42:04.401516 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bbc531-4175-425f-abb9-c2ea13c3b615 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:04.401799 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bbc531-4175-425f-abb9-c2ea13c3b615 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:04.402070 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bbc531-4175-425f-abb9-c2ea13c3b615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:04.409890 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374ee668-c206-4738-82ab-71e4d44e3560 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:04.441084 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-c4bbc531-4175-425f-abb9-c2ea13c3b615 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:42:04.442292 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-c4bbc531-4175-425f-abb9-c2ea13c3b615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:42:04.448869 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a796fd-786b-4c5e-a260-d965d173955a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:04.449846 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a796fd-786b-4c5e-a260-d965d173955a None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:04.450159 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a796fd-786b-4c5e-a260-d965d173955a None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:04.450530 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a796fd-786b-4c5e-a260-d965d173955a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:04.453916 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:04.468123 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a796fd-786b-4c5e-a260-d965d173955a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:04.469838 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a796fd-786b-4c5e-a260-d965d173955a None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:04.490251 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-38a796fd-786b-4c5e-a260-d965d173955a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:04.490251 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:04.490251 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:04.490251 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:04.490251 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:04.490251 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:04.490251 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:04.490251 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:04.490251 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:04.490251 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:04.490251 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:04.490251 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:04.490251 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:42:04.490251 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:42:04.490251 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:42:04.490251 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:42:04.491199 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:04.491199 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:04.491199 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:04.491199 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:04.491199 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:04.491199 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:04.491199 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:04.491199 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:04.491199 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:04.491199 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:04.491199 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:04.491199 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:04.491199 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:04.491199 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:04.491199 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:04.491199 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:04.491199 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:42:04.492601 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:42:04.492601 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:04.492601 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:04.492601 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 248/488] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:42:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:04.498736 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a796fd-786b-4c5e-a260-d965d173955a None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:04.569101 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 241/489] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:42:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 14:42:04.570359 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bbc531-4175-425f-abb9-c2ea13c3b615 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:04.630612 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a796fd-786b-4c5e-a260-d965d173955a None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:04.674538 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29206f7e-4eb1-4b34-9fde-9ac7a57bff2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:04.675386 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29206f7e-4eb1-4b34-9fde-9ac7a57bff2e None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:04.675806 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29206f7e-4eb1-4b34-9fde-9ac7a57bff2e None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:04.676479 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29206f7e-4eb1-4b34-9fde-9ac7a57bff2e None admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:04.677713 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29206f7e-4eb1-4b34-9fde-9ac7a57bff2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:04.678437 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29206f7e-4eb1-4b34-9fde-9ac7a57bff2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:04.679647 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:04.681400 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29206f7e-4eb1-4b34-9fde-9ac7a57bff2e None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:04.687843 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bbc531-4175-425f-abb9-c2ea13c3b615 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:04.702735 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 249/490] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 19 14:42:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:04.704434 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52342478-73d2-4039-8331-292064b043a7 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:04.705094 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52342478-73d2-4039-8331-292064b043a7 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:04.706318 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52342478-73d2-4039-8331-292064b043a7 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:04.707806 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 250/491] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:42:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:42:04.708455 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52342478-73d2-4039-8331-292064b043a7 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:04.731497 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fdbb6e-134a-42d1-b7f2-bb0f18c66add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:04.732108 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fdbb6e-134a-42d1-b7f2-bb0f18c66add None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:04.732367 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fdbb6e-134a-42d1-b7f2-bb0f18c66add None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:04.732631 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fdbb6e-134a-42d1-b7f2-bb0f18c66add None admin] PATH_INFO: `/v3/roles/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:04.743433 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fdbb6e-134a-42d1-b7f2-bb0f18c66add None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:42:04.748793 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-e4fdbb6e-134a-42d1-b7f2-bb0f18c66add None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:42:04.748793 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:04.748793 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:04.748793 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:04.748793 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:04.748793 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:04.748793 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:04.748793 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:04.748793 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:04.748793 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:04.748793 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:04.748793 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:04.748793 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:42:04.748793 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:42:04.748793 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:42:04.748793 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:42:04.749712 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:42:04.749712 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:42:04.749712 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:42:04.749712 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:42:04.749712 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:04.749712 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:04.749712 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:04.749712 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:04.749712 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:04.749712 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:04.749712 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:04.749712 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:04.749712 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:04.749712 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:04.749712 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:04.749712 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:04.750484 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:04.750484 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:04.750484 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:04.750484 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:04.750484 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:42:04.750484 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:42:04.750484 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:42:04.750484 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:42:04.750484 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:42:04.750484 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:42:04.750484 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:42:04.750484 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:42:04.753073 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 242/492] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Sep 19 14:42:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:04.756601 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038ca4a7-7c23-46ec-80da-9eff985158fe None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:04.757418 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038ca4a7-7c23-46ec-80da-9eff985158fe None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:04.757979 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038ca4a7-7c23-46ec-80da-9eff985158fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:04.776257 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-038ca4a7-7c23-46ec-80da-9eff985158fe None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:42:04.778040 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-038ca4a7-7c23-46ec-80da-9eff985158fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:42:04.778809 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:04.846117 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52342478-73d2-4039-8331-292064b043a7 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:04.848973 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 243/493] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:42:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:42:04.849375 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038ca4a7-7c23-46ec-80da-9eff985158fe None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:04.893510 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbf2985-3747-4ea2-b558-2a01f3052205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:04.894896 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf2985-3747-4ea2-b558-2a01f3052205 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:04.895752 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf2985-3747-4ea2-b558-2a01f3052205 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:04.896212 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf2985-3747-4ea2-b558-2a01f3052205 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:04.906029 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbf2985-3747-4ea2-b558-2a01f3052205 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:04.908533 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbf2985-3747-4ea2-b558-2a01f3052205 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:04.927104 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-cfbf2985-3747-4ea2-b558-2a01f3052205 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 19 14:42:04.927104 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:04.927104 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:04.927104 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:04.927104 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:04.927104 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:04.927104 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:04.927104 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:04.927104 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:04.927104 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:04.927104 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:04.927104 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:04.927104 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:42:04.927104 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:42:04.927104 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:42:04.927104 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:42:04.928005 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:04.928005 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:04.928005 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:42:04.928005 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:42:04.928005 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:42:04.928005 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:42:04.928005 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:04.928005 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:04.928005 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:04.928005 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:04.928005 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:04.928005 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:04.928005 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:04.928005 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:04.928005 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:04.928005 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:04.928005 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:04.928005 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:04.928858 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:04.928858 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:04.928858 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:42:04.928858 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:42:04.928858 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:42:04.928858 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:42:04.928858 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:42:04.928858 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:42:04.928858 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 19 14:42:04.928858 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:04.931134 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 251/494] 10.222.0.26 () {56 vars in 1093 bytes} [Mon Sep 19 14:42:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:04.932652 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbf2985-3747-4ea2-b558-2a01f3052205 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:04.942152 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:04.959568 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038ca4a7-7c23-46ec-80da-9eff985158fe None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:05.009296 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ad70c0-b050-4076-bee5-bb87282df8a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:05.010365 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad70c0-b050-4076-bee5-bb87282df8a0 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:05.010365 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad70c0-b050-4076-bee5-bb87282df8a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:05.010554 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad70c0-b050-4076-bee5-bb87282df8a0 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:05.011160 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ad70c0-b050-4076-bee5-bb87282df8a0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:05.011475 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ad70c0-b050-4076-bee5-bb87282df8a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:05.013266 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ad70c0-b050-4076-bee5-bb87282df8a0 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:05.022855 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 244/495] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Sep 19 14:42:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:05.023872 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ad70c0-b050-4076-bee5-bb87282df8a0 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:05.077103 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbf2985-3747-4ea2-b558-2a01f3052205 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:05.089982 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:05.127653 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb31b05-4b04-4e07-9912-abcebe93393c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:05.128723 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb31b05-4b04-4e07-9912-abcebe93393c None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:05.129403 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb31b05-4b04-4e07-9912-abcebe93393c None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:05.129841 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb31b05-4b04-4e07-9912-abcebe93393c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:05.133600 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ad70c0-b050-4076-bee5-bb87282df8a0 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:05.144344 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb31b05-4b04-4e07-9912-abcebe93393c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:42:05.152149 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-acb31b05-4b04-4e07-9912-abcebe93393c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:42:05.152149 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:05.152149 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:05.152149 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:05.152149 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:05.152149 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:05.152149 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:05.152149 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:05.152149 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:05.152149 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:05.152149 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:05.152149 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:05.152149 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:42:05.152149 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:42:05.152149 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:42:05.152149 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:42:05.153367 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:42:05.153367 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:42:05.153367 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:42:05.153367 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:42:05.153367 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:05.153367 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:05.153367 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:05.153367 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:05.153367 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:05.153367 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:05.153367 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:05.153367 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:05.153367 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:05.153367 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:05.153367 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:05.153367 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:05.155327 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:05.155327 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:05.155327 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:05.155327 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:05.155327 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:42:05.155327 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:42:05.155327 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:42:05.155327 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:42:05.155327 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:42:05.155327 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:42:05.155327 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:42:05.155327 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:05.155327 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 252/496] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Sep 19 14:42:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:05.155327 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb31b05-4b04-4e07-9912-abcebe93393c None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:05.175391 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a5c5c5-2a73-409a-b1bf-fbd5a4ae9d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:05.175969 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a5c5c5-2a73-409a-b1bf-fbd5a4ae9d30 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:05.176247 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a5c5c5-2a73-409a-b1bf-fbd5a4ae9d30 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:05.176519 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a5c5c5-2a73-409a-b1bf-fbd5a4ae9d30 None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:05.177335 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a5c5c5-2a73-409a-b1bf-fbd5a4ae9d30 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:05.177587 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a5c5c5-2a73-409a-b1bf-fbd5a4ae9d30 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:05.179018 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a5c5c5-2a73-409a-b1bf-fbd5a4ae9d30 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:05.221026 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 245/497] 10.222.0.26 () {56 vars in 1133 bytes} [Mon Sep 19 14:42:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:05.221026 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a5c5c5-2a73-409a-b1bf-fbd5a4ae9d30 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:05.224922 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:05.267181 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb31b05-4b04-4e07-9912-abcebe93393c None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:05.302861 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e45508-15aa-4822-be2d-035bf753651e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:05.303613 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e45508-15aa-4822-be2d-035bf753651e None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:05.303890 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e45508-15aa-4822-be2d-035bf753651e None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:05.304259 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e45508-15aa-4822-be2d-035bf753651e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:05.315598 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e45508-15aa-4822-be2d-035bf753651e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:05.317086 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e45508-15aa-4822-be2d-035bf753651e None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:05.325738 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a5c5c5-2a73-409a-b1bf-fbd5a4ae9d30 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:05.331479 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-b0e45508-15aa-4822-be2d-035bf753651e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:05.331479 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:05.331479 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:05.331479 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:05.331479 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:05.331479 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:05.331479 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:05.331479 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:05.331479 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:05.331479 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:05.331479 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:05.331479 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:05.331479 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:42:05.331479 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:42:05.331479 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:42:05.331479 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:42:05.332329 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:05.332329 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:05.332329 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:05.332329 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:05.332329 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:05.332329 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:05.332329 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:05.332329 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:05.332329 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:05.332329 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:05.332329 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:05.332329 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:05.332329 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:05.332329 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:05.332329 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:05.332329 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:05.332329 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:42:05.333724 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:42:05.333724 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:05.333724 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:05.337255 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 253/498] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:42:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:05.338104 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e45508-15aa-4822-be2d-035bf753651e None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:05.362763 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:05.363339 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567da559-2048-4b11-8c7b-3b8d3ea170d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:05.364268 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567da559-2048-4b11-8c7b-3b8d3ea170d7 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:05.364561 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567da559-2048-4b11-8c7b-3b8d3ea170d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:05.365016 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567da559-2048-4b11-8c7b-3b8d3ea170d7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:05.375775 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567da559-2048-4b11-8c7b-3b8d3ea170d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:42:05.380695 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-567da559-2048-4b11-8c7b-3b8d3ea170d7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:42:05.380695 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:05.380695 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:05.380695 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:05.380695 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:05.380695 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:05.380695 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:05.380695 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:05.380695 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:05.380695 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:05.380695 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:05.380695 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:05.380695 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:42:05.380695 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:42:05.380695 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:42:05.380695 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:42:05.381799 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:42:05.381799 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:42:05.381799 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:42:05.381799 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:42:05.381799 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:05.381799 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:05.381799 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:05.381799 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:05.381799 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:05.381799 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:05.381799 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:05.381799 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:05.381799 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:05.381799 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:05.381799 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:05.381799 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:05.385950 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:05.385950 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:05.385950 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:05.385950 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:05.385950 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:42:05.385950 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:42:05.385950 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:42:05.385950 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:42:05.385950 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:42:05.385950 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:42:05.385950 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:42:05.385950 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:42:05.385950 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 246/499] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Sep 19 14:42:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:05.385950 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567da559-2048-4b11-8c7b-3b8d3ea170d7 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:05.450897 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:05.461747 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e45508-15aa-4822-be2d-035bf753651e None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:05.491460 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567da559-2048-4b11-8c7b-3b8d3ea170d7 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:05.501225 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce16bce-4f1b-485d-adbb-51ec7bf90d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:05.502174 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce16bce-4f1b-485d-adbb-51ec7bf90d01 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:05.502174 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce16bce-4f1b-485d-adbb-51ec7bf90d01 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:05.502441 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce16bce-4f1b-485d-adbb-51ec7bf90d01 None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:05.503132 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce16bce-4f1b-485d-adbb-51ec7bf90d01 None admin] RBAC: Adding query filter params (name=service) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:05.503439 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce16bce-4f1b-485d-adbb-51ec7bf90d01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:05.504904 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce16bce-4f1b-485d-adbb-51ec7bf90d01 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:05.519174 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 254/500] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Sep 19 14:42:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:05.519174 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce16bce-4f1b-485d-adbb-51ec7bf90d01 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:05.533661 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3bea58-b714-473d-be92-fcc5a0b9e9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:05.534357 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3bea58-b714-473d-be92-fcc5a0b9e9bb None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:05.534631 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3bea58-b714-473d-be92-fcc5a0b9e9bb None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:05.534896 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3bea58-b714-473d-be92-fcc5a0b9e9bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:05.605561 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3bea58-b714-473d-be92-fcc5a0b9e9bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:05.607439 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3bea58-b714-473d-be92-fcc5a0b9e9bb None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:05.612182 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:05.634240 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce16bce-4f1b-485d-adbb-51ec7bf90d01 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:05.670941 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e241a151-fab6-4c1a-ba5e-beb0e4e9fb96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:05.671593 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e241a151-fab6-4c1a-ba5e-beb0e4e9fb96 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:05.671849 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e241a151-fab6-4c1a-ba5e-beb0e4e9fb96 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:05.672115 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e241a151-fab6-4c1a-ba5e-beb0e4e9fb96 None admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:05.672777 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e241a151-fab6-4c1a-ba5e-beb0e4e9fb96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:05.673105 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e241a151-fab6-4c1a-ba5e-beb0e4e9fb96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:05.673212 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:05.674848 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e241a151-fab6-4c1a-ba5e-beb0e4e9fb96 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:05.693515 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 255/501] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 19 14:42:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:05.693515 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e241a151-fab6-4c1a-ba5e-beb0e4e9fb96 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:05.715387 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 247/502] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 19 14:42:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:42:05.720496 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3bea58-b714-473d-be92-fcc5a0b9e9bb None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:05.806174 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e241a151-fab6-4c1a-ba5e-beb0e4e9fb96 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:05.823428 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3bea58-b714-473d-be92-fcc5a0b9e9bb None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:05.842357 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6930e457-1b5e-4604-b1f5-730cca0151db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:05.843359 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6930e457-1b5e-4604-b1f5-730cca0151db None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:05.843626 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6930e457-1b5e-4604-b1f5-730cca0151db None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:05.843895 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6930e457-1b5e-4604-b1f5-730cca0151db None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:05.844597 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6930e457-1b5e-4604-b1f5-730cca0151db None admin] RBAC: Adding query filter params (name=service) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:05.844922 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6930e457-1b5e-4604-b1f5-730cca0151db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:05.846389 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6930e457-1b5e-4604-b1f5-730cca0151db None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:05.855240 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 256/503] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Sep 19 14:42:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:05.856411 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6930e457-1b5e-4604-b1f5-730cca0151db None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:05.861263 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:05.865048 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fbe867-5e8d-4525-946f-5e5338596fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:05.865694 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fbe867-5e8d-4525-946f-5e5338596fba None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:05.865980 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fbe867-5e8d-4525-946f-5e5338596fba None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:05.866251 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fbe867-5e8d-4525-946f-5e5338596fba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:05.877703 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fbe867-5e8d-4525-946f-5e5338596fba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:05.879298 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fbe867-5e8d-4525-946f-5e5338596fba None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:05.896143 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-d9fbe867-5e8d-4525-946f-5e5338596fba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:05.896143 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:05.896143 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:05.896143 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:05.896143 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:05.896143 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:05.896143 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:05.896143 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:05.896143 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:05.896143 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:05.896143 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:05.896143 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:05.896143 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:42:05.896143 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:42:05.896143 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:42:05.896143 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:42:05.897431 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:05.897431 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:05.897431 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:05.897431 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:05.897431 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:05.897431 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:05.897431 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:05.897431 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:05.897431 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:05.897431 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:05.897431 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:05.897431 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:05.897431 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:05.897431 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:05.897431 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:05.897431 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:05.897431 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:42:05.898286 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:42:05.898286 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:05.898286 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:42:05.902602 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 248/504] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:42:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:05.903592 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fbe867-5e8d-4525-946f-5e5338596fba None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:05.924777 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:05.974993 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6930e457-1b5e-4604-b1f5-730cca0151db None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:06.013629 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f75e78-fb59-4540-afdc-f7b622ddbf2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:06.014503 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f75e78-fb59-4540-afdc-f7b622ddbf2f None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:06.014888 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f75e78-fb59-4540-afdc-f7b622ddbf2f None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:06.015196 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f75e78-fb59-4540-afdc-f7b622ddbf2f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:06.021252 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fbe867-5e8d-4525-946f-5e5338596fba None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:06.023408 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f75e78-fb59-4540-afdc-f7b622ddbf2f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:06.024845 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f75e78-fb59-4540-afdc-f7b622ddbf2f None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:06.035898 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-b1f75e78-fb59-4540-afdc-f7b622ddbf2f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 19 14:42:06.035898 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:06.035898 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:06.035898 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:06.035898 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:06.035898 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:06.035898 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:06.035898 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:06.035898 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:06.035898 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:06.035898 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:06.035898 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:06.035898 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:42:06.035898 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:42:06.035898 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:42:06.035898 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:42:06.036909 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:06.036909 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:06.036909 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:42:06.036909 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:42:06.036909 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:42:06.036909 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:42:06.036909 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:06.036909 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:06.036909 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:06.036909 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:06.036909 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:06.036909 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:06.036909 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:06.036909 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:06.036909 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:06.036909 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:06.036909 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:06.036909 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:06.037812 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:06.037812 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:06.037812 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:42:06.037812 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:42:06.037812 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:42:06.037812 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:42:06.037812 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:42:06.037812 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:42:06.037812 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 19 14:42:06.037812 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:06.037812 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 257/505] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 19 14:42:05 2022] GET /identity/v3/users/cinder => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:06.037812 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f75e78-fb59-4540-afdc-f7b622ddbf2f None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:06.058284 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c818197-bdbf-480a-8c64-89f6f4943739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:06.058993 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c818197-bdbf-480a-8c64-89f6f4943739 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:06.059215 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c818197-bdbf-480a-8c64-89f6f4943739 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:06.059493 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c818197-bdbf-480a-8c64-89f6f4943739 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:06.070232 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c818197-bdbf-480a-8c64-89f6f4943739 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:06.071934 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c818197-bdbf-480a-8c64-89f6f4943739 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:06.086628 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-1c818197-bdbf-480a-8c64-89f6f4943739 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:06.086628 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:06.086628 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:06.086628 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:06.086628 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:06.086628 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:06.086628 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:06.086628 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:06.086628 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:06.086628 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:06.086628 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:06.086628 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:06.086628 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:42:06.086628 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:42:06.086628 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:42:06.086628 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:42:06.087539 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:06.087539 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:06.087539 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:06.087539 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:06.087539 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:06.087539 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:06.087539 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:06.087539 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:06.087539 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:06.087539 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:06.087539 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:06.087539 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:06.087539 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:06.087539 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:06.087539 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:06.087539 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:06.087539 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:42:06.088358 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:42:06.088358 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:06.088358 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:42:06.088358 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 249/506] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:42:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:06.088568 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c818197-bdbf-480a-8c64-89f6f4943739 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:06.099057 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:06.137237 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f75e78-fb59-4540-afdc-f7b622ddbf2f None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:06.159108 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:06.174526 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3a727c-64aa-432d-bf13-e405fc312005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:06.175152 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a727c-64aa-432d-bf13-e405fc312005 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:06.175432 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a727c-64aa-432d-bf13-e405fc312005 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:06.175701 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a727c-64aa-432d-bf13-e405fc312005 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:06.187613 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3a727c-64aa-432d-bf13-e405fc312005 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:06.189118 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3a727c-64aa-432d-bf13-e405fc312005 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:06.194574 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c818197-bdbf-480a-8c64-89f6f4943739 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:06.203429 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-dd3a727c-64aa-432d-bf13-e405fc312005 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:06.203429 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:06.203429 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:06.203429 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:06.203429 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:06.203429 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:06.203429 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:06.203429 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:06.203429 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:06.203429 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:06.203429 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:06.203429 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:06.203429 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:42:06.203429 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:42:06.203429 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:42:06.203429 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:42:06.204379 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:06.204379 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:06.204379 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:06.204379 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:06.204379 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:06.204379 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:06.204379 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:06.204379 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:06.204379 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:06.204379 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:06.204379 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:06.204379 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:06.204379 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:06.204379 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:06.204379 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:06.204379 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:06.204379 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:42:06.205629 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:42:06.205629 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:06.205629 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:06.205629 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 258/507] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:42:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:06.205950 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697a474-8505-49dc-9664-27cc72088792 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:06.206226 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697a474-8505-49dc-9664-27cc72088792 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:06.206498 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697a474-8505-49dc-9664-27cc72088792 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:06.207984 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 259/508] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:42:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:42:06.208487 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c697a474-8505-49dc-9664-27cc72088792 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:06.235831 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6ff270-392b-46f2-a760-12c1011fb1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:06.236362 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ff270-392b-46f2-a760-12c1011fb1a7 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:06.236638 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ff270-392b-46f2-a760-12c1011fb1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:06.236914 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ff270-392b-46f2-a760-12c1011fb1a7 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:06.237588 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6ff270-392b-46f2-a760-12c1011fb1a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:06.237891 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6ff270-392b-46f2-a760-12c1011fb1a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:06.239289 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6ff270-392b-46f2-a760-12c1011fb1a7 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:06.251351 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 250/509] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 19 14:42:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:06.252185 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6ff270-392b-46f2-a760-12c1011fb1a7 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:06.335125 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c697a474-8505-49dc-9664-27cc72088792 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:06.352807 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:06.359231 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6ff270-392b-46f2-a760-12c1011fb1a7 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:06.371739 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56429dc2-5e36-4038-a9c7-9aa530036581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:06.372345 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56429dc2-5e36-4038-a9c7-9aa530036581 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:06.372619 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56429dc2-5e36-4038-a9c7-9aa530036581 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:06.372886 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56429dc2-5e36-4038-a9c7-9aa530036581 None admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:06.373654 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56429dc2-5e36-4038-a9c7-9aa530036581 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:06.373955 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56429dc2-5e36-4038-a9c7-9aa530036581 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:06.375384 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56429dc2-5e36-4038-a9c7-9aa530036581 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:06.386994 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:06.395648 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f06fd6-4664-4711-bd58-ef2a905fbe0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:06.396245 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f06fd6-4664-4711-bd58-ef2a905fbe0c None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:06.396517 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f06fd6-4664-4711-bd58-ef2a905fbe0c None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:06.396781 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f06fd6-4664-4711-bd58-ef2a905fbe0c None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:06.397444 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f06fd6-4664-4711-bd58-ef2a905fbe0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:06.397738 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f06fd6-4664-4711-bd58-ef2a905fbe0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:06.399150 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f06fd6-4664-4711-bd58-ef2a905fbe0c None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:06.410733 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 251/510] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 19 14:42:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:06.411517 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f06fd6-4664-4711-bd58-ef2a905fbe0c None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:06.418670 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 260/511] 10.222.0.26 () {56 vars in 1137 bytes} [Mon Sep 19 14:42:06 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:06.418670 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d775ff2b-053f-482b-b1bd-7260b23c2367 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:06.418670 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d775ff2b-053f-482b-b1bd-7260b23c2367 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:06.418670 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d775ff2b-053f-482b-b1bd-7260b23c2367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:06.434879 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-d775ff2b-053f-482b-b1bd-7260b23c2367 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:42:06.436089 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-d775ff2b-053f-482b-b1bd-7260b23c2367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:42:06.503962 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 261/512] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:42:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:42:06.504802 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d775ff2b-053f-482b-b1bd-7260b23c2367 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:06.515658 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f06fd6-4664-4711-bd58-ef2a905fbe0c None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:06.551596 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153912e1-3e13-4831-9064-382d9c51c1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:06.552193 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153912e1-3e13-4831-9064-382d9c51c1d8 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:06.552468 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153912e1-3e13-4831-9064-382d9c51c1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:06.552734 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153912e1-3e13-4831-9064-382d9c51c1d8 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:06.553475 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153912e1-3e13-4831-9064-382d9c51c1d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:06.553711 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153912e1-3e13-4831-9064-382d9c51c1d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:06.555291 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153912e1-3e13-4831-9064-382d9c51c1d8 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:06.571832 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 252/513] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 19 14:42:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:06.571832 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153912e1-3e13-4831-9064-382d9c51c1d8 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:06.624766 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:06.627948 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d775ff2b-053f-482b-b1bd-7260b23c2367 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:06.632051 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:06.670733 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357ce679-2d51-4158-9416-5bedfa5614c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:06.671372 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ce679-2d51-4158-9416-5bedfa5614c6 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:06.671641 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ce679-2d51-4158-9416-5bedfa5614c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:06.671905 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ce679-2d51-4158-9416-5bedfa5614c6 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:06.677651 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153912e1-3e13-4831-9064-382d9c51c1d8 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:06.679088 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357ce679-2d51-4158-9416-5bedfa5614c6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:06.680546 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357ce679-2d51-4158-9416-5bedfa5614c6 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:06.692695 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-357ce679-2d51-4158-9416-5bedfa5614c6 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 19 14:42:06.692695 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:06.692695 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:06.692695 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:06.692695 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:06.692695 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:06.692695 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:06.692695 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:06.692695 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:06.692695 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:06.692695 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:06.692695 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:06.692695 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:42:06.692695 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:42:06.692695 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:42:06.692695 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:42:06.693660 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:06.693660 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:06.693660 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:42:06.693660 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:42:06.693660 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:42:06.693660 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:42:06.693660 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:06.693660 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:06.693660 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:06.693660 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:06.693660 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:06.693660 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:06.693660 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:06.693660 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:06.693660 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:06.693660 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:06.693660 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:06.693660 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:06.694683 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:06.694683 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:06.694683 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:42:06.694683 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:42:06.694683 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:42:06.694683 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:42:06.694683 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:42:06.694683 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:42:06.694683 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 19 14:42:06.694683 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:06.694683 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 262/514] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 19 14:42:06 2022] GET /identity/v3/users/glance => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:06.694683 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357ce679-2d51-4158-9416-5bedfa5614c6 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:06.719659 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d229395-1dc8-4fb3-b995-f549cfcd4bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:06.720281 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d229395-1dc8-4fb3-b995-f549cfcd4bef None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:06.720560 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d229395-1dc8-4fb3-b995-f549cfcd4bef None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:06.720818 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d229395-1dc8-4fb3-b995-f549cfcd4bef None admin] PATH_INFO: `/v3/projects/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:06.727627 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d229395-1dc8-4fb3-b995-f549cfcd4bef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:06.729120 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d229395-1dc8-4fb3-b995-f549cfcd4bef None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:06.740779 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-8d229395-1dc8-4fb3-b995-f549cfcd4bef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:42:06.740779 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:06.740779 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:06.740779 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:06.740779 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:06.740779 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:06.740779 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:06.740779 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:06.740779 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:06.740779 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:06.740779 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:06.740779 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:06.740779 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:42:06.740779 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:42:06.740779 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:42:06.741964 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:42:06.741964 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:06.741964 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:06.741964 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:06.741964 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:06.741964 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:06.741964 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:06.741964 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:06.741964 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:06.741964 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:06.741964 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:06.741964 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:06.741964 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:06.741964 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:06.741964 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:06.741964 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:06.741964 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:06.743030 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:42:06.743030 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:42:06.743030 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:42:06.743030 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:42:06.743030 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:42:06.743030 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:42:06.743030 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:42:06.743030 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:42:06.746838 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 253/515] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 19 14:42:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:06.747753 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d229395-1dc8-4fb3-b995-f549cfcd4bef None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:06.806286 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357ce679-2d51-4158-9416-5bedfa5614c6 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:06.841098 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a4cef4-0061-49d1-91c8-71f4579a7d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:06.841701 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a4cef4-0061-49d1-91c8-71f4579a7d53 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:06.841977 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a4cef4-0061-49d1-91c8-71f4579a7d53 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:06.842246 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a4cef4-0061-49d1-91c8-71f4579a7d53 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:06.847562 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d229395-1dc8-4fb3-b995-f549cfcd4bef None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:06.856979 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:06.873555 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:06.882951 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291eea9a-3e46-42db-aadf-b2bc37b6681a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:06.883572 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291eea9a-3e46-42db-aadf-b2bc37b6681a None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:06.883849 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291eea9a-3e46-42db-aadf-b2bc37b6681a None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:06.884122 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291eea9a-3e46-42db-aadf-b2bc37b6681a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:06.892809 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291eea9a-3e46-42db-aadf-b2bc37b6681a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:06.894307 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291eea9a-3e46-42db-aadf-b2bc37b6681a None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:06.906975 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-291eea9a-3e46-42db-aadf-b2bc37b6681a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 19 14:42:06.906975 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:06.906975 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:06.906975 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:06.906975 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:06.906975 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:06.906975 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:06.906975 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:06.906975 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:06.906975 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:06.906975 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:06.906975 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:06.906975 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:42:06.906975 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:42:06.906975 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:42:06.906975 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:42:06.908000 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:06.908000 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:06.908000 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:42:06.908000 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:42:06.908000 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:42:06.908000 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:42:06.908000 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:06.908000 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:06.908000 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:06.908000 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:06.908000 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:06.908000 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:06.908000 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:06.908000 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:06.908000 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:06.908000 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:06.908000 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:06.908000 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:06.908861 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:06.908861 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:06.908861 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:42:06.908861 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:42:06.908861 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:42:06.908861 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:42:06.908861 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:42:06.908861 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:42:06.908861 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 19 14:42:06.908861 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:42:06.908861 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 254/516] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Sep 19 14:42:06 2022] GET /identity/v3/users/neutron => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:06.909638 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291eea9a-3e46-42db-aadf-b2bc37b6681a None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:06.916790 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a4cef4-0061-49d1-91c8-71f4579a7d53 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:06.918422 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a4cef4-0061-49d1-91c8-71f4579a7d53 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:07.021113 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291eea9a-3e46-42db-aadf-b2bc37b6681a None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:07.025216 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 263/517] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 19 14:42:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:42:07.025949 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a4cef4-0061-49d1-91c8-71f4579a7d53 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:07.061028 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbafe6e-21b3-45c0-be48-3901cdb62d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:07.061547 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbafe6e-21b3-45c0-be48-3901cdb62d9b None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:07.061824 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbafe6e-21b3-45c0-be48-3901cdb62d9b None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:07.062091 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbafe6e-21b3-45c0-be48-3901cdb62d9b None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:07.062820 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbafe6e-21b3-45c0-be48-3901cdb62d9b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:07.063120 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbafe6e-21b3-45c0-be48-3901cdb62d9b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:07.064569 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbafe6e-21b3-45c0-be48-3901cdb62d9b None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:07.081636 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 255/518] 10.222.0.26 () {56 vars in 1137 bytes} [Mon Sep 19 14:42:06 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:07.082460 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbafe6e-21b3-45c0-be48-3901cdb62d9b None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:07.095506 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:07.110165 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:07.135383 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a4cef4-0061-49d1-91c8-71f4579a7d53 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:07.171603 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bb71ee-69c1-48d8-b331-493a3a650d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:07.172211 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bb71ee-69c1-48d8-b331-493a3a650d65 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:07.172485 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bb71ee-69c1-48d8-b331-493a3a650d65 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:07.172759 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bb71ee-69c1-48d8-b331-493a3a650d65 None admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:07.173494 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bb71ee-69c1-48d8-b331-493a3a650d65 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:07.173800 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bb71ee-69c1-48d8-b331-493a3a650d65 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:07.175261 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bb71ee-69c1-48d8-b331-493a3a650d65 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:07.183022 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbafe6e-21b3-45c0-be48-3901cdb62d9b None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:07.193056 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 264/519] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 19 14:42:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:07.193973 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bb71ee-69c1-48d8-b331-493a3a650d65 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:07.218551 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9ad223-b567-4f4c-95a6-c1730efee963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:07.219149 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ad223-b567-4f4c-95a6-c1730efee963 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:07.219413 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ad223-b567-4f4c-95a6-c1730efee963 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:07.219675 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ad223-b567-4f4c-95a6-c1730efee963 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:07.229567 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9ad223-b567-4f4c-95a6-c1730efee963 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:07.231217 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9ad223-b567-4f4c-95a6-c1730efee963 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:07.245496 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-4f9ad223-b567-4f4c-95a6-c1730efee963 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:07.245496 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:07.245496 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:07.245496 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:07.245496 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:07.245496 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:07.245496 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:07.245496 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:07.245496 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:07.245496 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:07.245496 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:07.245496 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:07.245496 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:42:07.245496 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:42:07.245496 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:42:07.245496 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:42:07.246982 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:07.246982 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:07.246982 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:07.246982 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:07.246982 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:07.246982 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:07.246982 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:07.246982 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:07.246982 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:07.246982 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:07.246982 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:07.246982 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:07.246982 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:07.246982 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:07.246982 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:07.246982 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:07.246982 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:42:07.247803 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:42:07.247803 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:07.247803 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:42:07.247803 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 256/520] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:42:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:07.247803 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9ad223-b567-4f4c-95a6-c1730efee963 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:07.297892 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bb71ee-69c1-48d8-b331-493a3a650d65 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:07.321699 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:07.325060 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:07.334684 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265660ba-2cbb-4cb4-9aa3-7346d063288c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:07.335303 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265660ba-2cbb-4cb4-9aa3-7346d063288c None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:07.335577 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265660ba-2cbb-4cb4-9aa3-7346d063288c None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:07.335843 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265660ba-2cbb-4cb4-9aa3-7346d063288c None admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:07.336562 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265660ba-2cbb-4cb4-9aa3-7346d063288c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:07.336863 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265660ba-2cbb-4cb4-9aa3-7346d063288c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:07.338315 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265660ba-2cbb-4cb4-9aa3-7346d063288c None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:07.348494 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9ad223-b567-4f4c-95a6-c1730efee963 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:07.356652 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 265/521] 10.222.0.26 () {56 vars in 1139 bytes} [Mon Sep 19 14:42:07 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:07.356652 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265660ba-2cbb-4cb4-9aa3-7346d063288c None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:07.384275 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d8ef9f-f8f9-4dfd-95af-56bf0df6134a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:07.384907 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d8ef9f-f8f9-4dfd-95af-56bf0df6134a None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:07.385215 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d8ef9f-f8f9-4dfd-95af-56bf0df6134a None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:07.385486 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d8ef9f-f8f9-4dfd-95af-56bf0df6134a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:07.395954 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d8ef9f-f8f9-4dfd-95af-56bf0df6134a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:07.397589 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d8ef9f-f8f9-4dfd-95af-56bf0df6134a None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:07.411715 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-17d8ef9f-f8f9-4dfd-95af-56bf0df6134a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:07.411715 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:07.411715 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:07.411715 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:07.411715 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:07.411715 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:07.411715 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:07.411715 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:07.411715 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:07.411715 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:07.411715 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:07.411715 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:07.411715 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:42:07.411715 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:42:07.411715 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:42:07.411715 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:42:07.412762 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:07.412762 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:07.412762 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:07.412762 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:07.412762 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:07.412762 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:07.412762 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:07.412762 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:07.412762 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:07.412762 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:07.412762 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:07.412762 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:07.412762 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:07.412762 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:07.412762 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:07.412762 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:07.412762 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:42:07.413655 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:42:07.413655 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:07.413655 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:42:07.413655 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 257/522] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:42:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:07.413655 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d8ef9f-f8f9-4dfd-95af-56bf0df6134a None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:07.458568 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265660ba-2cbb-4cb4-9aa3-7346d063288c None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:07.495424 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a255b8a2-9ac2-48b3-aa61-9b6acd5229a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:07.496027 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a255b8a2-9ac2-48b3-aa61-9b6acd5229a7 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:07.496333 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a255b8a2-9ac2-48b3-aa61-9b6acd5229a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:07.497146 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a255b8a2-9ac2-48b3-aa61-9b6acd5229a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:07.524651 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d8ef9f-f8f9-4dfd-95af-56bf0df6134a None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:07.552509 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:07.553367 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:07.559935 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8154ea-cd6a-42b6-8c71-456533925a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:07.560521 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8154ea-cd6a-42b6-8c71-456533925a6d None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:07.560794 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8154ea-cd6a-42b6-8c71-456533925a6d None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:07.561083 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8154ea-cd6a-42b6-8c71-456533925a6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:07.561804 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8154ea-cd6a-42b6-8c71-456533925a6d None admin] RBAC: Adding query filter params (role.id=3d5d4018951045e18e7577ee742c10ca, scope.project.id=9ede5dc59ece4d9282867a99e94c4c41, user.id=3017e5d92bef4cc2aeae4f28c78ba233) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:07.562102 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8154ea-cd6a-42b6-8c71-456533925a6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:07.563552 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8154ea-cd6a-42b6-8c71-456533925a6d None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:07.568896 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 258/523] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 19 14:42:07 2022] GET /identity/v3/role_assignments?user.id=3017e5d92bef4cc2aeae4f28c78ba233&scope.project.id=9ede5dc59ece4d9282867a99e94c4c41&role.id=3d5d4018951045e18e7577ee742c10ca => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:07.569689 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8154ea-cd6a-42b6-8c71-456533925a6d None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:07.578157 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a255b8a2-9ac2-48b3-aa61-9b6acd5229a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:07.579701 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a255b8a2-9ac2-48b3-aa61-9b6acd5229a7 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:07.697369 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8154ea-cd6a-42b6-8c71-456533925a6d None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:07.713331 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 266/524] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 19 14:42:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:42:07.713331 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a255b8a2-9ac2-48b3-aa61-9b6acd5229a7 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:07.743382 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a7ac0a-48d3-42bd-8e8d-bbb2964b9a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:07.744026 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7ac0a-48d3-42bd-8e8d-bbb2964b9a2d None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:07.744304 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7ac0a-48d3-42bd-8e8d-bbb2964b9a2d None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:07.744561 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7ac0a-48d3-42bd-8e8d-bbb2964b9a2d None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:07.745254 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a7ac0a-48d3-42bd-8e8d-bbb2964b9a2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:07.745558 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a7ac0a-48d3-42bd-8e8d-bbb2964b9a2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:07.747429 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a7ac0a-48d3-42bd-8e8d-bbb2964b9a2d None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:07.760665 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 259/525] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 19 14:42:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:07.761778 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a7ac0a-48d3-42bd-8e8d-bbb2964b9a2d None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:07.814438 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:07.835020 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a255b8a2-9ac2-48b3-aa61-9b6acd5229a7 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:07.840946 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:07.877562 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c53016-f70f-4b79-8618-2619b9de9a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:07.878171 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c53016-f70f-4b79-8618-2619b9de9a74 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:07.878447 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c53016-f70f-4b79-8618-2619b9de9a74 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:07.878716 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c53016-f70f-4b79-8618-2619b9de9a74 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:07.909631 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a7ac0a-48d3-42bd-8e8d-bbb2964b9a2d None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:07.955211 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8d428a-96fe-43d1-980e-0de02e011c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:07.955927 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8d428a-96fe-43d1-980e-0de02e011c72 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:07.956270 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8d428a-96fe-43d1-980e-0de02e011c72 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:07.956632 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8d428a-96fe-43d1-980e-0de02e011c72 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:07.957391 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8d428a-96fe-43d1-980e-0de02e011c72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:07.957756 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8d428a-96fe-43d1-980e-0de02e011c72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:07.959156 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8d428a-96fe-43d1-980e-0de02e011c72 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:07.963294 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c53016-f70f-4b79-8618-2619b9de9a74 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:07.965352 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c53016-f70f-4b79-8618-2619b9de9a74 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:07.978436 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 260/526] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 19 14:42:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:07.978436 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8d428a-96fe-43d1-980e-0de02e011c72 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:08.067868 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:08.088979 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 267/527] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 19 14:42:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:42:08.089709 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c53016-f70f-4b79-8618-2619b9de9a74 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:08.111971 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8d428a-96fe-43d1-980e-0de02e011c72 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:08.127127 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:08.152893 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7527687c-3cd7-406c-a16f-bb870b15aa8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:08.153695 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7527687c-3cd7-406c-a16f-bb870b15aa8c None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:08.153971 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7527687c-3cd7-406c-a16f-bb870b15aa8c None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:08.154238 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7527687c-3cd7-406c-a16f-bb870b15aa8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:08.166668 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7527687c-3cd7-406c-a16f-bb870b15aa8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:08.168226 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7527687c-3cd7-406c-a16f-bb870b15aa8c None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:08.184753 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-7527687c-3cd7-406c-a16f-bb870b15aa8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:08.184753 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:08.184753 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:08.184753 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:08.184753 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:08.184753 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:08.184753 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:08.184753 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:08.184753 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:08.184753 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:08.184753 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:08.184753 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:08.184753 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:42:08.184753 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:42:08.184753 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:42:08.184753 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:42:08.185772 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:08.185772 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:08.185772 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:08.185772 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:08.185772 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:08.185772 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:08.185772 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:08.185772 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:08.185772 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:08.185772 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:08.185772 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:08.185772 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:08.185772 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:08.185772 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:08.185772 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:08.185772 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:08.185772 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:42:08.186572 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:42:08.186572 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:08.186572 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:42:08.186572 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 261/528] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:42:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:08.186915 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7527687c-3cd7-406c-a16f-bb870b15aa8c None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:08.218331 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c53016-f70f-4b79-8618-2619b9de9a74 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:08.263040 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c8f192-82c0-48c3-a997-bd7450da2701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:08.265122 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8f192-82c0-48c3-a997-bd7450da2701 None admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:08.265403 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8f192-82c0-48c3-a997-bd7450da2701 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:08.265671 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8f192-82c0-48c3-a997-bd7450da2701 None admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:08.266320 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c8f192-82c0-48c3-a997-bd7450da2701 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:08.268447 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c8f192-82c0-48c3-a997-bd7450da2701 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:08.304701 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 268/529] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Sep 19 14:42:08 2022] POST /identity/v3/users => generated 247 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:42:08.305724 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7527687c-3cd7-406c-a16f-bb870b15aa8c None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:08.306209 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c8f192-82c0-48c3-a997-bd7450da2701 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:08.366625 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b464df15-716e-459b-bf0d-396752cc8541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:08.367182 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b464df15-716e-459b-bf0d-396752cc8541 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:08.367454 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b464df15-716e-459b-bf0d-396752cc8541 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:08.367718 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b464df15-716e-459b-bf0d-396752cc8541 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:08.372012 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:08.384022 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b464df15-716e-459b-bf0d-396752cc8541 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:08.387118 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b464df15-716e-459b-bf0d-396752cc8541 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:08.404984 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-b464df15-716e-459b-bf0d-396752cc8541 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:42:08.404984 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:08.404984 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:08.404984 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:08.404984 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:08.404984 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:08.404984 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:08.404984 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:08.404984 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:08.404984 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:08.404984 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:08.404984 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:08.404984 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:42:08.404984 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:42:08.404984 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:42:08.406034 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:42:08.406034 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:08.406034 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:08.406034 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:08.406034 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:08.406034 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:08.406034 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:08.406034 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:08.406034 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:08.406034 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:08.406034 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:08.406034 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:08.406034 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:08.406034 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:08.406034 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:08.406034 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:08.406034 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:08.406934 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:42:08.406934 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:42:08.406934 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:42:08.406934 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:42:08.406934 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:42:08.406934 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:42:08.406934 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:42:08.406934 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:42:08.406934 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 262/530] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 19 14:42:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:08.407419 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b464df15-716e-459b-bf0d-396752cc8541 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:08.452831 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:08.477819 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c8f192-82c0-48c3-a997-bd7450da2701 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:08.537226 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d42ade1-4c64-44c7-af75-4fdad04e7cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:08.538309 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d42ade1-4c64-44c7-af75-4fdad04e7cde None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:08.538744 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d42ade1-4c64-44c7-af75-4fdad04e7cde None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:08.539022 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d42ade1-4c64-44c7-af75-4fdad04e7cde None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:08.555799 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d42ade1-4c64-44c7-af75-4fdad04e7cde None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:08.558912 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d42ade1-4c64-44c7-af75-4fdad04e7cde None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:08.565803 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b464df15-716e-459b-bf0d-396752cc8541 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:08.582748 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-0d42ade1-4c64-44c7-af75-4fdad04e7cde None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:08.582748 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:08.582748 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:08.582748 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:08.582748 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:08.582748 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:08.582748 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:08.582748 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:08.582748 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:08.582748 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:08.582748 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:08.582748 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:08.582748 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:42:08.582748 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:42:08.582748 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:42:08.582748 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:42:08.583838 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:08.583838 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:08.583838 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:08.583838 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:08.583838 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:08.583838 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:08.583838 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:08.583838 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:08.583838 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:08.583838 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:08.583838 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:08.583838 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:08.583838 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:08.583838 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:08.583838 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:08.583838 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:08.583838 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:42:08.584710 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:42:08.584710 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:08.584710 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:08.586538 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 269/531] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:42:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:08.587727 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d42ade1-4c64-44c7-af75-4fdad04e7cde None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:08.613397 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b945ac2e-592e-42e4-b5b3-f3a7ab7890e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:08.613783 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945ac2e-592e-42e4-b5b3-f3a7ab7890e6 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:08.614086 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945ac2e-592e-42e4-b5b3-f3a7ab7890e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:08.614541 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945ac2e-592e-42e4-b5b3-f3a7ab7890e6 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:08.615453 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b945ac2e-592e-42e4-b5b3-f3a7ab7890e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:08.615762 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b945ac2e-592e-42e4-b5b3-f3a7ab7890e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:08.617351 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b945ac2e-592e-42e4-b5b3-f3a7ab7890e6 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:08.635727 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 263/532] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 19 14:42:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:08.635727 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b945ac2e-592e-42e4-b5b3-f3a7ab7890e6 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:08.704675 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:08.723499 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d42ade1-4c64-44c7-af75-4fdad04e7cde None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:08.759294 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:08.777600 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463667e8-e64f-4f93-b2b7-c626a56ada8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:08.778594 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463667e8-e64f-4f93-b2b7-c626a56ada8e None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:08.778977 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b945ac2e-592e-42e4-b5b3-f3a7ab7890e6 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:08.779283 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463667e8-e64f-4f93-b2b7-c626a56ada8e None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:08.779714 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463667e8-e64f-4f93-b2b7-c626a56ada8e None admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:08.780863 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463667e8-e64f-4f93-b2b7-c626a56ada8e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:08.781380 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463667e8-e64f-4f93-b2b7-c626a56ada8e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:08.783994 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463667e8-e64f-4f93-b2b7-c626a56ada8e None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:08.805283 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 270/533] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 19 14:42:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:08.806366 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463667e8-e64f-4f93-b2b7-c626a56ada8e None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:08.819811 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cbf2aa-baff-4343-8c7a-53dc8d7fc1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:08.820820 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cbf2aa-baff-4343-8c7a-53dc8d7fc1a0 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:08.821361 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cbf2aa-baff-4343-8c7a-53dc8d7fc1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:08.821821 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cbf2aa-baff-4343-8c7a-53dc8d7fc1a0 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:08.822658 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cbf2aa-baff-4343-8c7a-53dc8d7fc1a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:08.823160 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cbf2aa-baff-4343-8c7a-53dc8d7fc1a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:08.824925 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cbf2aa-baff-4343-8c7a-53dc8d7fc1a0 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:08.837655 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 264/534] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 19 14:42:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:08.838743 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cbf2aa-baff-4343-8c7a-53dc8d7fc1a0 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:08.928960 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463667e8-e64f-4f93-b2b7-c626a56ada8e None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:08.967274 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade10c7a-3a47-4a51-b23b-90736d4d2f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:08.968320 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade10c7a-3a47-4a51-b23b-90736d4d2f34 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:08.968603 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade10c7a-3a47-4a51-b23b-90736d4d2f34 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:08.968969 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade10c7a-3a47-4a51-b23b-90736d4d2f34 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:08.976363 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade10c7a-3a47-4a51-b23b-90736d4d2f34 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:08.977849 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade10c7a-3a47-4a51-b23b-90736d4d2f34 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:08.989952 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cbf2aa-baff-4343-8c7a-53dc8d7fc1a0 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:08.991342 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-ade10c7a-3a47-4a51-b23b-90736d4d2f34 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:42:08.991342 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:08.991342 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:08.991342 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:08.991342 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:08.991342 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:08.991342 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:08.991342 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:08.991342 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:08.991342 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:08.991342 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:08.991342 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:08.991342 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:42:08.991342 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:42:08.991342 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:42:08.992115 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:42:08.992115 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:08.992115 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:08.992115 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:08.992115 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:08.992115 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:08.992115 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:08.992115 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:08.992115 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:08.992115 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:08.992115 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:08.992115 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:08.992115 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:08.992115 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:08.992115 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:08.992115 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:08.992115 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:08.992958 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:42:08.992958 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:42:08.992958 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:42:08.992958 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:42:08.992958 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:42:08.992958 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:42:08.992958 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:42:08.992958 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:08.992958 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 271/535] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 19 14:42:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:08.993858 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade10c7a-3a47-4a51-b23b-90736d4d2f34 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:09.013461 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:09.029273 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074f3a8c-5129-4c11-af58-abf262aa69ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:09.029893 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f3a8c-5129-4c11-af58-abf262aa69ab None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:09.030170 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f3a8c-5129-4c11-af58-abf262aa69ab None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:09.030512 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f3a8c-5129-4c11-af58-abf262aa69ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:09.031159 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074f3a8c-5129-4c11-af58-abf262aa69ab None admin] RBAC: Adding query filter params (role.id=3d5d4018951045e18e7577ee742c10ca, scope.project.id=9ede5dc59ece4d9282867a99e94c4c41, user.id=df648c909ddb41418128b43f925f5ed4) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:09.031463 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074f3a8c-5129-4c11-af58-abf262aa69ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:09.033340 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074f3a8c-5129-4c11-af58-abf262aa69ab None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:09.045019 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 265/536] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 19 14:42:08 2022] GET /identity/v3/role_assignments?user.id=df648c909ddb41418128b43f925f5ed4&scope.project.id=9ede5dc59ece4d9282867a99e94c4c41&role.id=3d5d4018951045e18e7577ee742c10ca => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:09.045019 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074f3a8c-5129-4c11-af58-abf262aa69ab None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:09.066805 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:09.163991 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074f3a8c-5129-4c11-af58-abf262aa69ab None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:09.171263 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade10c7a-3a47-4a51-b23b-90736d4d2f34 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:09.217062 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a47db9a-fc87-4aee-bac6-d6aeb9092e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:09.217910 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a47db9a-fc87-4aee-bac6-d6aeb9092e00 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:09.218188 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a47db9a-fc87-4aee-bac6-d6aeb9092e00 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:09.218456 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a47db9a-fc87-4aee-bac6-d6aeb9092e00 None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:09.222216 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a47db9a-fc87-4aee-bac6-d6aeb9092e00 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:09.222527 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a47db9a-fc87-4aee-bac6-d6aeb9092e00 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:09.224028 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a47db9a-fc87-4aee-bac6-d6aeb9092e00 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:09.236915 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0a7fc4-c9ce-44b5-b788-b6067a7a89da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:09.241978 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0a7fc4-c9ce-44b5-b788-b6067a7a89da None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:09.242261 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0a7fc4-c9ce-44b5-b788-b6067a7a89da None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:09.242584 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0a7fc4-c9ce-44b5-b788-b6067a7a89da None admin] PATH_INFO: `/v3/projects/service` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:09.252067 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0a7fc4-c9ce-44b5-b788-b6067a7a89da None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:09.261633 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0a7fc4-c9ce-44b5-b788-b6067a7a89da None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:09.272056 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 266/537] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 19 14:42:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:09.278062 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a47db9a-fc87-4aee-bac6-d6aeb9092e00 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:09.286054 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-4e0a7fc4-c9ce-44b5-b788-b6067a7a89da None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:42:09.286054 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:09.286054 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:09.286054 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:09.286054 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:09.286054 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:09.286054 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:09.286054 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:09.286054 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:09.286054 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:09.286054 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:09.286054 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:09.286054 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:42:09.286054 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:42:09.286054 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:42:09.286940 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:42:09.286940 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:09.286940 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:09.286940 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:09.286940 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:09.286940 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:09.286940 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:09.286940 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:09.286940 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:09.286940 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:09.286940 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:09.286940 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:09.286940 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:09.286940 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:09.286940 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:09.286940 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:09.286940 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:09.287778 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:42:09.287778 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:42:09.287778 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:42:09.287778 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:42:09.287778 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:42:09.287778 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:42:09.287778 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:42:09.287778 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:09.292058 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 272/538] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 19 14:42:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:09.295772 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0a7fc4-c9ce-44b5-b788-b6067a7a89da None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:09.422502 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:09.438969 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:09.480383 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a47db9a-fc87-4aee-bac6-d6aeb9092e00 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:09.504422 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0a7fc4-c9ce-44b5-b788-b6067a7a89da None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:09.545836 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9a8a83-ebdc-453d-a32e-dedf795d6649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:09.546438 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a8a83-ebdc-453d-a32e-dedf795d6649 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:09.546823 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a8a83-ebdc-453d-a32e-dedf795d6649 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:09.547093 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a8a83-ebdc-453d-a32e-dedf795d6649 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:09.547820 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9a8a83-ebdc-453d-a32e-dedf795d6649 None admin] RBAC: Adding query filter params (role.id=3d5d4018951045e18e7577ee742c10ca, scope.project.id=9ede5dc59ece4d9282867a99e94c4c41, user.id=f5d4e9c3da83402dbe7938aaf2dcbb8f) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:09.548118 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9a8a83-ebdc-453d-a32e-dedf795d6649 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:09.549588 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9a8a83-ebdc-453d-a32e-dedf795d6649 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:09.563556 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 267/539] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 19 14:42:09 2022] GET /identity/v3/role_assignments?user.id=f5d4e9c3da83402dbe7938aaf2dcbb8f&scope.project.id=9ede5dc59ece4d9282867a99e94c4c41&role.id=3d5d4018951045e18e7577ee742c10ca => generated 259 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:09.577618 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371262f3-2256-45b2-85c7-fd2d34331738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:09.578327 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371262f3-2256-45b2-85c7-fd2d34331738 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:09.578491 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371262f3-2256-45b2-85c7-fd2d34331738 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:09.578747 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371262f3-2256-45b2-85c7-fd2d34331738 None admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:09.579495 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371262f3-2256-45b2-85c7-fd2d34331738 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:09.579800 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371262f3-2256-45b2-85c7-fd2d34331738 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:09.581252 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371262f3-2256-45b2-85c7-fd2d34331738 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:09.602546 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 273/540] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 19 14:42:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:09.609177 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9a8a83-ebdc-453d-a32e-dedf795d6649 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:09.759877 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9a8a83-ebdc-453d-a32e-dedf795d6649 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:09.803876 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485737d7-dae7-415e-9f31-246abe6ad67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:09.804543 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485737d7-dae7-415e-9f31-246abe6ad67d None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:09.804819 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485737d7-dae7-415e-9f31-246abe6ad67d None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:09.805117 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485737d7-dae7-415e-9f31-246abe6ad67d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:09.805860 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485737d7-dae7-415e-9f31-246abe6ad67d None admin] RBAC: Adding query filter params (role.id=3d5d4018951045e18e7577ee742c10ca, scope.project.id=9ede5dc59ece4d9282867a99e94c4c41, user.id=d20a0d24e7034b6db447ba842ac986dd) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:09.806164 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485737d7-dae7-415e-9f31-246abe6ad67d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:09.807820 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485737d7-dae7-415e-9f31-246abe6ad67d None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:09.810735 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:09.823064 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 268/541] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 19 14:42:09 2022] GET /identity/v3/role_assignments?user.id=d20a0d24e7034b6db447ba842ac986dd&scope.project.id=9ede5dc59ece4d9282867a99e94c4c41&role.id=3d5d4018951045e18e7577ee742c10ca => generated 259 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:10.044972 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466be538-03bf-44e7-a325-ca3fb9870ccc None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:10.045661 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466be538-03bf-44e7-a325-ca3fb9870ccc None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:10.046162 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466be538-03bf-44e7-a325-ca3fb9870ccc None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:10.048137 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 274/542] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:42:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:42:10.054131 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86d8f84-b441-47ee-b290-7db1dcffedaa None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:10.054687 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86d8f84-b441-47ee-b290-7db1dcffedaa None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:10.055162 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86d8f84-b441-47ee-b290-7db1dcffedaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:10.082099 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-b86d8f84-b441-47ee-b290-7db1dcffedaa None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:42:10.083360 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b86d8f84-b441-47ee-b290-7db1dcffedaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:42:10.186924 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 269/543] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:42:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:42:10.612914 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466be538-03bf-44e7-a325-ca3fb9870ccc None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:10.751742 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466be538-03bf-44e7-a325-ca3fb9870ccc None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:10.783700 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:10.793415 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffb9544-1f6c-4a6f-a9f5-b7944fc40dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:10.794088 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffb9544-1f6c-4a6f-a9f5-b7944fc40dad None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:10.794369 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffb9544-1f6c-4a6f-a9f5-b7944fc40dad None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:10.794642 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffb9544-1f6c-4a6f-a9f5-b7944fc40dad None admin] PATH_INFO: `/v3/roles/service` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:10.813858 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffb9544-1f6c-4a6f-a9f5-b7944fc40dad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:42:10.818952 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-3ffb9544-1f6c-4a6f-a9f5-b7944fc40dad None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:42:10.818952 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:10.818952 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:10.818952 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:10.818952 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:10.818952 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:10.818952 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:10.818952 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:10.818952 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:10.818952 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:10.818952 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:10.818952 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:10.818952 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:42:10.818952 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:42:10.818952 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:42:10.818952 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:42:10.819853 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:42:10.819853 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:42:10.819853 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:42:10.819853 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:42:10.819853 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:10.819853 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:10.819853 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:10.819853 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:10.819853 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:10.819853 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:10.819853 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:10.819853 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:10.819853 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:10.819853 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:10.819853 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:10.819853 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:10.820663 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:10.820663 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:10.820663 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:10.820663 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:10.820663 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:42:10.820663 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:42:10.820663 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:42:10.820663 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:42:10.820663 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:42:10.820663 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:42:10.820663 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:42:10.820663 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:10.820663 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 275/544] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Sep 19 14:42:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:10.826495 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86d8f84-b441-47ee-b290-7db1dcffedaa None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:10.853637 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc020ff-0c83-43f2-941f-e3b6d808d145 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:10.853974 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc020ff-0c83-43f2-941f-e3b6d808d145 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:10.854180 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc020ff-0c83-43f2-941f-e3b6d808d145 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:10.856661 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 276/545] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:42:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 14:42:10.870187 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e87982-887f-4906-9c1c-185a8752bea6 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:10.870448 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e87982-887f-4906-9c1c-185a8752bea6 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:10.870759 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e87982-887f-4906-9c1c-185a8752bea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:10.908820 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-33e87982-887f-4906-9c1c-185a8752bea6 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:42:10.911519 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-33e87982-887f-4906-9c1c-185a8752bea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:42:11.041353 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 277/546] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:42:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:42:11.048042 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86d8f84-b441-47ee-b290-7db1dcffedaa None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:11.087296 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:11.100430 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da60c85-e0d1-439d-bd75-28da4485b852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:11.101130 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da60c85-e0d1-439d-bd75-28da4485b852 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:11.101346 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da60c85-e0d1-439d-bd75-28da4485b852 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:11.101617 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da60c85-e0d1-439d-bd75-28da4485b852 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:11.102285 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da60c85-e0d1-439d-bd75-28da4485b852 None admin] RBAC: Adding query filter params (name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:11.102584 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da60c85-e0d1-439d-bd75-28da4485b852 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:11.103955 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da60c85-e0d1-439d-bd75-28da4485b852 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:11.119226 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 270/547] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Sep 19 14:42:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:11.125372 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e87982-887f-4906-9c1c-185a8752bea6 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:11.249399 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e87982-887f-4906-9c1c-185a8752bea6 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:11.274661 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:11.296523 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7111c836-b02b-421b-a8d6-d32d9e6f76aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:11.297189 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7111c836-b02b-421b-a8d6-d32d9e6f76aa None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:11.297466 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7111c836-b02b-421b-a8d6-d32d9e6f76aa None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:11.297792 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7111c836-b02b-421b-a8d6-d32d9e6f76aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:11.309027 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7111c836-b02b-421b-a8d6-d32d9e6f76aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:11.310272 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7111c836-b02b-421b-a8d6-d32d9e6f76aa None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:11.330495 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-7111c836-b02b-421b-a8d6-d32d9e6f76aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:11.330495 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:11.330495 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:11.330495 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:11.330495 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:11.330495 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:11.330495 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:11.330495 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:11.330495 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:11.330495 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:11.330495 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:11.330495 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:11.330495 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:42:11.330495 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:42:11.330495 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:42:11.330495 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:42:11.331416 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:11.331416 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:11.331416 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:11.331416 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:11.331416 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:11.331416 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:11.331416 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:11.331416 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:11.331416 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:11.331416 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:11.331416 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:11.331416 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:11.331416 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:11.331416 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:11.331416 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:11.331416 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:11.331416 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:42:11.332232 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:42:11.332232 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:11.332232 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:11.332232 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 278/548] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:42:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:11.341812 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da60c85-e0d1-439d-bd75-28da4485b852 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:11.382854 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7111c836-b02b-421b-a8d6-d32d9e6f76aa None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:11.548847 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da60c85-e0d1-439d-bd75-28da4485b852 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:11.549636 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7111c836-b02b-421b-a8d6-d32d9e6f76aa None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:11.590651 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ca2efe-48d3-41c0-b81b-d0de31577111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:11.591780 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca2efe-48d3-41c0-b81b-d0de31577111 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:11.593442 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca2efe-48d3-41c0-b81b-d0de31577111 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:11.596511 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca2efe-48d3-41c0-b81b-d0de31577111 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:11.614061 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ca2efe-48d3-41c0-b81b-d0de31577111 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:42:11.620108 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-a2ca2efe-48d3-41c0-b81b-d0de31577111 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:42:11.620108 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:11.620108 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:11.620108 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:11.620108 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:11.620108 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:11.620108 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:11.620108 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:11.620108 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:11.620108 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:11.620108 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:11.620108 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:11.620108 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:42:11.620108 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:42:11.620108 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:42:11.620108 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:42:11.622271 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:42:11.622271 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:42:11.622271 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:42:11.622271 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:42:11.622271 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:11.622271 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:11.622271 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:11.622271 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:11.622271 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:11.622271 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:11.622271 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:11.622271 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:11.622271 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:11.622271 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:11.622271 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:11.622271 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:11.623229 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:11.623229 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:11.623229 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:11.623229 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:11.623229 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:42:11.623229 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:42:11.623229 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:42:11.623229 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:42:11.623229 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:42:11.623229 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:42:11.623229 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:42:11.623229 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:11.625890 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 279/549] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Sep 19 14:42:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:42:11.631984 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ca2efe-48d3-41c0-b81b-d0de31577111 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:11.647142 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1ee7b0-2ca3-43a4-a045-77b85398d64d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:11.647685 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ee7b0-2ca3-43a4-a045-77b85398d64d None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:11.647965 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ee7b0-2ca3-43a4-a045-77b85398d64d None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:11.648237 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ee7b0-2ca3-43a4-a045-77b85398d64d None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:11.648895 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1ee7b0-2ca3-43a4-a045-77b85398d64d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:11.653383 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1ee7b0-2ca3-43a4-a045-77b85398d64d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:11.654855 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1ee7b0-2ca3-43a4-a045-77b85398d64d None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:11.669364 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:11.679491 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 271/550] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 19 14:42:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:11.685203 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1ee7b0-2ca3-43a4-a045-77b85398d64d None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:11.748799 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ca2efe-48d3-41c0-b81b-d0de31577111 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:11.789483 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbede6f-95cc-41f8-acaa-a7ac2d1c78e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:11.790560 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbede6f-95cc-41f8-acaa-a7ac2d1c78e5 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:11.791734 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbede6f-95cc-41f8-acaa-a7ac2d1c78e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:11.792414 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbede6f-95cc-41f8-acaa-a7ac2d1c78e5 None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:11.795358 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbede6f-95cc-41f8-acaa-a7ac2d1c78e5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:11.795910 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbede6f-95cc-41f8-acaa-a7ac2d1c78e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:11.797552 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbede6f-95cc-41f8-acaa-a7ac2d1c78e5 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:11.808671 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:11.818751 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 280/551] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Sep 19 14:42:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:11.830905 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbede6f-95cc-41f8-acaa-a7ac2d1c78e5 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:11.910228 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1ee7b0-2ca3-43a4-a045-77b85398d64d None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:11.951027 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02caf88b-abdd-47e5-9037-f004de0eedcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:11.951659 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02caf88b-abdd-47e5-9037-f004de0eedcc None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:11.951934 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02caf88b-abdd-47e5-9037-f004de0eedcc None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:11.952217 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02caf88b-abdd-47e5-9037-f004de0eedcc None admin] PATH_INFO: `/v3/users/nova` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:11.959932 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02caf88b-abdd-47e5-9037-f004de0eedcc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:11.961416 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02caf88b-abdd-47e5-9037-f004de0eedcc None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:11.965487 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:11.974351 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-02caf88b-abdd-47e5-9037-f004de0eedcc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 19 14:42:11.974351 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:11.974351 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:11.974351 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:11.974351 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:11.974351 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:11.974351 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:11.974351 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:11.974351 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:11.974351 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:11.974351 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:11.974351 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:11.974351 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:42:11.974351 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:42:11.974351 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:42:11.974351 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:42:11.975410 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:11.975410 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:11.975410 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:42:11.975410 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:42:11.975410 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:42:11.975410 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:42:11.975410 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:11.975410 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:11.975410 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:11.975410 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:11.975410 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:11.975410 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:11.975410 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:11.975410 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:11.975410 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:11.975410 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:11.975410 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:11.975410 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:11.976301 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:11.976301 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:11.976301 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:42:11.976301 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:42:11.976301 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:42:11.976301 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:42:11.976301 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:42:11.976301 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:42:11.976301 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 19 14:42:11.976301 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:42:11.977589 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbede6f-95cc-41f8-acaa-a7ac2d1c78e5 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:11.981775 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 272/552] 10.222.0.26 () {56 vars in 1093 bytes} [Mon Sep 19 14:42:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:42:11.981926 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b579f29b-b35c-4c2c-b6d6-55da5cf74030 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:11.982173 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b579f29b-b35c-4c2c-b6d6-55da5cf74030 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:11.982448 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b579f29b-b35c-4c2c-b6d6-55da5cf74030 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:11.984431 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 273/553] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:42:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:42:11.990668 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b579f29b-b35c-4c2c-b6d6-55da5cf74030 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:12.021329 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13570ecc-bb97-4056-b1b5-d822c162a56d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:12.022383 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13570ecc-bb97-4056-b1b5-d822c162a56d None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:12.022873 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13570ecc-bb97-4056-b1b5-d822c162a56d None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:12.023341 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13570ecc-bb97-4056-b1b5-d822c162a56d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:12.038517 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13570ecc-bb97-4056-b1b5-d822c162a56d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:12.040396 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13570ecc-bb97-4056-b1b5-d822c162a56d None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:12.057604 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-13570ecc-bb97-4056-b1b5-d822c162a56d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:12.057604 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:12.057604 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:12.057604 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:12.057604 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:12.057604 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:12.057604 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:12.057604 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:12.057604 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:12.057604 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:12.057604 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:12.057604 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:12.057604 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:42:12.057604 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:42:12.057604 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:42:12.057604 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:42:12.059357 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:12.059357 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:12.059357 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:12.059357 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:12.059357 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:12.059357 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:12.059357 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:12.059357 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:12.059357 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:12.059357 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:12.059357 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:12.059357 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:12.059357 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:12.059357 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:12.059357 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:12.059357 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:12.059357 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:42:12.060210 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:42:12.060210 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:12.060210 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:12.066790 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 281/554] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:42:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:42:12.068737 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5548bd-d83d-450c-9f67-11e344a255a6 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:12.069265 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5548bd-d83d-450c-9f67-11e344a255a6 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:12.069733 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5548bd-d83d-450c-9f67-11e344a255a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:12.090685 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-8a5548bd-d83d-450c-9f67-11e344a255a6 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:42:12.092207 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-8a5548bd-d83d-450c-9f67-11e344a255a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:42:12.110947 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b579f29b-b35c-4c2c-b6d6-55da5cf74030 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:12.123220 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:12.149450 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0065a0c-dc62-4cb3-aefe-ebfe03915d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:12.150048 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0065a0c-dc62-4cb3-aefe-ebfe03915d77 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:12.150332 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0065a0c-dc62-4cb3-aefe-ebfe03915d77 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:12.150599 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0065a0c-dc62-4cb3-aefe-ebfe03915d77 None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:12.151337 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0065a0c-dc62-4cb3-aefe-ebfe03915d77 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:12.151639 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0065a0c-dc62-4cb3-aefe-ebfe03915d77 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:12.153868 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0065a0c-dc62-4cb3-aefe-ebfe03915d77 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:12.168601 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 282/555] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:42:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:42:12.169831 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5548bd-d83d-450c-9f67-11e344a255a6 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:12.177027 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 274/556] 10.222.0.26 () {56 vars in 1133 bytes} [Mon Sep 19 14:42:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:12.177027 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3653887-164a-4d79-92dc-bef9e87b3164 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:12.177027 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3653887-164a-4d79-92dc-bef9e87b3164 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:12.177027 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3653887-164a-4d79-92dc-bef9e87b3164 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:12.177027 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 275/557] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:42:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:42:12.185109 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3653887-164a-4d79-92dc-bef9e87b3164 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:12.259273 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:12.286471 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5548bd-d83d-450c-9f67-11e344a255a6 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:12.306642 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3653887-164a-4d79-92dc-bef9e87b3164 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:12.327838 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae08c429-f9e2-478f-8a44-4a15220ec4c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:12.328764 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae08c429-f9e2-478f-8a44-4a15220ec4c3 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:12.329367 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae08c429-f9e2-478f-8a44-4a15220ec4c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:12.329824 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae08c429-f9e2-478f-8a44-4a15220ec4c3 None admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:12.330727 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae08c429-f9e2-478f-8a44-4a15220ec4c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:12.331212 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae08c429-f9e2-478f-8a44-4a15220ec4c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:12.332852 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae08c429-f9e2-478f-8a44-4a15220ec4c3 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:12.346346 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 283/558] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 19 14:42:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:12.347808 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c4b7c-391f-47f4-8b8e-cc90f9cb84c4 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:12.348288 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c4b7c-391f-47f4-8b8e-cc90f9cb84c4 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:12.348728 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c4b7c-391f-47f4-8b8e-cc90f9cb84c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:12.348830 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc24e3ec-dce2-42d0-998c-cda783983fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:12.349541 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc24e3ec-dce2-42d0-998c-cda783983fc5 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:12.350048 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc24e3ec-dce2-42d0-998c-cda783983fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:12.350403 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc24e3ec-dce2-42d0-998c-cda783983fc5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:12.362695 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc24e3ec-dce2-42d0-998c-cda783983fc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:12.364548 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc24e3ec-dce2-42d0-998c-cda783983fc5 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:12.369999 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-818c4b7c-391f-47f4-8b8e-cc90f9cb84c4 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:42:12.372196 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-818c4b7c-391f-47f4-8b8e-cc90f9cb84c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:42:12.381341 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-cc24e3ec-dce2-42d0-998c-cda783983fc5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:12.381341 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:12.381341 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:12.381341 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:12.381341 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:12.381341 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:12.381341 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:12.381341 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:12.381341 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:12.381341 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:12.381341 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:12.381341 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:12.381341 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:42:12.381341 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:42:12.381341 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:42:12.381341 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:42:12.382289 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:12.382289 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:12.382289 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:12.382289 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:12.382289 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:12.382289 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:12.382289 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:12.382289 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:12.382289 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:12.382289 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:12.382289 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:12.382289 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:12.382289 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:12.382289 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:12.382289 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:12.382289 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:12.382289 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:42:12.383165 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:42:12.383165 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:12.383165 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:42:12.387572 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 276/559] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:42:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:12.388238 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc24e3ec-dce2-42d0-998c-cda783983fc5 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:12.412693 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:12.449273 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 284/560] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:42:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:42:12.450494 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818c4b7c-391f-47f4-8b8e-cc90f9cb84c4 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:12.506286 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc24e3ec-dce2-42d0-998c-cda783983fc5 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:12.523908 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:12.540506 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cd34f4-72b2-49c1-9320-afffe7ab0eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:12.541159 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cd34f4-72b2-49c1-9320-afffe7ab0eec None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:12.541438 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cd34f4-72b2-49c1-9320-afffe7ab0eec None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:12.541709 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cd34f4-72b2-49c1-9320-afffe7ab0eec None admin] PATH_INFO: `/v3/users/swift` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:12.549525 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cd34f4-72b2-49c1-9320-afffe7ab0eec None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:12.550961 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cd34f4-72b2-49c1-9320-afffe7ab0eec None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:12.560290 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818c4b7c-391f-47f4-8b8e-cc90f9cb84c4 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:12.562960 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-b5cd34f4-72b2-49c1-9320-afffe7ab0eec None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 19 14:42:12.562960 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:12.562960 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:12.562960 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:12.562960 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:12.562960 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:12.562960 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:12.562960 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:12.562960 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:12.562960 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:12.562960 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:12.562960 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:12.562960 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:42:12.562960 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:42:12.562960 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:42:12.562960 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:42:12.563964 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:12.563964 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:12.563964 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:42:12.563964 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:42:12.563964 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:42:12.563964 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:42:12.563964 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:12.563964 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:12.563964 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:12.563964 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:12.563964 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:12.563964 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:12.563964 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:12.563964 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:12.563964 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:12.563964 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:12.563964 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:12.563964 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:12.564868 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:12.564868 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:12.564868 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:42:12.564868 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:42:12.564868 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:42:12.564868 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:42:12.564868 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:42:12.564868 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:42:12.564868 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 19 14:42:12.564868 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:42:12.564868 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 277/561] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 19 14:42:12 2022] GET /identity/v3/users/swift => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:12.565506 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38cfc24-4188-42f2-9db5-b5acdda0cef8 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:12.565506 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38cfc24-4188-42f2-9db5-b5acdda0cef8 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:12.565967 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38cfc24-4188-42f2-9db5-b5acdda0cef8 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:12.570831 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 278/562] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:42:12 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:42:12.570831 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38cfc24-4188-42f2-9db5-b5acdda0cef8 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:12.607951 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2748c0-21ae-4107-a345-d614d61731a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:12.608711 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2748c0-21ae-4107-a345-d614d61731a3 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:12.608977 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2748c0-21ae-4107-a345-d614d61731a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:12.610060 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2748c0-21ae-4107-a345-d614d61731a3 None admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:12.610717 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2748c0-21ae-4107-a345-d614d61731a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:12.611018 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2748c0-21ae-4107-a345-d614d61731a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:12.612405 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2748c0-21ae-4107-a345-d614d61731a3 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:12.630660 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 285/563] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 19 14:42:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:12.631384 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2748c0-21ae-4107-a345-d614d61731a3 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:12.664455 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:12.687131 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38cfc24-4188-42f2-9db5-b5acdda0cef8 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:12.725333 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1ae6e1-ff65-48f9-be28-3d30346ecaf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:12.725878 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ae6e1-ff65-48f9-be28-3d30346ecaf6 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:12.726152 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ae6e1-ff65-48f9-be28-3d30346ecaf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:12.726419 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ae6e1-ff65-48f9-be28-3d30346ecaf6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:12.736336 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2748c0-21ae-4107-a345-d614d61731a3 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:12.737328 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1ae6e1-ff65-48f9-be28-3d30346ecaf6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:42:12.742155 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-0e1ae6e1-ff65-48f9-be28-3d30346ecaf6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:42:12.742155 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:12.742155 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:12.742155 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:12.742155 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:12.742155 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:12.742155 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:12.742155 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:12.742155 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:12.742155 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:12.742155 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:12.742155 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:12.742155 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:42:12.742155 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:42:12.742155 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:42:12.742155 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:42:12.743204 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:42:12.743204 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:42:12.743204 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:42:12.743204 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:42:12.743204 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:12.743204 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:12.743204 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:12.743204 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:12.743204 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:12.743204 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:12.743204 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:12.743204 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:12.743204 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:12.743204 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:12.743204 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:12.743204 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:12.744048 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:12.744048 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:12.744048 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:12.744048 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:12.744048 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:42:12.744048 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:42:12.744048 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:42:12.744048 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:42:12.744048 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:42:12.744048 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:42:12.744048 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:42:12.744048 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:42:12.744048 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 279/564] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Sep 19 14:42:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:12.744714 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af9ac1d-d2b0-4f3c-b714-92fa01316069 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:12.744786 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af9ac1d-d2b0-4f3c-b714-92fa01316069 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:12.745086 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af9ac1d-d2b0-4f3c-b714-92fa01316069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:12.763314 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-1af9ac1d-d2b0-4f3c-b714-92fa01316069 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:42:12.764548 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-1af9ac1d-d2b0-4f3c-b714-92fa01316069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:42:12.765216 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:12.775261 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ed4125-b449-4c21-bb1b-fa9f8a2019ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:12.775984 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ed4125-b449-4c21-bb1b-fa9f8a2019ff None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:12.776260 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ed4125-b449-4c21-bb1b-fa9f8a2019ff None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:12.776526 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ed4125-b449-4c21-bb1b-fa9f8a2019ff None admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:12.777346 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ed4125-b449-4c21-bb1b-fa9f8a2019ff None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:12.777657 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ed4125-b449-4c21-bb1b-fa9f8a2019ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:12.779125 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ed4125-b449-4c21-bb1b-fa9f8a2019ff None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:12.798964 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 286/565] 10.222.0.26 () {56 vars in 1135 bytes} [Mon Sep 19 14:42:12 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:12.799826 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ed4125-b449-4c21-bb1b-fa9f8a2019ff None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:12.844998 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 280/566] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:42:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:42:12.845855 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af9ac1d-d2b0-4f3c-b714-92fa01316069 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:12.910768 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ed4125-b449-4c21-bb1b-fa9f8a2019ff None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:12.918749 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:12.946891 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2b3ac2-c5b3-45c1-8f75-a7bf6538055f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:12.947616 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b3ac2-c5b3-45c1-8f75-a7bf6538055f None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:12.947899 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b3ac2-c5b3-45c1-8f75-a7bf6538055f None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:12.948166 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b3ac2-c5b3-45c1-8f75-a7bf6538055f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:12.951020 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af9ac1d-d2b0-4f3c-b714-92fa01316069 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:12.955763 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2b3ac2-c5b3-45c1-8f75-a7bf6538055f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:12.957272 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2b3ac2-c5b3-45c1-8f75-a7bf6538055f None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:12.969421 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-bc2b3ac2-c5b3-45c1-8f75-a7bf6538055f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:42:12.969421 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:12.969421 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:12.969421 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:12.969421 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:12.969421 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:12.969421 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:12.969421 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:12.969421 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:12.969421 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:12.969421 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:12.969421 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:12.969421 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:42:12.969421 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:42:12.969421 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:42:12.970328 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:42:12.970328 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:12.970328 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:12.970328 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:12.970328 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:12.970328 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:12.970328 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:12.970328 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:12.970328 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:12.970328 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:12.970328 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:12.970328 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:12.970328 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:12.970328 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:12.970328 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:12.970328 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:12.970328 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:12.971221 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:42:12.971221 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:42:12.971221 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:42:12.971221 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:42:12.971221 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:42:12.971221 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:42:12.971221 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:42:12.971221 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:12.971221 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 287/567] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 19 14:42:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:12.971725 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2b3ac2-c5b3-45c1-8f75-a7bf6538055f None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:12.996106 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5259eaa6-a300-42e3-ae2b-41f0440a4f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:12.996815 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5259eaa6-a300-42e3-ae2b-41f0440a4f46 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:12.997133 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5259eaa6-a300-42e3-ae2b-41f0440a4f46 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:12.997399 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5259eaa6-a300-42e3-ae2b-41f0440a4f46 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:13.008903 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5259eaa6-a300-42e3-ae2b-41f0440a4f46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:42:13.013923 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-5259eaa6-a300-42e3-ae2b-41f0440a4f46 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:42:13.013923 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:13.013923 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:13.013923 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:13.013923 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:13.013923 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:13.013923 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:13.013923 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:13.013923 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:13.013923 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:13.013923 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:13.013923 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:13.013923 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:42:13.013923 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:42:13.013923 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:42:13.013923 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:42:13.015189 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:42:13.015189 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:42:13.015189 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:42:13.015189 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:42:13.015189 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:13.015189 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:13.015189 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:13.015189 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:13.015189 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:13.015189 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:13.015189 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:13.015189 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:13.015189 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:13.015189 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:13.015189 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:13.015189 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:13.016044 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:13.016044 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:13.016044 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:13.016044 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:13.016044 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:42:13.016044 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:42:13.016044 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:42:13.016044 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:42:13.016044 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:42:13.016044 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:42:13.016044 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:42:13.016044 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:42:13.016044 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 281/568] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Sep 19 14:42:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:13.016714 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5259eaa6-a300-42e3-ae2b-41f0440a4f46 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:13.029239 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:13.085809 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2b3ac2-c5b3-45c1-8f75-a7bf6538055f None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:13.121777 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf03e9b4-da12-41f9-8189-3c82908b22dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:13.122379 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf03e9b4-da12-41f9-8189-3c82908b22dd None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:13.122651 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf03e9b4-da12-41f9-8189-3c82908b22dd None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:13.122926 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf03e9b4-da12-41f9-8189-3c82908b22dd None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:13.123586 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf03e9b4-da12-41f9-8189-3c82908b22dd None admin] RBAC: Adding query filter params (name=service) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:13.123889 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf03e9b4-da12-41f9-8189-3c82908b22dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:13.125276 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf03e9b4-da12-41f9-8189-3c82908b22dd None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:13.126114 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5259eaa6-a300-42e3-ae2b-41f0440a4f46 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:13.133988 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 288/569] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Sep 19 14:42:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:13.134829 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf03e9b4-da12-41f9-8189-3c82908b22dd None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:13.160899 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:13.166830 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a221de7f-47bf-448c-a579-a8c6e380828f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:13.167447 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221de7f-47bf-448c-a579-a8c6e380828f None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:13.167766 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221de7f-47bf-448c-a579-a8c6e380828f None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:13.168041 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221de7f-47bf-448c-a579-a8c6e380828f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:13.236752 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf03e9b4-da12-41f9-8189-3c82908b22dd None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:13.238651 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a221de7f-47bf-448c-a579-a8c6e380828f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:13.240155 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a221de7f-47bf-448c-a579-a8c6e380828f None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:13.244365 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:13.276253 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1444d687-61bc-4244-8c7c-fbe9c5f8af7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:13.276897 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1444d687-61bc-4244-8c7c-fbe9c5f8af7e None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:13.277323 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1444d687-61bc-4244-8c7c-fbe9c5f8af7e None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:13.277937 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1444d687-61bc-4244-8c7c-fbe9c5f8af7e None admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:13.278825 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1444d687-61bc-4244-8c7c-fbe9c5f8af7e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:13.279256 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1444d687-61bc-4244-8c7c-fbe9c5f8af7e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:13.281317 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1444d687-61bc-4244-8c7c-fbe9c5f8af7e None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:13.295212 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 289/570] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 19 14:42:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:13.295820 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1444d687-61bc-4244-8c7c-fbe9c5f8af7e None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:13.365598 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 282/571] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 19 14:42:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:42:13.366447 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a221de7f-47bf-448c-a579-a8c6e380828f None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:13.397314 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:13.402929 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1444d687-61bc-4244-8c7c-fbe9c5f8af7e None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:13.437700 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0400a4c5-4505-4fae-9351-903da22586e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:13.438307 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0400a4c5-4505-4fae-9351-903da22586e8 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:13.438591 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0400a4c5-4505-4fae-9351-903da22586e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:13.438856 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0400a4c5-4505-4fae-9351-903da22586e8 None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:13.439531 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0400a4c5-4505-4fae-9351-903da22586e8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:13.439843 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0400a4c5-4505-4fae-9351-903da22586e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:13.441306 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0400a4c5-4505-4fae-9351-903da22586e8 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:13.450246 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 290/572] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Sep 19 14:42:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:13.451027 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0400a4c5-4505-4fae-9351-903da22586e8 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:13.469422 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a221de7f-47bf-448c-a579-a8c6e380828f None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:13.483881 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:13.505276 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579426d0-fad9-4d82-8db8-0461b7db7f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:13.505930 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579426d0-fad9-4d82-8db8-0461b7db7f85 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:13.506205 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579426d0-fad9-4d82-8db8-0461b7db7f85 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:13.506481 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579426d0-fad9-4d82-8db8-0461b7db7f85 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:13.516942 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579426d0-fad9-4d82-8db8-0461b7db7f85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:42:13.521755 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-579426d0-fad9-4d82-8db8-0461b7db7f85 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:42:13.521755 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:13.521755 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:13.521755 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:13.521755 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:13.521755 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:13.521755 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:13.521755 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:13.521755 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:13.521755 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:13.521755 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:13.521755 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:13.521755 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:42:13.521755 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:42:13.521755 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:42:13.521755 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:42:13.522805 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:42:13.522805 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:42:13.522805 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:42:13.522805 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:42:13.522805 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:13.522805 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:13.522805 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:13.522805 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:13.522805 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:13.522805 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:13.522805 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:13.522805 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:13.522805 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:13.522805 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:13.522805 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:13.522805 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:13.523659 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:13.523659 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:13.523659 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:13.523659 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:13.523659 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:42:13.523659 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:42:13.523659 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:42:13.523659 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:42:13.523659 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:42:13.523659 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:42:13.523659 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:42:13.523659 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:42:13.523659 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 283/573] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Sep 19 14:42:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:13.523659 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579426d0-fad9-4d82-8db8-0461b7db7f85 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:13.560006 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0400a4c5-4505-4fae-9351-903da22586e8 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:13.595942 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e08c46-c3e4-475c-ba7f-7418d76bc5bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:13.596562 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e08c46-c3e4-475c-ba7f-7418d76bc5bd None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:13.596837 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e08c46-c3e4-475c-ba7f-7418d76bc5bd None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:13.597135 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e08c46-c3e4-475c-ba7f-7418d76bc5bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:13.610162 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e08c46-c3e4-475c-ba7f-7418d76bc5bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:13.611636 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e08c46-c3e4-475c-ba7f-7418d76bc5bd None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:13.620258 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:13.626081 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-00e08c46-c3e4-475c-ba7f-7418d76bc5bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:13.626081 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:13.626081 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:13.626081 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:13.626081 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:13.626081 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:13.626081 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:13.626081 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:13.626081 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:13.626081 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:13.626081 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:13.626081 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:13.626081 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:42:13.626081 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:42:13.626081 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:42:13.626081 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:42:13.627039 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:13.627039 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:13.627039 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:13.627039 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:13.627039 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:13.627039 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:13.627039 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:13.627039 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:13.627039 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:13.627039 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:13.627039 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:13.627039 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:13.627039 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:13.627039 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:13.627039 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:13.627039 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:13.627039 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:42:13.627918 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:42:13.627918 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:13.627918 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:13.627918 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 291/574] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:42:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:13.627918 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e08c46-c3e4-475c-ba7f-7418d76bc5bd None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:13.635602 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579426d0-fad9-4d82-8db8-0461b7db7f85 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:13.671857 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c5e656-5670-44a2-9981-d226b3924005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:13.672472 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c5e656-5670-44a2-9981-d226b3924005 None admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:13.672748 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c5e656-5670-44a2-9981-d226b3924005 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:13.673038 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c5e656-5670-44a2-9981-d226b3924005 None admin] PATH_INFO: `/v3/projects/9ede5dc59ece4d9282867a99e94c4c41/users/3017e5d92bef4cc2aeae4f28c78ba233/roles/3d5d4018951045e18e7577ee742c10ca` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:13.689293 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c5e656-5670-44a2-9981-d226b3924005 None admin] RBAC: Authorizing `identity:create_grant(project_id=9ede5dc59ece4d9282867a99e94c4c41, user_id=3017e5d92bef4cc2aeae4f28c78ba233, role_id=3d5d4018951045e18e7577ee742c10ca)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:13.690753 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c5e656-5670-44a2-9981-d226b3924005 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:13.705818 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 284/575] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Sep 19 14:42:13 2022] PUT /identity/v3/projects/9ede5dc59ece4d9282867a99e94c4c41/users/3017e5d92bef4cc2aeae4f28c78ba233/roles/3d5d4018951045e18e7577ee742c10ca => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:42:13.706683 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c5e656-5670-44a2-9981-d226b3924005 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:13.724817 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:13.753914 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e08c46-c3e4-475c-ba7f-7418d76bc5bd None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:13.797970 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f790e6-979b-4f03-b117-0e706f842a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:13.798620 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f790e6-979b-4f03-b117-0e706f842a3a None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:13.798897 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f790e6-979b-4f03-b117-0e706f842a3a None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:13.799176 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f790e6-979b-4f03-b117-0e706f842a3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:13.812315 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f790e6-979b-4f03-b117-0e706f842a3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:13.814150 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f790e6-979b-4f03-b117-0e706f842a3a None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:13.829679 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-a0f790e6-979b-4f03-b117-0e706f842a3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:13.829679 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:13.829679 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:13.829679 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:13.829679 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:13.829679 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:13.829679 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:13.829679 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:13.829679 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:13.829679 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:13.829679 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:13.829679 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:13.829679 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:42:13.829679 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:42:13.829679 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:42:13.829679 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:42:13.830809 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:13.830809 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:13.830809 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:13.830809 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:13.830809 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:13.830809 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:13.830809 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:13.830809 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:13.830809 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:13.830809 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:13.830809 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:13.830809 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:13.830809 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:13.830809 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:13.830809 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:13.830809 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:13.830809 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:42:13.831799 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:42:13.831799 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:13.831799 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:13.837852 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 292/576] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:42:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:13.838320 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c5e656-5670-44a2-9981-d226b3924005 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:13.839207 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f790e6-979b-4f03-b117-0e706f842a3a None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:13.880549 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfdb8ac-c5ec-467d-b4df-bcb0f31af401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:13.882521 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfdb8ac-c5ec-467d-b4df-bcb0f31af401 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:13.882813 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfdb8ac-c5ec-467d-b4df-bcb0f31af401 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:13.883089 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfdb8ac-c5ec-467d-b4df-bcb0f31af401 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:13.896916 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:13.899338 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfdb8ac-c5ec-467d-b4df-bcb0f31af401 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:13.901053 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfdb8ac-c5ec-467d-b4df-bcb0f31af401 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:13.917659 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-0cfdb8ac-c5ec-467d-b4df-bcb0f31af401 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:13.917659 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:13.917659 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:13.917659 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:13.917659 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:13.917659 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:13.917659 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:13.917659 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:13.917659 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:13.917659 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:13.917659 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:13.917659 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:13.917659 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:42:13.917659 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:42:13.917659 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:42:13.917659 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:42:13.918771 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:13.918771 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:13.918771 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:13.918771 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:13.918771 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:13.918771 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:13.918771 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:13.918771 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:13.918771 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:13.918771 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:13.918771 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:13.918771 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:13.918771 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:13.918771 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:13.918771 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:13.918771 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:13.918771 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:42:13.919644 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:42:13.919644 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:13.919644 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:42:13.919644 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 285/577] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:42:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:13.919644 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfdb8ac-c5ec-467d-b4df-bcb0f31af401 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:13.962962 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f790e6-979b-4f03-b117-0e706f842a3a None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:14.001104 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:14.007770 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49fa937-e570-45c5-9a76-6a251bba554f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:14.008380 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49fa937-e570-45c5-9a76-6a251bba554f None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:14.008654 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49fa937-e570-45c5-9a76-6a251bba554f None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:14.008922 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49fa937-e570-45c5-9a76-6a251bba554f None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:14.009785 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49fa937-e570-45c5-9a76-6a251bba554f None admin] RBAC: Adding query filter params (name=service) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:14.009939 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49fa937-e570-45c5-9a76-6a251bba554f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:14.011308 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49fa937-e570-45c5-9a76-6a251bba554f None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:14.025512 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 293/578] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Sep 19 14:42:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:14.026348 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49fa937-e570-45c5-9a76-6a251bba554f None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:14.035754 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfdb8ac-c5ec-467d-b4df-bcb0f31af401 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:14.074330 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39207c14-3f6b-4afb-b9bb-57269e9424c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:14.074876 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39207c14-3f6b-4afb-b9bb-57269e9424c9 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:14.075158 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39207c14-3f6b-4afb-b9bb-57269e9424c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:14.075428 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39207c14-3f6b-4afb-b9bb-57269e9424c9 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:14.076087 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39207c14-3f6b-4afb-b9bb-57269e9424c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:14.076395 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39207c14-3f6b-4afb-b9bb-57269e9424c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:14.077854 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39207c14-3f6b-4afb-b9bb-57269e9424c9 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:14.091875 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 286/579] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 19 14:42:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:14.096931 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39207c14-3f6b-4afb-b9bb-57269e9424c9 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:14.146947 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49fa937-e570-45c5-9a76-6a251bba554f None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:14.151025 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:14.188371 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f47863e-0e17-4239-8e22-d36d90bf3aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:14.188974 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f47863e-0e17-4239-8e22-d36d90bf3aee None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:14.189281 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f47863e-0e17-4239-8e22-d36d90bf3aee None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:14.189828 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f47863e-0e17-4239-8e22-d36d90bf3aee None admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:14.190194 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f47863e-0e17-4239-8e22-d36d90bf3aee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:14.190490 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f47863e-0e17-4239-8e22-d36d90bf3aee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:14.191874 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f47863e-0e17-4239-8e22-d36d90bf3aee None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:14.202488 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39207c14-3f6b-4afb-b9bb-57269e9424c9 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:14.205608 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 294/580] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 19 14:42:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:14.206665 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f47863e-0e17-4239-8e22-d36d90bf3aee None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:14.240072 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338bc120-56cf-4e64-98bf-2619a83b5cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:14.240678 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338bc120-56cf-4e64-98bf-2619a83b5cbe None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:14.240959 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338bc120-56cf-4e64-98bf-2619a83b5cbe None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:14.241273 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338bc120-56cf-4e64-98bf-2619a83b5cbe None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:14.241921 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338bc120-56cf-4e64-98bf-2619a83b5cbe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:14.242225 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338bc120-56cf-4e64-98bf-2619a83b5cbe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:14.243688 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338bc120-56cf-4e64-98bf-2619a83b5cbe None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:14.257749 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 287/581] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 19 14:42:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:14.258701 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338bc120-56cf-4e64-98bf-2619a83b5cbe None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:14.273286 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:14.324850 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f47863e-0e17-4239-8e22-d36d90bf3aee None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:14.363002 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f285fc30-4a86-440e-9e55-9a58b457f39b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:14.363606 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f285fc30-4a86-440e-9e55-9a58b457f39b None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:14.363886 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f285fc30-4a86-440e-9e55-9a58b457f39b None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:14.364169 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f285fc30-4a86-440e-9e55-9a58b457f39b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:14.368897 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338bc120-56cf-4e64-98bf-2619a83b5cbe None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:14.376255 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f285fc30-4a86-440e-9e55-9a58b457f39b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:14.377862 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f285fc30-4a86-440e-9e55-9a58b457f39b None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:14.382688 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:14.396702 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-f285fc30-4a86-440e-9e55-9a58b457f39b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:14.396702 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:14.396702 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:14.396702 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:14.396702 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:14.396702 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:14.396702 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:14.396702 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:14.396702 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:14.396702 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:14.396702 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:14.396702 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:14.396702 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:42:14.396702 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:42:14.396702 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:42:14.396702 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:42:14.397749 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:14.397749 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:14.397749 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:14.397749 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:14.397749 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:14.397749 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:14.397749 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:14.397749 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:14.397749 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:14.397749 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:14.397749 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:14.397749 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:14.397749 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:14.397749 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:14.397749 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:14.397749 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:14.397749 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:42:14.398628 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:42:14.398628 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:14.398628 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:14.398628 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 295/582] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:42:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:14.398844 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f285fc30-4a86-440e-9e55-9a58b457f39b None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:14.411358 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c14820-71cb-422a-8899-8f894f6dd344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:14.411993 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c14820-71cb-422a-8899-8f894f6dd344 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:14.412282 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c14820-71cb-422a-8899-8f894f6dd344 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:14.412553 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c14820-71cb-422a-8899-8f894f6dd344 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:14.421411 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c14820-71cb-422a-8899-8f894f6dd344 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:14.422878 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c14820-71cb-422a-8899-8f894f6dd344 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:14.436654 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-61c14820-71cb-422a-8899-8f894f6dd344 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 19 14:42:14.436654 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:14.436654 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:14.436654 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:14.436654 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:14.436654 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:14.436654 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:14.436654 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:14.436654 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:14.436654 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:14.436654 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:14.436654 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:14.436654 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:42:14.436654 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:42:14.436654 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:42:14.436654 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:42:14.437965 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:14.437965 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:14.437965 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:42:14.437965 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:42:14.437965 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:42:14.437965 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:42:14.437965 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:14.437965 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:14.437965 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:14.437965 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:14.437965 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:14.437965 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:14.437965 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:14.437965 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:14.437965 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:14.437965 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:14.437965 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:14.437965 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:14.438916 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:14.438916 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:14.438916 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:42:14.438916 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:42:14.438916 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:42:14.438916 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:42:14.438916 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:42:14.438916 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:42:14.438916 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 19 14:42:14.438916 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:42:14.438916 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 288/583] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 19 14:42:14 2022] GET /identity/v3/users/cinder => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:14.438916 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c14820-71cb-422a-8899-8f894f6dd344 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:14.520585 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f285fc30-4a86-440e-9e55-9a58b457f39b None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:14.529267 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:14.549346 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c14820-71cb-422a-8899-8f894f6dd344 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:14.559241 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81028389-6209-4acc-9d7d-7e34b8c0e318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:14.560249 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81028389-6209-4acc-9d7d-7e34b8c0e318 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:14.560543 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81028389-6209-4acc-9d7d-7e34b8c0e318 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:14.560819 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81028389-6209-4acc-9d7d-7e34b8c0e318 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:14.568115 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81028389-6209-4acc-9d7d-7e34b8c0e318 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:14.569735 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81028389-6209-4acc-9d7d-7e34b8c0e318 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:14.581443 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-81028389-6209-4acc-9d7d-7e34b8c0e318 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:42:14.581443 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:14.581443 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:14.581443 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:14.581443 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:14.581443 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:14.581443 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:14.581443 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:14.581443 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:14.581443 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:14.581443 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:14.581443 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:14.581443 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:42:14.581443 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:42:14.581443 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:42:14.582395 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:42:14.582395 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:14.582395 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:14.582395 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:14.582395 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:14.582395 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:14.582395 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:14.582395 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:14.582395 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:14.582395 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:14.582395 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:14.582395 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:14.582395 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:14.582395 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:14.582395 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:14.582395 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:14.582395 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:14.583269 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:42:14.583269 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:42:14.583269 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:42:14.583269 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:42:14.583269 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:42:14.583269 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:42:14.583269 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:42:14.583269 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:14.583269 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 296/584] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 19 14:42:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:14.583769 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81028389-6209-4acc-9d7d-7e34b8c0e318 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:14.596173 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a381994-a660-4734-8dce-657ba3cb5c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:14.596825 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a381994-a660-4734-8dce-657ba3cb5c4f None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:14.597137 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a381994-a660-4734-8dce-657ba3cb5c4f None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:14.597861 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a381994-a660-4734-8dce-657ba3cb5c4f None admin] PATH_INFO: `/v3/users/glance` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:14.607964 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a381994-a660-4734-8dce-657ba3cb5c4f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:14.609486 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a381994-a660-4734-8dce-657ba3cb5c4f None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:14.622893 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-8a381994-a660-4734-8dce-657ba3cb5c4f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 19 14:42:14.622893 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:14.622893 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:14.622893 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:14.622893 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:14.622893 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:14.622893 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:14.622893 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:14.622893 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:14.622893 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:14.622893 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:14.622893 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:14.622893 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:42:14.622893 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:42:14.622893 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:42:14.622893 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:42:14.623869 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:14.623869 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:14.623869 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:42:14.623869 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:42:14.623869 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:42:14.623869 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:42:14.623869 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:14.623869 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:14.623869 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:14.623869 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:14.623869 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:14.623869 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:14.623869 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:14.623869 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:14.623869 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:14.623869 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:14.623869 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:14.623869 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:14.629904 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:14.629904 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:14.629904 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:42:14.629904 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:42:14.629904 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:42:14.629904 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:42:14.629904 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:42:14.629904 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:42:14.629904 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 19 14:42:14.629904 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:42:14.629904 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 289/585] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 19 14:42:14 2022] GET /identity/v3/users/glance => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:14.629904 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a381994-a660-4734-8dce-657ba3cb5c4f None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:14.659794 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:14.702663 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81028389-6209-4acc-9d7d-7e34b8c0e318 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:14.733202 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a381994-a660-4734-8dce-657ba3cb5c4f None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:14.739768 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3407db3f-77f7-499e-9fcb-16d5e53c5084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:14.740452 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3407db3f-77f7-499e-9fcb-16d5e53c5084 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:14.740793 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3407db3f-77f7-499e-9fcb-16d5e53c5084 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:14.741097 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3407db3f-77f7-499e-9fcb-16d5e53c5084 None admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:14.741738 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3407db3f-77f7-499e-9fcb-16d5e53c5084 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:14.742035 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3407db3f-77f7-499e-9fcb-16d5e53c5084 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:14.743395 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3407db3f-77f7-499e-9fcb-16d5e53c5084 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:14.756519 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 297/586] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 19 14:42:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:14.762641 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3407db3f-77f7-499e-9fcb-16d5e53c5084 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:14.770277 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0e37cb-2498-4279-9485-8e0344c859c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:14.770880 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e37cb-2498-4279-9485-8e0344c859c4 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:14.771152 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e37cb-2498-4279-9485-8e0344c859c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:14.771419 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e37cb-2498-4279-9485-8e0344c859c4 None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:14.772132 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0e37cb-2498-4279-9485-8e0344c859c4 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:14.772440 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0e37cb-2498-4279-9485-8e0344c859c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:14.773921 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0e37cb-2498-4279-9485-8e0344c859c4 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:14.791345 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 290/587] 10.222.0.26 () {56 vars in 1137 bytes} [Mon Sep 19 14:42:14 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:14.792163 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0e37cb-2498-4279-9485-8e0344c859c4 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:14.801296 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:14.883080 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3407db3f-77f7-499e-9fcb-16d5e53c5084 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:14.898553 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:14.909699 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0e37cb-2498-4279-9485-8e0344c859c4 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:14.924471 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f0194d-96d1-47af-a5f5-01cde8955c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:14.925078 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f0194d-96d1-47af-a5f5-01cde8955c71 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:14.925347 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f0194d-96d1-47af-a5f5-01cde8955c71 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:14.925644 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f0194d-96d1-47af-a5f5-01cde8955c71 None admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:14.926328 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f0194d-96d1-47af-a5f5-01cde8955c71 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:14.926602 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f0194d-96d1-47af-a5f5-01cde8955c71 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:14.928055 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f0194d-96d1-47af-a5f5-01cde8955c71 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:14.941026 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 298/588] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 19 14:42:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:14.942047 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f0194d-96d1-47af-a5f5-01cde8955c71 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:14.952733 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afb61a4-50b0-4ec5-9a63-acafcef48644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:14.953550 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb61a4-50b0-4ec5-9a63-acafcef48644 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:14.953904 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb61a4-50b0-4ec5-9a63-acafcef48644 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:14.954175 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb61a4-50b0-4ec5-9a63-acafcef48644 None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:14.954909 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afb61a4-50b0-4ec5-9a63-acafcef48644 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:14.955209 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afb61a4-50b0-4ec5-9a63-acafcef48644 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:14.956838 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afb61a4-50b0-4ec5-9a63-acafcef48644 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:14.976037 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 291/589] 10.222.0.26 () {56 vars in 1137 bytes} [Mon Sep 19 14:42:14 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:14.977045 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afb61a4-50b0-4ec5-9a63-acafcef48644 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:15.045756 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:15.064452 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f0194d-96d1-47af-a5f5-01cde8955c71 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:15.095079 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afb61a4-50b0-4ec5-9a63-acafcef48644 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:15.101892 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297875c6-82ea-4ac1-bd10-276a680f5f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:15.102548 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297875c6-82ea-4ac1-bd10-276a680f5f6e None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:15.102823 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297875c6-82ea-4ac1-bd10-276a680f5f6e None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:15.103116 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297875c6-82ea-4ac1-bd10-276a680f5f6e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:15.111251 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297875c6-82ea-4ac1-bd10-276a680f5f6e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:15.112682 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297875c6-82ea-4ac1-bd10-276a680f5f6e None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:15.124117 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-297875c6-82ea-4ac1-bd10-276a680f5f6e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 19 14:42:15.124117 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:15.124117 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:15.124117 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:15.124117 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:15.124117 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:15.124117 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:15.124117 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:15.124117 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:15.124117 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:15.124117 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:15.124117 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:15.124117 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:42:15.124117 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:42:15.124117 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:42:15.124117 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:42:15.125049 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:15.125049 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:15.125049 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:42:15.125049 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:42:15.125049 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:42:15.125049 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:42:15.125049 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:15.125049 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:15.125049 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:15.125049 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:15.125049 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:15.125049 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:15.125049 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:15.125049 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:15.125049 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:15.125049 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:15.125049 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:15.125049 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:15.126084 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:15.126084 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:15.126084 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:42:15.126084 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:42:15.126084 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:42:15.126084 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:42:15.126084 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:42:15.126084 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:42:15.126084 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 19 14:42:15.126084 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:15.130092 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 299/590] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Sep 19 14:42:14 2022] GET /identity/v3/users/neutron => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:15.130955 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297875c6-82ea-4ac1-bd10-276a680f5f6e None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:15.137977 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600f670b-70e2-4d6d-a8c0-2eaef5e26c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:15.138820 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f670b-70e2-4d6d-a8c0-2eaef5e26c77 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:15.139231 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f670b-70e2-4d6d-a8c0-2eaef5e26c77 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:15.139654 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f670b-70e2-4d6d-a8c0-2eaef5e26c77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:15.153343 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600f670b-70e2-4d6d-a8c0-2eaef5e26c77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:15.155180 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600f670b-70e2-4d6d-a8c0-2eaef5e26c77 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:15.164478 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:15.172636 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-600f670b-70e2-4d6d-a8c0-2eaef5e26c77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:15.172636 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:15.172636 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:15.172636 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:15.172636 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:15.172636 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:15.172636 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:15.172636 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:15.172636 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:15.172636 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:15.172636 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:15.172636 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:15.172636 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:42:15.172636 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:42:15.172636 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:42:15.172636 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:42:15.173797 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:15.173797 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:15.173797 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:15.173797 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:15.173797 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:15.173797 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:15.173797 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:15.173797 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:15.173797 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:15.173797 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:15.173797 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:15.173797 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:15.173797 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:15.173797 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:15.173797 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:15.173797 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:15.173797 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:42:15.174871 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:42:15.174871 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:15.174871 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:42:15.177045 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 292/591] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:42:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:15.182493 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600f670b-70e2-4d6d-a8c0-2eaef5e26c77 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:15.239577 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297875c6-82ea-4ac1-bd10-276a680f5f6e None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:15.278320 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82777050-5efd-4e1f-b537-975ed8166773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:15.279057 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82777050-5efd-4e1f-b537-975ed8166773 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:15.279403 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82777050-5efd-4e1f-b537-975ed8166773 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:15.279692 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82777050-5efd-4e1f-b537-975ed8166773 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:15.280419 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82777050-5efd-4e1f-b537-975ed8166773 None admin] RBAC: Adding query filter params (role.id=3d5d4018951045e18e7577ee742c10ca, scope.project.id=9ede5dc59ece4d9282867a99e94c4c41, user.id=76cb60a5e90343e69a38db4356cb3a90) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:15.280707 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82777050-5efd-4e1f-b537-975ed8166773 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:15.282209 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82777050-5efd-4e1f-b537-975ed8166773 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:15.288067 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 300/592] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 19 14:42:15 2022] GET /identity/v3/role_assignments?user.id=76cb60a5e90343e69a38db4356cb3a90&scope.project.id=9ede5dc59ece4d9282867a99e94c4c41&role.id=3d5d4018951045e18e7577ee742c10ca => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:15.288682 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82777050-5efd-4e1f-b537-975ed8166773 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:15.300143 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600f670b-70e2-4d6d-a8c0-2eaef5e26c77 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:15.302935 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:15.362041 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43b565f-bcb2-4f36-b249-5f9dd62acb5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:15.363689 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43b565f-bcb2-4f36-b249-5f9dd62acb5a None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:15.364459 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43b565f-bcb2-4f36-b249-5f9dd62acb5a None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:15.364957 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43b565f-bcb2-4f36-b249-5f9dd62acb5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:15.380598 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43b565f-bcb2-4f36-b249-5f9dd62acb5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:15.381963 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43b565f-bcb2-4f36-b249-5f9dd62acb5a None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:15.398333 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-a43b565f-bcb2-4f36-b249-5f9dd62acb5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:15.398333 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:15.398333 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:15.398333 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:15.398333 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:15.398333 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:15.398333 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:15.398333 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:15.398333 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:15.398333 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:15.398333 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:15.398333 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:15.398333 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:42:15.398333 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:42:15.398333 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:42:15.398333 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:42:15.399319 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:15.399319 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:15.399319 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:15.399319 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:15.399319 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:15.399319 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:15.399319 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:15.399319 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:15.399319 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:15.399319 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:15.399319 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:15.399319 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:15.399319 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:15.399319 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:15.399319 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:15.399319 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:15.399319 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:42:15.400224 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:42:15.400224 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:15.400224 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:42:15.400224 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 293/593] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:42:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:15.401194 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43b565f-bcb2-4f36-b249-5f9dd62acb5a None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:15.420111 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82777050-5efd-4e1f-b537-975ed8166773 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:15.462343 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:15.474965 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511c519a-effa-49ce-92c1-701491d83635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:15.476549 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c519a-effa-49ce-92c1-701491d83635 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:15.477024 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c519a-effa-49ce-92c1-701491d83635 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:15.477443 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c519a-effa-49ce-92c1-701491d83635 None admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:15.478333 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511c519a-effa-49ce-92c1-701491d83635 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:15.478806 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511c519a-effa-49ce-92c1-701491d83635 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:15.480949 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511c519a-effa-49ce-92c1-701491d83635 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:15.509666 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 301/594] 10.222.0.26 () {56 vars in 1139 bytes} [Mon Sep 19 14:42:15 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:15.511451 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511c519a-effa-49ce-92c1-701491d83635 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:15.530865 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43b565f-bcb2-4f36-b249-5f9dd62acb5a None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:15.575231 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f6dbbb-f607-4221-8095-219c185fffeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:15.575845 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f6dbbb-f607-4221-8095-219c185fffeb None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:15.576121 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f6dbbb-f607-4221-8095-219c185fffeb None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:15.576392 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f6dbbb-f607-4221-8095-219c185fffeb None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:15.577064 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f6dbbb-f607-4221-8095-219c185fffeb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:15.577370 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f6dbbb-f607-4221-8095-219c185fffeb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:15.579332 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f6dbbb-f607-4221-8095-219c185fffeb None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:15.597005 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:15.601070 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 294/595] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 19 14:42:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:15.601070 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f6dbbb-f607-4221-8095-219c185fffeb None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:15.642497 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511c519a-effa-49ce-92c1-701491d83635 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:15.680113 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd29d7e-eba5-47e9-921e-e99cacfe1f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:15.680754 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd29d7e-eba5-47e9-921e-e99cacfe1f32 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:15.681053 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd29d7e-eba5-47e9-921e-e99cacfe1f32 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:15.681331 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd29d7e-eba5-47e9-921e-e99cacfe1f32 None admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:15.681984 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd29d7e-eba5-47e9-921e-e99cacfe1f32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:15.682282 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd29d7e-eba5-47e9-921e-e99cacfe1f32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:15.683822 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd29d7e-eba5-47e9-921e-e99cacfe1f32 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:15.701227 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 302/596] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 19 14:42:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:15.702175 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd29d7e-eba5-47e9-921e-e99cacfe1f32 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:15.734532 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f6dbbb-f607-4221-8095-219c185fffeb None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:15.752329 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:15.780488 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f485438d-1936-4008-823e-49680746f12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:15.781370 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485438d-1936-4008-823e-49680746f12c None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:15.781844 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485438d-1936-4008-823e-49680746f12c None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:15.782210 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485438d-1936-4008-823e-49680746f12c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:15.795522 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f485438d-1936-4008-823e-49680746f12c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:15.797481 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f485438d-1936-4008-823e-49680746f12c None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:15.815441 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-f485438d-1936-4008-823e-49680746f12c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:15.815441 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:15.815441 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:15.815441 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:15.815441 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:15.815441 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:15.815441 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:15.815441 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:15.815441 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:15.815441 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:15.815441 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:15.815441 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:15.815441 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:42:15.815441 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:42:15.815441 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:42:15.815441 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:42:15.816616 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:15.816616 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:15.816616 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:15.816616 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:15.816616 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:15.816616 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:15.816616 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:15.816616 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:15.816616 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:15.816616 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:15.816616 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:15.816616 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:15.816616 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:15.816616 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:15.816616 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:15.816616 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:15.816616 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:42:15.817766 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:42:15.817766 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:15.817766 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:42:15.823931 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 295/597] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:42:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:15.824818 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd29d7e-eba5-47e9-921e-e99cacfe1f32 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:15.825379 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f485438d-1936-4008-823e-49680746f12c None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:15.856449 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:15.870288 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad2559a-af71-481b-8181-5b381f94673c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:15.871994 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2559a-af71-481b-8181-5b381f94673c None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:15.872368 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2559a-af71-481b-8181-5b381f94673c None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:15.872741 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2559a-af71-481b-8181-5b381f94673c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:15.881842 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad2559a-af71-481b-8181-5b381f94673c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:15.884015 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad2559a-af71-481b-8181-5b381f94673c None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:15.899662 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-2ad2559a-af71-481b-8181-5b381f94673c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:42:15.899662 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:15.899662 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:15.899662 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:15.899662 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:15.899662 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:15.899662 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:15.899662 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:15.899662 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:15.899662 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:15.899662 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:15.899662 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:15.899662 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:42:15.899662 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:42:15.899662 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:42:15.900783 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:42:15.900783 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:15.900783 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:15.900783 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:15.900783 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:15.900783 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:15.900783 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:15.900783 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:15.900783 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:15.900783 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:15.900783 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:15.900783 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:15.900783 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:15.900783 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:15.900783 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:15.900783 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:15.900783 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:15.901930 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:42:15.901930 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:42:15.901930 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:42:15.901930 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:42:15.901930 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:42:15.901930 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:42:15.901930 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:42:15.901930 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:15.903069 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 303/598] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 19 14:42:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:15.907723 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad2559a-af71-481b-8181-5b381f94673c None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:15.942217 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f485438d-1936-4008-823e-49680746f12c None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:15.978644 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653f3d0f-3e18-44dd-bda0-4c2d5faf81d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:15.979260 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653f3d0f-3e18-44dd-bda0-4c2d5faf81d6 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:15.979534 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653f3d0f-3e18-44dd-bda0-4c2d5faf81d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:15.979861 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653f3d0f-3e18-44dd-bda0-4c2d5faf81d6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:15.988827 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653f3d0f-3e18-44dd-bda0-4c2d5faf81d6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:15.990309 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653f3d0f-3e18-44dd-bda0-4c2d5faf81d6 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:16.003904 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-653f3d0f-3e18-44dd-bda0-4c2d5faf81d6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:42:16.003904 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:16.003904 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:16.003904 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:16.003904 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:16.003904 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:16.003904 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:16.003904 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:16.003904 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:16.003904 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:16.003904 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:16.003904 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:16.003904 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:42:16.003904 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:42:16.003904 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:42:16.004954 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:42:16.004954 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:16.004954 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:16.004954 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:16.004954 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:16.004954 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:16.004954 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:16.004954 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:16.004954 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:16.004954 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:16.004954 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:16.004954 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:16.004954 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:16.004954 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:16.004954 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:16.004954 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:16.004954 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:16.005866 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:42:16.005866 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:42:16.005866 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:42:16.005866 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:42:16.005866 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:42:16.005866 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:42:16.005866 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:42:16.005866 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:42:16.005866 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 296/599] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 19 14:42:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:16.006819 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd8214d-85ba-4a7d-802d-bbcd6d41838a None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:16.006819 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd8214d-85ba-4a7d-802d-bbcd6d41838a None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:16.006819 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd8214d-85ba-4a7d-802d-bbcd6d41838a None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:16.007940 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 297/600] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:42:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:42:16.008612 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd8214d-85ba-4a7d-802d-bbcd6d41838a None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:16.026607 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad2559a-af71-481b-8181-5b381f94673c None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:16.035158 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:16.062634 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a895648a-a920-4b85-8d3e-716231d8aee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:16.063300 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a895648a-a920-4b85-8d3e-716231d8aee4 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:16.063550 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a895648a-a920-4b85-8d3e-716231d8aee4 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:16.063842 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a895648a-a920-4b85-8d3e-716231d8aee4 None admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:16.064531 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a895648a-a920-4b85-8d3e-716231d8aee4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:16.064835 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a895648a-a920-4b85-8d3e-716231d8aee4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:16.066368 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a895648a-a920-4b85-8d3e-716231d8aee4 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:16.085347 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 304/601] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 19 14:42:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:16.085347 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a895648a-a920-4b85-8d3e-716231d8aee4 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:16.122534 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd8214d-85ba-4a7d-802d-bbcd6d41838a None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:16.140584 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:16.159091 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c88b96d-f6e6-4565-a186-47188a6f0edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:16.159692 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88b96d-f6e6-4565-a186-47188a6f0edd None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:16.159967 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88b96d-f6e6-4565-a186-47188a6f0edd None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:16.160232 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88b96d-f6e6-4565-a186-47188a6f0edd None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:16.160924 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c88b96d-f6e6-4565-a186-47188a6f0edd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:16.161254 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c88b96d-f6e6-4565-a186-47188a6f0edd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:16.162690 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c88b96d-f6e6-4565-a186-47188a6f0edd None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:16.176354 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 298/602] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 19 14:42:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:16.182290 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7535268f-d9c4-4a34-b93b-4d2d43bb2c8c None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:16.182574 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7535268f-d9c4-4a34-b93b-4d2d43bb2c8c None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:16.182872 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7535268f-d9c4-4a34-b93b-4d2d43bb2c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:16.196902 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a895648a-a920-4b85-8d3e-716231d8aee4 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:16.202143 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-7535268f-d9c4-4a34-b93b-4d2d43bb2c8c None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:42:16.203345 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-7535268f-d9c4-4a34-b93b-4d2d43bb2c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:42:16.236070 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b2b9ee-a918-46fa-9889-d628262fb626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:16.236676 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b2b9ee-a918-46fa-9889-d628262fb626 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:16.236952 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b2b9ee-a918-46fa-9889-d628262fb626 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:16.237308 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b2b9ee-a918-46fa-9889-d628262fb626 None admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:16.238013 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b2b9ee-a918-46fa-9889-d628262fb626 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:16.238311 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b2b9ee-a918-46fa-9889-d628262fb626 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:16.239768 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b2b9ee-a918-46fa-9889-d628262fb626 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:16.259026 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 305/603] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 19 14:42:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:16.259026 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b2b9ee-a918-46fa-9889-d628262fb626 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:16.281315 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 299/604] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:42:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:42:16.293869 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7535268f-d9c4-4a34-b93b-4d2d43bb2c8c None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:16.313438 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:16.365640 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b2b9ee-a918-46fa-9889-d628262fb626 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:16.375630 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:16.403914 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3825643-1709-4336-859d-7a0cf81ac92d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:16.404512 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3825643-1709-4336-859d-7a0cf81ac92d None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:16.404848 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3825643-1709-4336-859d-7a0cf81ac92d None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:16.405208 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3825643-1709-4336-859d-7a0cf81ac92d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:16.412828 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3825643-1709-4336-859d-7a0cf81ac92d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:16.413828 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7535268f-d9c4-4a34-b93b-4d2d43bb2c8c None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:16.414455 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3825643-1709-4336-859d-7a0cf81ac92d None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:16.426472 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-f3825643-1709-4336-859d-7a0cf81ac92d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:42:16.426472 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:16.426472 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:16.426472 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:16.426472 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:16.426472 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:16.426472 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:16.426472 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:16.426472 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:16.426472 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:16.426472 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:16.426472 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:16.426472 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:42:16.426472 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:42:16.426472 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:42:16.427368 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:42:16.427368 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:16.427368 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:16.427368 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:16.427368 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:16.427368 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:16.427368 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:16.427368 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:16.427368 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:16.427368 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:16.427368 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:16.427368 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:16.427368 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:16.427368 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:16.427368 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:16.427368 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:16.427368 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:16.428396 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:42:16.428396 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:42:16.428396 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:42:16.428396 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:42:16.428396 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:42:16.428396 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:42:16.428396 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:42:16.428396 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:16.428396 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 306/605] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 19 14:42:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:16.429065 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3825643-1709-4336-859d-7a0cf81ac92d None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:16.453369 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484d79b6-3234-4bf1-a612-6f72cf7cef69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:16.454387 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484d79b6-3234-4bf1-a612-6f72cf7cef69 None admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:16.454880 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484d79b6-3234-4bf1-a612-6f72cf7cef69 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:16.455482 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484d79b6-3234-4bf1-a612-6f72cf7cef69 None admin] PATH_INFO: `/v3/projects/9ede5dc59ece4d9282867a99e94c4c41/users/df648c909ddb41418128b43f925f5ed4/roles/3d5d4018951045e18e7577ee742c10ca` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:16.470988 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484d79b6-3234-4bf1-a612-6f72cf7cef69 None admin] RBAC: Authorizing `identity:create_grant(project_id=9ede5dc59ece4d9282867a99e94c4c41, user_id=df648c909ddb41418128b43f925f5ed4, role_id=3d5d4018951045e18e7577ee742c10ca)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:16.472751 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484d79b6-3234-4bf1-a612-6f72cf7cef69 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:16.487185 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 300/606] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Sep 19 14:42:16 2022] PUT /identity/v3/projects/9ede5dc59ece4d9282867a99e94c4c41/users/df648c909ddb41418128b43f925f5ed4/roles/3d5d4018951045e18e7577ee742c10ca => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:42:16.488407 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484d79b6-3234-4bf1-a612-6f72cf7cef69 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:16.562245 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3825643-1709-4336-859d-7a0cf81ac92d None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:16.573418 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:16.634965 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b91910-5165-410d-ae53-9f7a29958667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:16.635724 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b91910-5165-410d-ae53-9f7a29958667 None admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:16.636007 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b91910-5165-410d-ae53-9f7a29958667 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:16.636338 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b91910-5165-410d-ae53-9f7a29958667 None admin] PATH_INFO: `/v3/projects/9ede5dc59ece4d9282867a99e94c4c41/users/f5d4e9c3da83402dbe7938aaf2dcbb8f/roles/3d5d4018951045e18e7577ee742c10ca` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:16.642795 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484d79b6-3234-4bf1-a612-6f72cf7cef69 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:16.658750 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b91910-5165-410d-ae53-9f7a29958667 None admin] RBAC: Authorizing `identity:create_grant(project_id=9ede5dc59ece4d9282867a99e94c4c41, user_id=f5d4e9c3da83402dbe7938aaf2dcbb8f, role_id=3d5d4018951045e18e7577ee742c10ca)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:16.661507 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b91910-5165-410d-ae53-9f7a29958667 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:16.683482 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 307/607] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Sep 19 14:42:16 2022] PUT /identity/v3/projects/9ede5dc59ece4d9282867a99e94c4c41/users/f5d4e9c3da83402dbe7938aaf2dcbb8f/roles/3d5d4018951045e18e7577ee742c10ca => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:42:16.684828 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b91910-5165-410d-ae53-9f7a29958667 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:16.686434 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136f718b-0e60-49c9-a77d-cfb2c7005c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:16.687313 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f718b-0e60-49c9-a77d-cfb2c7005c37 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:16.687741 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f718b-0e60-49c9-a77d-cfb2c7005c37 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:16.688199 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f718b-0e60-49c9-a77d-cfb2c7005c37 None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:16.689082 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136f718b-0e60-49c9-a77d-cfb2c7005c37 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:16.689543 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136f718b-0e60-49c9-a77d-cfb2c7005c37 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:16.691314 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136f718b-0e60-49c9-a77d-cfb2c7005c37 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:16.706127 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 301/608] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 19 14:42:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:16.715555 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:16.716647 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136f718b-0e60-49c9-a77d-cfb2c7005c37 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:16.820247 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b91910-5165-410d-ae53-9f7a29958667 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:16.858922 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136f718b-0e60-49c9-a77d-cfb2c7005c37 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:16.861205 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c28a56f-2314-4be4-bf14-c6055376f58f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:16.862382 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c28a56f-2314-4be4-bf14-c6055376f58f None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:16.862877 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c28a56f-2314-4be4-bf14-c6055376f58f None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:16.863288 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c28a56f-2314-4be4-bf14-c6055376f58f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:16.876307 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c28a56f-2314-4be4-bf14-c6055376f58f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:42:16.881972 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-3c28a56f-2314-4be4-bf14-c6055376f58f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:42:16.881972 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:16.881972 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:16.881972 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:16.881972 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:16.881972 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:16.881972 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:16.881972 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:16.881972 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:16.881972 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:16.881972 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:16.881972 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:16.881972 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:42:16.881972 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:42:16.881972 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:42:16.881972 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:42:16.883242 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:42:16.883242 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:42:16.883242 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:42:16.883242 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:42:16.883242 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:16.883242 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:16.883242 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:16.883242 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:16.883242 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:16.883242 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:16.883242 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:16.883242 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:16.883242 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:16.883242 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:16.883242 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:16.883242 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:16.884071 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:16.884071 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:16.884071 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:16.884071 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:16.884071 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:42:16.884071 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:42:16.884071 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:42:16.884071 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:42:16.884071 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:42:16.884071 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:42:16.884071 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:42:16.884071 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:16.887234 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:16.887362 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 308/609] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Sep 19 14:42:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:16.894334 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c28a56f-2314-4be4-bf14-c6055376f58f None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:16.906664 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214f257f-13e1-4b5b-8572-376742224664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:16.907366 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f257f-13e1-4b5b-8572-376742224664 None admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:16.907649 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f257f-13e1-4b5b-8572-376742224664 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:16.907916 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f257f-13e1-4b5b-8572-376742224664 None admin] PATH_INFO: `/v3/projects/9ede5dc59ece4d9282867a99e94c4c41/users/d20a0d24e7034b6db447ba842ac986dd/roles/3d5d4018951045e18e7577ee742c10ca` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:16.929589 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214f257f-13e1-4b5b-8572-376742224664 None admin] RBAC: Authorizing `identity:create_grant(project_id=9ede5dc59ece4d9282867a99e94c4c41, user_id=d20a0d24e7034b6db447ba842ac986dd, role_id=3d5d4018951045e18e7577ee742c10ca)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:16.931663 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214f257f-13e1-4b5b-8572-376742224664 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:16.949664 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 302/610] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Sep 19 14:42:16 2022] PUT /identity/v3/projects/9ede5dc59ece4d9282867a99e94c4c41/users/d20a0d24e7034b6db447ba842ac986dd/roles/3d5d4018951045e18e7577ee742c10ca => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:42:17.000294 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:17.023311 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c28a56f-2314-4be4-bf14-c6055376f58f None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:17.067043 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7295b45-fe17-4ad7-be1d-107ac13654c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:17.067663 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7295b45-fe17-4ad7-be1d-107ac13654c1 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:17.068032 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7295b45-fe17-4ad7-be1d-107ac13654c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:17.068302 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7295b45-fe17-4ad7-be1d-107ac13654c1 None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:17.068974 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7295b45-fe17-4ad7-be1d-107ac13654c1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:17.069354 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7295b45-fe17-4ad7-be1d-107ac13654c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:17.070893 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7295b45-fe17-4ad7-be1d-107ac13654c1 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:17.081078 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 309/611] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Sep 19 14:42:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:42:17.087095 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214f257f-13e1-4b5b-8572-376742224664 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:17.217780 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214f257f-13e1-4b5b-8572-376742224664 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:17.255886 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecec18e-7665-41f6-96a2-62bb5292378b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:17.256438 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecec18e-7665-41f6-96a2-62bb5292378b None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:17.256713 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecec18e-7665-41f6-96a2-62bb5292378b None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:17.256981 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecec18e-7665-41f6-96a2-62bb5292378b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:17.269606 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecec18e-7665-41f6-96a2-62bb5292378b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:17.271068 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecec18e-7665-41f6-96a2-62bb5292378b None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:17.287003 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-9ecec18e-7665-41f6-96a2-62bb5292378b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:17.287003 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:17.287003 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:17.287003 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:17.287003 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:17.287003 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:17.287003 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:17.287003 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:17.287003 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:17.287003 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:17.287003 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:17.287003 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:17.287003 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:42:17.287003 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:42:17.287003 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:42:17.287003 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:42:17.287980 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:17.287980 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:17.287980 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:17.287980 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:17.287980 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:17.287980 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:17.287980 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:17.287980 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:17.287980 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:17.287980 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:17.287980 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:17.287980 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:17.287980 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:17.287980 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:17.287980 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:17.287980 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:17.287980 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:42:17.288844 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:42:17.288844 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:17.288844 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:42:17.288844 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 303/612] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:42:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:17.294591 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7295b45-fe17-4ad7-be1d-107ac13654c1 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:17.441100 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7295b45-fe17-4ad7-be1d-107ac13654c1 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:17.482888 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70408e18-60bb-4d42-b83e-6c5a373f6613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:17.483480 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70408e18-60bb-4d42-b83e-6c5a373f6613 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:17.483750 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70408e18-60bb-4d42-b83e-6c5a373f6613 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:17.484041 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70408e18-60bb-4d42-b83e-6c5a373f6613 None admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:17.484851 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70408e18-60bb-4d42-b83e-6c5a373f6613 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:17.485280 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70408e18-60bb-4d42-b83e-6c5a373f6613 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:17.486987 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70408e18-60bb-4d42-b83e-6c5a373f6613 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:17.498327 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:17.501941 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 310/613] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 19 14:42:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:17.507029 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecec18e-7665-41f6-96a2-62bb5292378b None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:17.558282 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:17.676677 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecec18e-7665-41f6-96a2-62bb5292378b None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:17.724908 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4243549b-a9d7-4691-bf47-b34060657d3c None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:17.725644 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4243549b-a9d7-4691-bf47-b34060657d3c None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:17.726128 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4243549b-a9d7-4691-bf47-b34060657d3c None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:17.727926 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 311/614] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:42:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:42:17.731167 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6da34dc-d5a4-4b1b-bead-2293d56d5ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:17.731803 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da34dc-d5a4-4b1b-bead-2293d56d5ab5 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:17.732080 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da34dc-d5a4-4b1b-bead-2293d56d5ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:17.732351 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da34dc-d5a4-4b1b-bead-2293d56d5ab5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:17.734687 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf0ad5-891c-4235-b3c4-5294595ca264 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:17.734973 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf0ad5-891c-4235-b3c4-5294595ca264 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:17.735245 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf0ad5-891c-4235-b3c4-5294595ca264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:17.740863 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6da34dc-d5a4-4b1b-bead-2293d56d5ab5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:17.742343 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6da34dc-d5a4-4b1b-bead-2293d56d5ab5 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:17.755294 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-d6da34dc-d5a4-4b1b-bead-2293d56d5ab5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 19 14:42:17.755294 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:17.755294 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:17.755294 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:17.755294 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:17.755294 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:17.755294 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:17.755294 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:17.755294 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:17.755294 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:17.755294 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:17.755294 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:17.755294 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:42:17.755294 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:42:17.755294 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:42:17.755294 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:42:17.756426 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:17.756426 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:17.756426 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:42:17.756426 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:42:17.756426 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:42:17.756426 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:42:17.756426 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:17.756426 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:17.756426 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:17.756426 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:17.756426 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:17.756426 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:17.756426 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:17.756426 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:17.756426 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:17.756426 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:17.756426 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:17.756426 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:17.757416 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:17.757416 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:17.757416 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:42:17.757416 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:42:17.757416 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:42:17.757416 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:42:17.757416 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:42:17.757416 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:42:17.757416 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 19 14:42:17.757416 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:42:17.757416 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 304/615] 10.222.0.26 () {56 vars in 1093 bytes} [Mon Sep 19 14:42:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:17.765469 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6da34dc-d5a4-4b1b-bead-2293d56d5ab5 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:17.768821 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-6edf0ad5-891c-4235-b3c4-5294595ca264 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:42:17.770066 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-6edf0ad5-891c-4235-b3c4-5294595ca264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:42:17.873619 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:17.886024 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 312/616] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:42:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:42:17.896808 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6da34dc-d5a4-4b1b-bead-2293d56d5ab5 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:17.931445 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a669bdb4-9bdd-4e61-8973-8c0aebbb894e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:17.932111 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a669bdb4-9bdd-4e61-8973-8c0aebbb894e None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:17.932390 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a669bdb4-9bdd-4e61-8973-8c0aebbb894e None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:17.932658 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a669bdb4-9bdd-4e61-8973-8c0aebbb894e None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:17.934085 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a669bdb4-9bdd-4e61-8973-8c0aebbb894e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:17.934392 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a669bdb4-9bdd-4e61-8973-8c0aebbb894e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:17.935934 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a669bdb4-9bdd-4e61-8973-8c0aebbb894e None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:17.957118 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 305/617] 10.222.0.26 () {56 vars in 1133 bytes} [Mon Sep 19 14:42:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:42:17.966394 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edf0ad5-891c-4235-b3c4-5294595ca264 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:18.113641 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edf0ad5-891c-4235-b3c4-5294595ca264 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:18.150110 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:18.156883 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd78d920-76e6-44c3-806a-d576a873edf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:18.157590 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd78d920-76e6-44c3-806a-d576a873edf4 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:18.158126 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd78d920-76e6-44c3-806a-d576a873edf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:18.158753 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd78d920-76e6-44c3-806a-d576a873edf4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:18.244886 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd78d920-76e6-44c3-806a-d576a873edf4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:18.246443 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd78d920-76e6-44c3-806a-d576a873edf4 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:18.387622 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 313/618] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 19 14:42:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:42:18.392837 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a669bdb4-9bdd-4e61-8973-8c0aebbb894e None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:18.420940 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd78d920-76e6-44c3-806a-d576a873edf4 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:18.478637 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:18.566814 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a669bdb4-9bdd-4e61-8973-8c0aebbb894e None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:18.597442 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd78d920-76e6-44c3-806a-d576a873edf4 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:18.632261 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d385ba22-ec56-4e28-96c4-6437e36be0b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:18.632898 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d385ba22-ec56-4e28-96c4-6437e36be0b7 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:18.633198 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d385ba22-ec56-4e28-96c4-6437e36be0b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:18.633470 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d385ba22-ec56-4e28-96c4-6437e36be0b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:18.654830 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d385ba22-ec56-4e28-96c4-6437e36be0b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:18.656231 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d385ba22-ec56-4e28-96c4-6437e36be0b7 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:18.661439 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:18.669600 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68a0a1d-1327-4c6a-9789-20f9ab8b313c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:18.670245 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68a0a1d-1327-4c6a-9789-20f9ab8b313c None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:18.670521 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68a0a1d-1327-4c6a-9789-20f9ab8b313c None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:18.670791 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68a0a1d-1327-4c6a-9789-20f9ab8b313c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:18.683086 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-d385ba22-ec56-4e28-96c4-6437e36be0b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:18.683086 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:18.683086 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:18.683086 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:18.683086 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:18.683086 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:18.683086 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:18.683086 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:18.683086 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:18.683086 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:18.683086 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:18.683086 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:18.683086 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:42:18.683086 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:42:18.683086 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:42:18.683086 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:42:18.684317 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:18.684317 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:18.684317 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:18.684317 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:18.684317 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:18.684317 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:18.684317 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:18.684317 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:18.684317 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:18.684317 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:18.684317 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:18.684317 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:18.684317 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:18.684317 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:18.684317 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:18.684317 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:18.684317 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:42:18.685360 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:42:18.685360 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:18.685360 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:42:18.686614 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 306/619] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:42:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:18.690779 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d385ba22-ec56-4e28-96c4-6437e36be0b7 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:18.692117 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68a0a1d-1327-4c6a-9789-20f9ab8b313c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:42:18.696902 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-c68a0a1d-1327-4c6a-9789-20f9ab8b313c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:42:18.696902 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:18.696902 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:18.696902 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:18.696902 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:18.696902 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:18.696902 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:18.696902 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:18.696902 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:18.696902 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:18.696902 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:18.696902 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:18.696902 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:42:18.696902 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:42:18.696902 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:42:18.696902 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:42:18.697952 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:42:18.697952 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:42:18.697952 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:42:18.697952 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:42:18.697952 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:18.697952 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:18.697952 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:18.697952 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:18.697952 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:18.697952 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:18.697952 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:18.697952 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:18.697952 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:18.697952 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:18.697952 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:18.697952 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:18.699399 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:18.699399 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:18.699399 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:18.699399 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:18.699399 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:42:18.699399 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:42:18.699399 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:42:18.699399 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:42:18.699399 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:42:18.699399 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:42:18.699399 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:42:18.699399 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:18.705554 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 314/620] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Sep 19 14:42:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:42:18.709430 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68a0a1d-1327-4c6a-9789-20f9ab8b313c None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:18.872093 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d385ba22-ec56-4e28-96c4-6437e36be0b7 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:18.877326 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:18.896936 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68a0a1d-1327-4c6a-9789-20f9ab8b313c None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:18.938434 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9320274-69b5-43a9-a743-5c36ba69fdbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:18.938962 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9320274-69b5-43a9-a743-5c36ba69fdbf None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:18.939248 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9320274-69b5-43a9-a743-5c36ba69fdbf None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:18.939519 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9320274-69b5-43a9-a743-5c36ba69fdbf None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:18.940289 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9320274-69b5-43a9-a743-5c36ba69fdbf None admin] RBAC: Adding query filter params (name=service) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:18.940599 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9320274-69b5-43a9-a743-5c36ba69fdbf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:18.942015 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9320274-69b5-43a9-a743-5c36ba69fdbf None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:18.946518 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4de8f1-00d3-40b4-b377-d408fee23ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:18.947496 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4de8f1-00d3-40b4-b377-d408fee23ea5 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:18.947893 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4de8f1-00d3-40b4-b377-d408fee23ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:18.948257 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4de8f1-00d3-40b4-b377-d408fee23ea5 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:18.948978 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4de8f1-00d3-40b4-b377-d408fee23ea5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:18.949390 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4de8f1-00d3-40b4-b377-d408fee23ea5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:18.951318 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4de8f1-00d3-40b4-b377-d408fee23ea5 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:18.952183 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 315/621] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Sep 19 14:42:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:18.958119 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9320274-69b5-43a9-a743-5c36ba69fdbf None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:18.978469 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 307/622] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 19 14:42:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:18.979432 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4de8f1-00d3-40b4-b377-d408fee23ea5 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:19.101290 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:19.177130 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9320274-69b5-43a9-a743-5c36ba69fdbf None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:19.190904 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4de8f1-00d3-40b4-b377-d408fee23ea5 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:19.240419 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560b68c2-02e8-497d-9f57-686169257c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:19.241085 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b68c2-02e8-497d-9f57-686169257c4b None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:19.241365 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b68c2-02e8-497d-9f57-686169257c4b None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:19.241646 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b68c2-02e8-497d-9f57-686169257c4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:19.258144 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e5fbc5-880a-495d-b0e8-d1a3f270328a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:19.258784 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e5fbc5-880a-495d-b0e8-d1a3f270328a None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:19.259062 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e5fbc5-880a-495d-b0e8-d1a3f270328a None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:19.259329 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e5fbc5-880a-495d-b0e8-d1a3f270328a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:19.264008 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560b68c2-02e8-497d-9f57-686169257c4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:19.265509 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560b68c2-02e8-497d-9f57-686169257c4b None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:19.271344 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e5fbc5-880a-495d-b0e8-d1a3f270328a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:19.272889 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e5fbc5-880a-495d-b0e8-d1a3f270328a None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:19.283719 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-560b68c2-02e8-497d-9f57-686169257c4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:19.283719 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:19.283719 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:19.283719 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:19.283719 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:19.283719 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:19.283719 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:19.283719 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:19.283719 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:19.283719 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:19.283719 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:19.283719 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:19.283719 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:42:19.283719 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:42:19.283719 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:42:19.283719 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:42:19.284763 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:19.284763 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:19.284763 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:19.284763 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:19.284763 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:19.284763 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:19.284763 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:19.284763 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:19.284763 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:19.284763 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:19.284763 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:19.284763 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:19.284763 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:19.284763 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:19.284763 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:19.284763 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:19.284763 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:42:19.285997 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:42:19.285997 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:19.285997 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:19.285997 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 316/623] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:42:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:19.286485 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-46e5fbc5-880a-495d-b0e8-d1a3f270328a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:42:19.286485 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:19.286485 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:19.286485 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:19.286485 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:19.286485 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:19.286485 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:19.286485 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:19.286485 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:19.286485 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:19.286485 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:19.286485 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:19.286485 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:42:19.286485 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:42:19.286485 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:42:19.287607 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:42:19.287607 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:19.287607 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:19.287607 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:19.287607 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:19.287607 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:19.287607 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:19.287607 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:19.287607 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:19.287607 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:19.287607 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:19.287607 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:19.287607 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:19.287607 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:19.287607 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:19.287607 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:19.287607 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:19.288697 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:42:19.288697 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:42:19.288697 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:42:19.288697 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:42:19.288697 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:42:19.288697 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:42:19.288697 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:42:19.288697 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:42:19.288697 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 308/624] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 19 14:42:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:19.289695 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a43dd1-1ef8-4d0f-974d-e51db319cc65 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:19.289695 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a43dd1-1ef8-4d0f-974d-e51db319cc65 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:19.289695 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a43dd1-1ef8-4d0f-974d-e51db319cc65 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:19.289695 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 317/625] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:42:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:42:19.294495 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e5fbc5-880a-495d-b0e8-d1a3f270328a None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:19.295830 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a43dd1-1ef8-4d0f-974d-e51db319cc65 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:19.301825 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:19.429942 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a43dd1-1ef8-4d0f-974d-e51db319cc65 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:19.433312 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e5fbc5-880a-495d-b0e8-d1a3f270328a None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:19.458274 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:19.469526 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da871fd-2d8c-438b-b85a-879f211eaf55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:19.470145 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da871fd-2d8c-438b-b85a-879f211eaf55 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:19.470423 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da871fd-2d8c-438b-b85a-879f211eaf55 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:19.470698 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da871fd-2d8c-438b-b85a-879f211eaf55 None admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:19.471341 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da871fd-2d8c-438b-b85a-879f211eaf55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:19.471645 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da871fd-2d8c-438b-b85a-879f211eaf55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:19.473186 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da871fd-2d8c-438b-b85a-879f211eaf55 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:19.484217 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aee7d13-fa31-4d69-a235-4a17deb11a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:19.485620 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee7d13-fa31-4d69-a235-4a17deb11a29 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:19.486125 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee7d13-fa31-4d69-a235-4a17deb11a29 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:19.486608 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee7d13-fa31-4d69-a235-4a17deb11a29 None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:19.491956 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aee7d13-fa31-4d69-a235-4a17deb11a29 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:19.492088 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 318/626] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 19 14:42:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:19.492088 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8436cb-238f-4750-82f5-c31f278510ea None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:19.492088 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8436cb-238f-4750-82f5-c31f278510ea None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:19.492088 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8436cb-238f-4750-82f5-c31f278510ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:19.492851 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aee7d13-fa31-4d69-a235-4a17deb11a29 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:19.494926 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aee7d13-fa31-4d69-a235-4a17deb11a29 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:19.509842 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-4c8436cb-238f-4750-82f5-c31f278510ea None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:42:19.511330 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-4c8436cb-238f-4750-82f5-c31f278510ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:42:19.512187 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 309/627] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 19 14:42:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:19.513302 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aee7d13-fa31-4d69-a235-4a17deb11a29 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:19.579141 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:19.597342 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 319/628] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:42:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:42:19.598526 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8436cb-238f-4750-82f5-c31f278510ea None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:19.626647 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aee7d13-fa31-4d69-a235-4a17deb11a29 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:19.667720 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b16753c-2c8b-46ff-be1a-13931b8c6a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:19.668859 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b16753c-2c8b-46ff-be1a-13931b8c6a4c None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:19.669699 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b16753c-2c8b-46ff-be1a-13931b8c6a4c None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:19.670117 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b16753c-2c8b-46ff-be1a-13931b8c6a4c None admin] PATH_INFO: `/v3/users/swift` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:19.682534 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b16753c-2c8b-46ff-be1a-13931b8c6a4c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:19.684973 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b16753c-2c8b-46ff-be1a-13931b8c6a4c None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:19.700735 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-4b16753c-2c8b-46ff-be1a-13931b8c6a4c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 19 14:42:19.700735 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:19.700735 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:19.700735 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:19.700735 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:19.700735 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:19.700735 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:19.700735 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:19.700735 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:19.700735 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:19.700735 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:19.700735 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:19.700735 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:42:19.700735 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:42:19.700735 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:42:19.700735 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:42:19.702020 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:19.702020 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:19.702020 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:42:19.702020 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:42:19.702020 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:42:19.702020 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:42:19.702020 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:19.702020 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:19.702020 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:19.702020 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:19.702020 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:19.702020 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:19.702020 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:19.702020 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:19.702020 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:19.702020 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:19.702020 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:19.702020 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:19.703159 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:19.703159 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:19.703159 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:42:19.703159 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:42:19.703159 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:42:19.703159 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:42:19.703159 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:42:19.703159 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:42:19.703159 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 19 14:42:19.703159 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:42:19.703159 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 310/629] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 19 14:42:19 2022] GET /identity/v3/users/swift => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:19.703898 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38619281-f924-45b0-8b43-82ee41ac5773 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:19.709186 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38619281-f924-45b0-8b43-82ee41ac5773 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:19.709186 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38619281-f924-45b0-8b43-82ee41ac5773 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:19.709186 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 311/630] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:42:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:42:19.709186 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e9dc0d-7224-4639-bcec-5812365cd9ed None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:19.709186 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e9dc0d-7224-4639-bcec-5812365cd9ed None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:19.709186 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e9dc0d-7224-4639-bcec-5812365cd9ed None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:19.709600 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 312/631] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:42:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:42:19.710345 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e9dc0d-7224-4639-bcec-5812365cd9ed None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:19.732491 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8436cb-238f-4750-82f5-c31f278510ea None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:19.750575 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:19.772445 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d062969e-9b10-481a-b591-682dc24491c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:19.773083 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062969e-9b10-481a-b591-682dc24491c3 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:19.773346 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062969e-9b10-481a-b591-682dc24491c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:19.773613 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062969e-9b10-481a-b591-682dc24491c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:19.774340 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d062969e-9b10-481a-b591-682dc24491c3 None admin] RBAC: Adding query filter params (role.id=3d5d4018951045e18e7577ee742c10ca, scope.project.id=9ede5dc59ece4d9282867a99e94c4c41, user.id=3017e5d92bef4cc2aeae4f28c78ba233) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:19.774651 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d062969e-9b10-481a-b591-682dc24491c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:19.776160 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d062969e-9b10-481a-b591-682dc24491c3 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:19.789705 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 320/632] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 19 14:42:19 2022] GET /identity/v3/role_assignments?user.id=3017e5d92bef4cc2aeae4f28c78ba233&scope.project.id=9ede5dc59ece4d9282867a99e94c4c41&role.id=3d5d4018951045e18e7577ee742c10ca => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:19.789705 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1e2224-e586-4a6b-a78c-3905ec546fd9 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:19.789705 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1e2224-e586-4a6b-a78c-3905ec546fd9 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:19.789705 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1e2224-e586-4a6b-a78c-3905ec546fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:19.804709 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-7c1e2224-e586-4a6b-a78c-3905ec546fd9 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:42:19.806442 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-7c1e2224-e586-4a6b-a78c-3905ec546fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:42:19.846953 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e9dc0d-7224-4639-bcec-5812365cd9ed None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:19.882488 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:19.887869 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984587a4-a05a-4ac8-a0c3-1c919c1fb9e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:19.888752 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984587a4-a05a-4ac8-a0c3-1c919c1fb9e6 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:19.889063 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984587a4-a05a-4ac8-a0c3-1c919c1fb9e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:19.889335 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984587a4-a05a-4ac8-a0c3-1c919c1fb9e6 None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:19.890280 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984587a4-a05a-4ac8-a0c3-1c919c1fb9e6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:19.890585 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984587a4-a05a-4ac8-a0c3-1c919c1fb9e6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:19.892513 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984587a4-a05a-4ac8-a0c3-1c919c1fb9e6 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:19.899121 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 321/633] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:42:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:42:19.900254 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f966022-2ed2-4545-96db-d3497ec58e05 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:19.900537 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f966022-2ed2-4545-96db-d3497ec58e05 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:19.900813 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f966022-2ed2-4545-96db-d3497ec58e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:19.917791 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 313/634] 10.222.0.26 () {56 vars in 1135 bytes} [Mon Sep 19 14:42:19 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:19.918722 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984587a4-a05a-4ac8-a0c3-1c919c1fb9e6 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:19.920121 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-0f966022-2ed2-4545-96db-d3497ec58e05 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:42:19.921520 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-0f966022-2ed2-4545-96db-d3497ec58e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:42:20.017034 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 322/635] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:42:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:42:20.017231 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f966022-2ed2-4545-96db-d3497ec58e05 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:20.053860 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:20.064019 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984587a4-a05a-4ac8-a0c3-1c919c1fb9e6 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:20.109694 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376504c5-d57c-4e0d-af16-69ca382c43cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:20.110320 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376504c5-d57c-4e0d-af16-69ca382c43cc None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:20.110592 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376504c5-d57c-4e0d-af16-69ca382c43cc None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:20.110859 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376504c5-d57c-4e0d-af16-69ca382c43cc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:20.123851 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376504c5-d57c-4e0d-af16-69ca382c43cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:42:20.129091 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-376504c5-d57c-4e0d-af16-69ca382c43cc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:42:20.129091 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:20.129091 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:20.129091 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:20.129091 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:20.129091 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:20.129091 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:20.129091 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:20.129091 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:20.129091 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:20.129091 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:20.129091 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:20.129091 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:42:20.129091 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:42:20.129091 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:42:20.129091 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:42:20.130167 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:42:20.130167 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:42:20.130167 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:42:20.130167 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:42:20.130167 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:20.130167 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:20.130167 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:20.130167 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:20.130167 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:20.130167 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:20.130167 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:20.130167 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:20.130167 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:20.130167 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:20.130167 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:20.130167 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:20.131049 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:20.131049 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:20.131049 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:20.131049 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:20.131049 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:42:20.131049 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:42:20.131049 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:42:20.131049 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:42:20.131049 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:42:20.131049 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:42:20.131049 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:42:20.131049 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:42:20.131049 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 314/636] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Sep 19 14:42:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:20.138033 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376504c5-d57c-4e0d-af16-69ca382c43cc None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:20.145942 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f966022-2ed2-4545-96db-d3497ec58e05 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:20.169059 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:20.193006 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e6f0c8-2b62-4c69-8d30-7149f1bf52a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:20.193006 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e6f0c8-2b62-4c69-8d30-7149f1bf52a6 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:20.193006 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e6f0c8-2b62-4c69-8d30-7149f1bf52a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:20.193006 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e6f0c8-2b62-4c69-8d30-7149f1bf52a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:20.206008 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e6f0c8-2b62-4c69-8d30-7149f1bf52a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:20.207504 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e6f0c8-2b62-4c69-8d30-7149f1bf52a6 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:20.225234 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-67e6f0c8-2b62-4c69-8d30-7149f1bf52a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:20.225234 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:20.225234 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:20.225234 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:20.225234 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:20.225234 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:20.225234 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:20.225234 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:20.225234 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:20.225234 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:20.225234 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:20.225234 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:20.225234 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:42:20.225234 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:42:20.225234 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:42:20.225234 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:42:20.226402 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:20.226402 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:20.226402 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:20.226402 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:20.226402 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:20.226402 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:20.226402 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:20.226402 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:20.226402 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:20.226402 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:20.226402 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:20.226402 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:20.226402 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:20.226402 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:20.226402 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:20.226402 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:20.226402 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:42:20.227466 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:42:20.227466 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:20.227466 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:20.227466 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 323/637] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:42:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:20.228283 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e6f0c8-2b62-4c69-8d30-7149f1bf52a6 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:20.277062 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376504c5-d57c-4e0d-af16-69ca382c43cc None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:20.316055 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd159995-965b-4388-aadf-1aa497d2be8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:20.316662 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd159995-965b-4388-aadf-1aa497d2be8d None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:20.316933 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd159995-965b-4388-aadf-1aa497d2be8d None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:20.317225 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd159995-965b-4388-aadf-1aa497d2be8d None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:20.317889 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd159995-965b-4388-aadf-1aa497d2be8d None admin] RBAC: Adding query filter params (name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:20.318185 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd159995-965b-4388-aadf-1aa497d2be8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:20.319581 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd159995-965b-4388-aadf-1aa497d2be8d None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:20.328119 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 315/638] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Sep 19 14:42:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:20.328928 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd159995-965b-4388-aadf-1aa497d2be8d None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:20.350973 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:20.356771 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e6f0c8-2b62-4c69-8d30-7149f1bf52a6 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:20.393658 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6a6eaa-5e95-4fa1-9a4e-4f8518f5b7cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:20.394405 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a6eaa-5e95-4fa1-9a4e-4f8518f5b7cf None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:20.394692 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a6eaa-5e95-4fa1-9a4e-4f8518f5b7cf None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:20.394956 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a6eaa-5e95-4fa1-9a4e-4f8518f5b7cf None admin] PATH_INFO: `/v3/roles/service` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:20.407487 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6a6eaa-5e95-4fa1-9a4e-4f8518f5b7cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:42:20.413589 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-6c6a6eaa-5e95-4fa1-9a4e-4f8518f5b7cf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:42:20.413589 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:20.413589 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:20.413589 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:20.413589 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:20.413589 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:20.413589 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:20.413589 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:20.413589 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:20.413589 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:20.413589 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:20.413589 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:20.413589 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:42:20.413589 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:42:20.413589 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:42:20.413589 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:42:20.414537 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:42:20.414537 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:42:20.414537 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:42:20.414537 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:42:20.414537 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:20.414537 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:20.414537 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:20.414537 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:20.414537 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:20.414537 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:20.414537 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:20.414537 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:20.414537 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:20.414537 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:20.414537 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:20.414537 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:20.415360 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:20.415360 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:20.415360 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:20.415360 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:20.415360 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:42:20.415360 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:42:20.415360 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:42:20.415360 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:42:20.415360 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:42:20.415360 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:42:20.415360 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:42:20.415360 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:20.416075 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 324/639] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Sep 19 14:42:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:20.416688 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6a6eaa-5e95-4fa1-9a4e-4f8518f5b7cf None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:20.442726 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd159995-965b-4388-aadf-1aa497d2be8d None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:20.448411 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:20.480773 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ef33c2-7292-4649-95ea-1cf458d69f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:20.481495 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef33c2-7292-4649-95ea-1cf458d69f35 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:20.481841 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef33c2-7292-4649-95ea-1cf458d69f35 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:20.482115 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef33c2-7292-4649-95ea-1cf458d69f35 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:20.482750 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ef33c2-7292-4649-95ea-1cf458d69f35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:20.483047 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ef33c2-7292-4649-95ea-1cf458d69f35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:20.484435 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ef33c2-7292-4649-95ea-1cf458d69f35 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:20.497917 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 316/640] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 19 14:42:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:20.498740 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ef33c2-7292-4649-95ea-1cf458d69f35 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:20.530339 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6a6eaa-5e95-4fa1-9a4e-4f8518f5b7cf None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:20.569673 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cda456b-10a8-4440-90cd-54c9f1893354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:20.570640 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cda456b-10a8-4440-90cd-54c9f1893354 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:20.571105 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cda456b-10a8-4440-90cd-54c9f1893354 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:20.571448 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cda456b-10a8-4440-90cd-54c9f1893354 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:20.582287 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cda456b-10a8-4440-90cd-54c9f1893354 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:42:20.585837 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:20.588326 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-8cda456b-10a8-4440-90cd-54c9f1893354 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:42:20.588326 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:20.588326 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:20.588326 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:20.588326 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:20.588326 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:20.588326 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:20.588326 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:20.588326 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:20.588326 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:20.588326 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:20.588326 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:20.588326 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:42:20.588326 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:42:20.588326 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:42:20.588326 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:42:20.590130 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:42:20.590130 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:42:20.590130 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:42:20.590130 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:42:20.590130 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:20.590130 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:20.590130 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:20.590130 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:20.590130 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:20.590130 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:20.590130 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:20.590130 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:20.590130 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:20.590130 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:20.590130 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:20.590130 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:20.590982 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:20.590982 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:20.590982 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:20.590982 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:20.590982 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:42:20.590982 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:42:20.590982 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:42:20.590982 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:42:20.590982 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:42:20.590982 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:42:20.590982 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:42:20.590982 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:20.590982 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 325/641] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Sep 19 14:42:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:20.590982 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cda456b-10a8-4440-90cd-54c9f1893354 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:20.617038 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ef33c2-7292-4649-95ea-1cf458d69f35 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:20.654402 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f5dcf8-10ce-41e9-a56d-61672e1d3660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:20.655060 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f5dcf8-10ce-41e9-a56d-61672e1d3660 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:20.655321 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f5dcf8-10ce-41e9-a56d-61672e1d3660 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:20.655592 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f5dcf8-10ce-41e9-a56d-61672e1d3660 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:20.666668 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f5dcf8-10ce-41e9-a56d-61672e1d3660 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:20.668184 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f5dcf8-10ce-41e9-a56d-61672e1d3660 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:20.683197 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-92f5dcf8-10ce-41e9-a56d-61672e1d3660 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:20.683197 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:20.683197 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:20.683197 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:20.683197 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:20.683197 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:20.683197 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:20.683197 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:20.683197 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:20.683197 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:20.683197 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:20.683197 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:20.683197 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:42:20.683197 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:42:20.683197 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:42:20.683197 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:42:20.684367 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:20.684367 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:20.684367 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:20.684367 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:20.684367 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:20.684367 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:20.684367 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:20.684367 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:20.684367 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:20.684367 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:20.684367 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:20.684367 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:20.684367 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:20.684367 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:20.684367 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:20.684367 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:20.684367 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:42:20.685468 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:42:20.685468 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:20.685468 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:42:20.689014 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 317/642] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:42:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:20.689831 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f5dcf8-10ce-41e9-a56d-61672e1d3660 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:20.696391 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:20.708852 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cda456b-10a8-4440-90cd-54c9f1893354 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:20.742748 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7414fc-f8e9-463f-980f-c6fa3b6d25df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:20.743319 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7414fc-f8e9-463f-980f-c6fa3b6d25df None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:20.743594 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7414fc-f8e9-463f-980f-c6fa3b6d25df None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:20.743860 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7414fc-f8e9-463f-980f-c6fa3b6d25df None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:20.744557 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7414fc-f8e9-463f-980f-c6fa3b6d25df None admin] RBAC: Adding query filter params (name=service) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:20.744820 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7414fc-f8e9-463f-980f-c6fa3b6d25df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:20.747002 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7414fc-f8e9-463f-980f-c6fa3b6d25df None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:20.755182 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 326/643] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Sep 19 14:42:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:20.755988 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7414fc-f8e9-463f-980f-c6fa3b6d25df None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:20.809696 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f5dcf8-10ce-41e9-a56d-61672e1d3660 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:20.838230 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:20.848187 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c008adf1-044b-4fa3-8368-0f28699556a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:20.848811 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c008adf1-044b-4fa3-8368-0f28699556a8 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:20.849112 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c008adf1-044b-4fa3-8368-0f28699556a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:20.849366 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c008adf1-044b-4fa3-8368-0f28699556a8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:20.857525 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c008adf1-044b-4fa3-8368-0f28699556a8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:20.859013 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c008adf1-044b-4fa3-8368-0f28699556a8 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:20.868907 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7414fc-f8e9-463f-980f-c6fa3b6d25df None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:20.871712 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-c008adf1-044b-4fa3-8368-0f28699556a8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:42:20.871712 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:20.871712 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:20.871712 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:20.871712 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:20.871712 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:20.871712 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:20.871712 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:20.871712 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:20.871712 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:20.871712 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:20.871712 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:20.871712 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:42:20.871712 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:42:20.871712 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:42:20.872554 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:42:20.872554 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:20.872554 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:20.872554 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:20.872554 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:20.872554 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:20.872554 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:20.872554 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:20.872554 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:20.872554 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:20.872554 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:20.872554 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:20.872554 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:20.872554 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:20.872554 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:20.872554 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:20.872554 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:20.873626 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:42:20.873626 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:42:20.873626 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:42:20.873626 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:42:20.873626 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:42:20.873626 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:42:20.873626 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:42:20.873626 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:42:20.873626 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 318/644] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 19 14:42:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:20.873626 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c008adf1-044b-4fa3-8368-0f28699556a8 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:20.908528 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1989ffe-53e6-4749-bec6-795a282799cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:20.909768 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1989ffe-53e6-4749-bec6-795a282799cc None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:20.910040 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1989ffe-53e6-4749-bec6-795a282799cc None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:20.910302 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1989ffe-53e6-4749-bec6-795a282799cc None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:20.910960 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1989ffe-53e6-4749-bec6-795a282799cc None admin] RBAC: Adding query filter params (name=service) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:20.911258 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1989ffe-53e6-4749-bec6-795a282799cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:20.912619 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1989ffe-53e6-4749-bec6-795a282799cc None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:20.926106 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 327/645] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Sep 19 14:42:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:20.926106 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1989ffe-53e6-4749-bec6-795a282799cc None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:20.944001 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:20.996186 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c008adf1-044b-4fa3-8368-0f28699556a8 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:21.031683 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248818d0-a44d-41cf-84c1-b71cbd764ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:21.032339 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248818d0-a44d-41cf-84c1-b71cbd764ab7 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:21.032622 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248818d0-a44d-41cf-84c1-b71cbd764ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:21.032893 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248818d0-a44d-41cf-84c1-b71cbd764ab7 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:21.033565 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248818d0-a44d-41cf-84c1-b71cbd764ab7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:21.033872 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248818d0-a44d-41cf-84c1-b71cbd764ab7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:21.035314 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248818d0-a44d-41cf-84c1-b71cbd764ab7 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:21.041754 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1989ffe-53e6-4749-bec6-795a282799cc None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:21.048514 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 319/646] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 19 14:42:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:21.049365 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248818d0-a44d-41cf-84c1-b71cbd764ab7 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:21.080805 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20830e44-68b4-4e97-89a0-8fae159a13ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:21.081538 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20830e44-68b4-4e97-89a0-8fae159a13ae None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:21.081811 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20830e44-68b4-4e97-89a0-8fae159a13ae None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:21.082074 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20830e44-68b4-4e97-89a0-8fae159a13ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:21.093156 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20830e44-68b4-4e97-89a0-8fae159a13ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:21.094665 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20830e44-68b4-4e97-89a0-8fae159a13ae None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:21.106403 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:21.109770 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-20830e44-68b4-4e97-89a0-8fae159a13ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:21.109770 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:21.109770 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:21.109770 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:21.109770 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:21.109770 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:21.109770 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:21.109770 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:21.109770 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:21.109770 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:21.109770 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:21.109770 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:21.109770 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:42:21.109770 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:42:21.109770 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:42:21.109770 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:42:21.111082 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:21.111082 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:21.111082 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:21.111082 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:21.111082 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:21.111082 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:21.111082 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:21.111082 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:21.111082 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:21.111082 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:21.111082 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:21.111082 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:21.111082 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:21.111082 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:21.111082 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:21.111082 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:21.111082 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:42:21.111972 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:42:21.111972 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:21.111972 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:21.111972 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 328/647] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:42:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:21.112614 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20830e44-68b4-4e97-89a0-8fae159a13ae None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:21.166082 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248818d0-a44d-41cf-84c1-b71cbd764ab7 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:21.183658 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:21.202633 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9421740-858d-45a3-a41c-c196a62387f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:21.203241 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9421740-858d-45a3-a41c-c196a62387f1 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:21.203516 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9421740-858d-45a3-a41c-c196a62387f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:21.203780 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9421740-858d-45a3-a41c-c196a62387f1 None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:21.204462 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9421740-858d-45a3-a41c-c196a62387f1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:21.204759 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9421740-858d-45a3-a41c-c196a62387f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:21.206252 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9421740-858d-45a3-a41c-c196a62387f1 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:21.223124 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 320/648] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 19 14:42:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:21.223124 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9421740-858d-45a3-a41c-c196a62387f1 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:21.228912 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20830e44-68b4-4e97-89a0-8fae159a13ae None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:21.266221 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2de111-f9df-4638-be80-05e54bb47d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:21.267100 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2de111-f9df-4638-be80-05e54bb47d36 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:21.267372 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2de111-f9df-4638-be80-05e54bb47d36 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:21.267652 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2de111-f9df-4638-be80-05e54bb47d36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:21.279949 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2de111-f9df-4638-be80-05e54bb47d36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:21.281470 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2de111-f9df-4638-be80-05e54bb47d36 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:21.296671 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-0a2de111-f9df-4638-be80-05e54bb47d36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:21.296671 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:21.296671 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:21.296671 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:21.296671 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:21.296671 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:21.296671 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:21.296671 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:21.296671 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:21.296671 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:21.296671 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:21.296671 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:21.296671 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:42:21.296671 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:42:21.296671 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:42:21.296671 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:42:21.297856 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:21.297856 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:21.297856 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:21.297856 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:21.297856 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:21.297856 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:21.297856 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:21.297856 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:21.297856 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:21.297856 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:21.297856 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:21.297856 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:21.297856 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:21.297856 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:21.297856 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:21.297856 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:21.297856 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:42:21.298735 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:42:21.298735 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:21.298735 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:21.298735 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 329/649] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:42:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:21.298735 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2de111-f9df-4638-be80-05e54bb47d36 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:21.328203 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9421740-858d-45a3-a41c-c196a62387f1 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:21.338286 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:21.367502 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6b6394-8734-42d1-a3ca-ac7c6a742074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:21.368169 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6b6394-8734-42d1-a3ca-ac7c6a742074 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:21.368697 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6b6394-8734-42d1-a3ca-ac7c6a742074 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:21.368965 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6b6394-8734-42d1-a3ca-ac7c6a742074 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:21.379697 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6b6394-8734-42d1-a3ca-ac7c6a742074 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:21.381179 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6b6394-8734-42d1-a3ca-ac7c6a742074 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:21.393676 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-9a6b6394-8734-42d1-a3ca-ac7c6a742074 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 19 14:42:21.393676 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:21.393676 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:21.393676 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:21.393676 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:21.393676 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:21.393676 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:21.393676 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:21.393676 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:21.393676 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:21.393676 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:21.393676 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:21.393676 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:42:21.393676 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:42:21.393676 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:42:21.393676 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:42:21.394635 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:21.394635 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:21.394635 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:42:21.394635 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:42:21.394635 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:42:21.394635 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:42:21.394635 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:21.394635 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:21.394635 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:21.394635 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:21.394635 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:21.394635 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:21.394635 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:21.394635 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:21.394635 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:21.394635 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:21.394635 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:21.394635 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:21.395585 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:21.395585 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:21.395585 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:42:21.395585 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:42:21.395585 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:42:21.395585 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:42:21.395585 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:42:21.395585 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:42:21.395585 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 19 14:42:21.395585 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:42:21.399572 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 321/650] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 19 14:42:21 2022] GET /identity/v3/users/cinder => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:21.400162 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6b6394-8734-42d1-a3ca-ac7c6a742074 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:21.414324 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2de111-f9df-4638-be80-05e54bb47d36 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:21.432754 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:21.451622 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c6fb46-fdf2-474f-86e3-45bbb9269168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:21.452229 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6fb46-fdf2-474f-86e3-45bbb9269168 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:21.452502 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6fb46-fdf2-474f-86e3-45bbb9269168 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:21.452768 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6fb46-fdf2-474f-86e3-45bbb9269168 None admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:21.453446 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c6fb46-fdf2-474f-86e3-45bbb9269168 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:21.453745 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c6fb46-fdf2-474f-86e3-45bbb9269168 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:21.455101 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c6fb46-fdf2-474f-86e3-45bbb9269168 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:21.472322 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 330/651] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 19 14:42:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:21.472322 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c6fb46-fdf2-474f-86e3-45bbb9269168 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:21.513542 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6b6394-8734-42d1-a3ca-ac7c6a742074 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:21.547182 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efe0223-9caf-4104-8990-d38f30ba7f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:21.547994 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe0223-9caf-4104-8990-d38f30ba7f7c None admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:21.548393 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe0223-9caf-4104-8990-d38f30ba7f7c None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:21.548762 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe0223-9caf-4104-8990-d38f30ba7f7c None admin] PATH_INFO: `/v3/projects/9ede5dc59ece4d9282867a99e94c4c41/users/76cb60a5e90343e69a38db4356cb3a90/roles/3d5d4018951045e18e7577ee742c10ca` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:21.563171 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efe0223-9caf-4104-8990-d38f30ba7f7c None admin] RBAC: Authorizing `identity:create_grant(project_id=9ede5dc59ece4d9282867a99e94c4c41, user_id=76cb60a5e90343e69a38db4356cb3a90, role_id=3d5d4018951045e18e7577ee742c10ca)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:21.564732 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efe0223-9caf-4104-8990-d38f30ba7f7c None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:21.574770 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c6fb46-fdf2-474f-86e3-45bbb9269168 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:21.589263 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 322/652] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Sep 19 14:42:21 2022] PUT /identity/v3/projects/9ede5dc59ece4d9282867a99e94c4c41/users/76cb60a5e90343e69a38db4356cb3a90/roles/3d5d4018951045e18e7577ee742c10ca => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:42:21.589263 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efe0223-9caf-4104-8990-d38f30ba7f7c None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:21.613387 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae28790a-5634-4675-87a6-e53736a31000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:21.614127 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28790a-5634-4675-87a6-e53736a31000 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:21.614464 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28790a-5634-4675-87a6-e53736a31000 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:21.614839 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28790a-5634-4675-87a6-e53736a31000 None admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:21.615195 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:21.615650 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae28790a-5634-4675-87a6-e53736a31000 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:21.616119 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae28790a-5634-4675-87a6-e53736a31000 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:21.617625 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae28790a-5634-4675-87a6-e53736a31000 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:21.631804 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 331/653] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 19 14:42:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:21.633197 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae28790a-5634-4675-87a6-e53736a31000 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:21.681121 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:21.743838 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efe0223-9caf-4104-8990-d38f30ba7f7c None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:21.751719 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae28790a-5634-4675-87a6-e53736a31000 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:21.788612 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be9b40-e307-4295-a2cf-39cd260d36d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:21.789292 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be9b40-e307-4295-a2cf-39cd260d36d6 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:21.789568 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be9b40-e307-4295-a2cf-39cd260d36d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:21.789836 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be9b40-e307-4295-a2cf-39cd260d36d6 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:21.799631 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98cc96e-1575-45dc-81dd-fcab239a16cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:21.800671 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98cc96e-1575-45dc-81dd-fcab239a16cd None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:21.800781 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0be9b40-e307-4295-a2cf-39cd260d36d6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:21.801249 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98cc96e-1575-45dc-81dd-fcab239a16cd None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:21.801707 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98cc96e-1575-45dc-81dd-fcab239a16cd None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:21.802517 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0be9b40-e307-4295-a2cf-39cd260d36d6 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:21.802878 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98cc96e-1575-45dc-81dd-fcab239a16cd None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:21.803348 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98cc96e-1575-45dc-81dd-fcab239a16cd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:21.807105 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98cc96e-1575-45dc-81dd-fcab239a16cd None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:21.819695 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-d0be9b40-e307-4295-a2cf-39cd260d36d6 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 19 14:42:21.819695 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:21.819695 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:21.819695 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:21.819695 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:21.819695 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:21.819695 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:21.819695 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:21.819695 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:21.819695 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:21.819695 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:21.819695 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:21.819695 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:42:21.819695 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:42:21.819695 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:42:21.819695 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:42:21.820928 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:21.820928 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:21.820928 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:42:21.820928 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:42:21.820928 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:42:21.820928 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:42:21.820928 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:21.820928 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:21.820928 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:21.820928 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:21.820928 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:21.820928 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:21.820928 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:21.820928 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:21.820928 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:21.820928 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:21.820928 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:21.820928 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:21.822480 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:21.822480 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:21.822480 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:42:21.822480 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:42:21.822480 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:42:21.822480 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:42:21.822480 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:42:21.822480 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:42:21.822480 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 19 14:42:21.822480 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:21.823525 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 332/654] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 19 14:42:21 2022] GET /identity/v3/users/glance => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:21.823650 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be9b40-e307-4295-a2cf-39cd260d36d6 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:21.834047 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 323/655] 10.222.0.26 () {56 vars in 1137 bytes} [Mon Sep 19 14:42:21 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:21.834907 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98cc96e-1575-45dc-81dd-fcab239a16cd None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:21.940439 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:21.958737 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:21.964026 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be9b40-e307-4295-a2cf-39cd260d36d6 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:21.973796 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98cc96e-1575-45dc-81dd-fcab239a16cd None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:22.009378 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d13ebe-e9e4-41d5-a974-000a5853a4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:22.010285 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d13ebe-e9e4-41d5-a974-000a5853a4ce None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:22.010574 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d13ebe-e9e4-41d5-a974-000a5853a4ce None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:22.011051 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d13ebe-e9e4-41d5-a974-000a5853a4ce None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:22.022438 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d13ebe-e9e4-41d5-a974-000a5853a4ce None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:22.024937 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d13ebe-e9e4-41d5-a974-000a5853a4ce None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:22.031468 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fbdf01-36ce-43e5-ba80-b0a39ab6b702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:22.032202 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fbdf01-36ce-43e5-ba80-b0a39ab6b702 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:22.032579 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fbdf01-36ce-43e5-ba80-b0a39ab6b702 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:22.032945 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fbdf01-36ce-43e5-ba80-b0a39ab6b702 None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:22.033797 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fbdf01-36ce-43e5-ba80-b0a39ab6b702 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:22.034221 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fbdf01-36ce-43e5-ba80-b0a39ab6b702 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:22.036047 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fbdf01-36ce-43e5-ba80-b0a39ab6b702 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:22.040362 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-28d13ebe-e9e4-41d5-a974-000a5853a4ce None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 19 14:42:22.040362 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:22.040362 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:22.040362 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:22.040362 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:22.040362 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:22.040362 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:22.040362 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:22.040362 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:22.040362 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:22.040362 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:22.040362 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:22.040362 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:42:22.040362 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:42:22.040362 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:42:22.040362 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:42:22.041496 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:22.041496 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:22.041496 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:42:22.041496 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:42:22.041496 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:42:22.041496 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:42:22.041496 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:22.041496 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:22.041496 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:22.041496 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:22.041496 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:22.041496 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:22.041496 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:22.041496 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:22.041496 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:22.041496 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:22.041496 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:22.041496 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:22.042513 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:22.042513 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:22.042513 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:42:22.042513 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:42:22.042513 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:42:22.042513 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:42:22.042513 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:42:22.042513 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:42:22.042513 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 19 14:42:22.042513 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:22.044943 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 333/656] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Sep 19 14:42:21 2022] GET /identity/v3/users/neutron => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:22.045928 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d13ebe-e9e4-41d5-a974-000a5853a4ce None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:22.061088 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 324/657] 10.222.0.26 () {56 vars in 1137 bytes} [Mon Sep 19 14:42:21 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:22.061962 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fbdf01-36ce-43e5-ba80-b0a39ab6b702 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:22.166974 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d13ebe-e9e4-41d5-a974-000a5853a4ce None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:22.204684 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fbdf01-36ce-43e5-ba80-b0a39ab6b702 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:22.208012 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aad516a-0de8-4f9a-8d17-e5341aae6010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:22.208012 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad516a-0de8-4f9a-8d17-e5341aae6010 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:22.208417 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad516a-0de8-4f9a-8d17-e5341aae6010 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:22.208751 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad516a-0de8-4f9a-8d17-e5341aae6010 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:22.239384 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:22.264799 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e0b604-e266-443e-9696-52605abfb7e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:22.266061 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e0b604-e266-443e-9696-52605abfb7e1 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:22.267071 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e0b604-e266-443e-9696-52605abfb7e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:22.267668 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e0b604-e266-443e-9696-52605abfb7e1 None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:22.268886 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e0b604-e266-443e-9696-52605abfb7e1 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:22.269599 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e0b604-e266-443e-9696-52605abfb7e1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:22.272373 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e0b604-e266-443e-9696-52605abfb7e1 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:22.275227 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:22.288947 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aad516a-0de8-4f9a-8d17-e5341aae6010 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:22.290685 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aad516a-0de8-4f9a-8d17-e5341aae6010 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:22.299448 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 325/658] 10.222.0.26 () {56 vars in 1139 bytes} [Mon Sep 19 14:42:22 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:22.300950 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e0b604-e266-443e-9696-52605abfb7e1 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:22.405028 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 334/659] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 19 14:42:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:42:22.405028 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b8117-8d32-4716-9747-82de8b944f1f None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:22.405028 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b8117-8d32-4716-9747-82de8b944f1f None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:22.405028 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b8117-8d32-4716-9747-82de8b944f1f None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:22.409809 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 335/660] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:42:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:42:22.409809 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096b8117-8d32-4716-9747-82de8b944f1f None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:22.412136 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e0b604-e266-443e-9696-52605abfb7e1 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:22.451119 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c561bc-c098-41fe-8805-e0bb7e685c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:22.451726 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c561bc-c098-41fe-8805-e0bb7e685c0e None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:22.452005 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c561bc-c098-41fe-8805-e0bb7e685c0e None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:22.452273 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c561bc-c098-41fe-8805-e0bb7e685c0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:22.477819 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:22.521760 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:22.523994 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096b8117-8d32-4716-9747-82de8b944f1f None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:22.532878 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c561bc-c098-41fe-8805-e0bb7e685c0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:22.534421 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c561bc-c098-41fe-8805-e0bb7e685c0e None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:22.566724 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc92066-81ad-4a58-82c5-ff63235a4850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:22.567573 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc92066-81ad-4a58-82c5-ff63235a4850 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:22.567859 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc92066-81ad-4a58-82c5-ff63235a4850 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:22.568134 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc92066-81ad-4a58-82c5-ff63235a4850 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:22.645360 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc92066-81ad-4a58-82c5-ff63235a4850 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:22.645789 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 326/661] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 19 14:42:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:42:22.646799 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc92066-81ad-4a58-82c5-ff63235a4850 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:22.647032 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c561bc-c098-41fe-8805-e0bb7e685c0e None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:22.709366 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:22.746844 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:22.756198 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c561bc-c098-41fe-8805-e0bb7e685c0e None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:22.764833 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 336/662] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 19 14:42:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:42:22.764833 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a6ba91-d19c-445a-b546-e9154ee4dea6 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:22.764833 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a6ba91-d19c-445a-b546-e9154ee4dea6 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:22.764833 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a6ba91-d19c-445a-b546-e9154ee4dea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:22.783612 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-a4a6ba91-d19c-445a-b546-e9154ee4dea6 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:42:22.784803 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-a4a6ba91-d19c-445a-b546-e9154ee4dea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:42:22.793465 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bc9cac-0bd4-4f19-9700-4909dbc1c2b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:22.794347 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc9cac-0bd4-4f19-9700-4909dbc1c2b4 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:22.794818 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc9cac-0bd4-4f19-9700-4909dbc1c2b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:22.795339 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc9cac-0bd4-4f19-9700-4909dbc1c2b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:22.806969 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bc9cac-0bd4-4f19-9700-4909dbc1c2b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:22.808906 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bc9cac-0bd4-4f19-9700-4909dbc1c2b4 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:22.824837 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-25bc9cac-0bd4-4f19-9700-4909dbc1c2b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:22.824837 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:22.824837 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:22.824837 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:22.824837 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:22.824837 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:22.824837 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:22.824837 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:22.824837 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:22.824837 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:22.824837 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:22.824837 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:22.824837 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:42:22.824837 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:42:22.824837 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:42:22.824837 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:42:22.825995 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:22.825995 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:22.825995 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:22.825995 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:22.825995 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:22.825995 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:22.825995 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:22.825995 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:22.825995 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:22.825995 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:22.825995 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:22.825995 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:22.825995 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:22.825995 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:22.825995 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:22.825995 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:22.825995 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:42:22.827166 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:42:22.827166 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:22.827166 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:42:22.828592 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 327/663] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:42:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:22.829639 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bc9cac-0bd4-4f19-9700-4909dbc1c2b4 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:22.860093 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 337/664] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:42:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:42:22.861548 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a6ba91-d19c-445a-b546-e9154ee4dea6 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:22.958344 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bc9cac-0bd4-4f19-9700-4909dbc1c2b4 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:22.970958 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:22.985444 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a6ba91-d19c-445a-b546-e9154ee4dea6 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:23.012967 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac59ebe6-7476-4764-ac50-d45c721c3bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:23.014034 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac59ebe6-7476-4764-ac50-d45c721c3bff None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:23.014513 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac59ebe6-7476-4764-ac50-d45c721c3bff None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:23.015030 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac59ebe6-7476-4764-ac50-d45c721c3bff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:23.027308 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac59ebe6-7476-4764-ac50-d45c721c3bff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:23.029103 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac59ebe6-7476-4764-ac50-d45c721c3bff None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:23.032295 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:23.035825 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf44c3-07fb-4f69-a8b8-7426e72c7371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:23.036475 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf44c3-07fb-4f69-a8b8-7426e72c7371 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:23.036751 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf44c3-07fb-4f69-a8b8-7426e72c7371 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:23.037078 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf44c3-07fb-4f69-a8b8-7426e72c7371 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:23.048286 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-ac59ebe6-7476-4764-ac50-d45c721c3bff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:23.048286 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:23.048286 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:23.048286 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:23.048286 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:23.048286 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:23.048286 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:23.048286 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:23.048286 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:23.048286 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:23.048286 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:23.048286 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:23.048286 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:42:23.048286 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:42:23.048286 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:42:23.048286 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:42:23.049304 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:23.049304 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:23.049304 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:23.049304 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:23.049304 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:23.049304 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:23.049304 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:23.049304 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:23.049304 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:23.049304 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:23.049304 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:23.049304 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:23.049304 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:23.049304 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:23.049304 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:23.049304 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:23.049304 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:42:23.050363 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:42:23.050363 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:23.050363 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:42:23.050560 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecf44c3-07fb-4f69-a8b8-7426e72c7371 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:23.050950 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecf44c3-07fb-4f69-a8b8-7426e72c7371 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:23.057090 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 328/665] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:42:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:23.058211 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac59ebe6-7476-4764-ac50-d45c721c3bff None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:23.068569 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-3ecf44c3-07fb-4f69-a8b8-7426e72c7371 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:23.068569 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:23.068569 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:23.068569 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:23.068569 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:23.068569 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:23.068569 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:23.068569 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:23.068569 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:23.068569 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:23.068569 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:23.068569 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:23.068569 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:42:23.068569 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:42:23.068569 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:42:23.068569 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:42:23.069729 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:23.069729 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:23.069729 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:23.069729 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:23.069729 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:23.069729 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:23.069729 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:23.069729 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:23.069729 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:23.069729 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:23.069729 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:23.069729 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:23.069729 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:23.069729 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:23.069729 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:23.069729 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:23.069729 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:42:23.070682 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:42:23.070682 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:23.070682 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:23.070682 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 338/666] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:42:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:23.071574 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf44c3-07fb-4f69-a8b8-7426e72c7371 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:23.174731 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac59ebe6-7476-4764-ac50-d45c721c3bff None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:23.187283 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf44c3-07fb-4f69-a8b8-7426e72c7371 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:23.213279 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a245ee30-8b02-46ef-8a28-88b7c9012619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:23.213924 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a245ee30-8b02-46ef-8a28-88b7c9012619 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:23.214263 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a245ee30-8b02-46ef-8a28-88b7c9012619 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:23.214537 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a245ee30-8b02-46ef-8a28-88b7c9012619 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:23.215190 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a245ee30-8b02-46ef-8a28-88b7c9012619 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:23.215496 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a245ee30-8b02-46ef-8a28-88b7c9012619 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:23.216876 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a245ee30-8b02-46ef-8a28-88b7c9012619 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:23.224542 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad5a0d3-a5bd-44d6-a872-0f380fdf3921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:23.225197 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad5a0d3-a5bd-44d6-a872-0f380fdf3921 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:23.225467 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad5a0d3-a5bd-44d6-a872-0f380fdf3921 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:23.225730 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad5a0d3-a5bd-44d6-a872-0f380fdf3921 None admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:23.226353 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad5a0d3-a5bd-44d6-a872-0f380fdf3921 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:23.226651 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad5a0d3-a5bd-44d6-a872-0f380fdf3921 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:23.228280 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad5a0d3-a5bd-44d6-a872-0f380fdf3921 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:23.234199 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 329/667] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 19 14:42:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:23.234199 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a245ee30-8b02-46ef-8a28-88b7c9012619 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:23.243816 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:23.252423 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 339/668] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 19 14:42:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:23.253490 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad5a0d3-a5bd-44d6-a872-0f380fdf3921 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:23.289709 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:23.333948 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a245ee30-8b02-46ef-8a28-88b7c9012619 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:23.363013 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad5a0d3-a5bd-44d6-a872-0f380fdf3921 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:23.368796 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c9dc77-a6df-451b-9dbb-d24f1eadb1ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:23.369432 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c9dc77-a6df-451b-9dbb-d24f1eadb1ad None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:23.369711 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c9dc77-a6df-451b-9dbb-d24f1eadb1ad None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:23.370029 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c9dc77-a6df-451b-9dbb-d24f1eadb1ad None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:23.370676 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c9dc77-a6df-451b-9dbb-d24f1eadb1ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:23.371068 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c9dc77-a6df-451b-9dbb-d24f1eadb1ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:23.372348 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c9dc77-a6df-451b-9dbb-d24f1eadb1ad None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:23.388388 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 330/669] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 19 14:42:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:23.388388 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c9dc77-a6df-451b-9dbb-d24f1eadb1ad None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:23.400109 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7168c2-0ff3-4e6d-aad7-ba398d97dfa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:23.400726 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7168c2-0ff3-4e6d-aad7-ba398d97dfa9 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:23.401006 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7168c2-0ff3-4e6d-aad7-ba398d97dfa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:23.401352 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7168c2-0ff3-4e6d-aad7-ba398d97dfa9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:23.412957 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7168c2-0ff3-4e6d-aad7-ba398d97dfa9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:42:23.418189 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-dc7168c2-0ff3-4e6d-aad7-ba398d97dfa9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:42:23.418189 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:23.418189 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:23.418189 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:23.418189 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:23.418189 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:23.418189 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:23.418189 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:23.418189 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:23.418189 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:23.418189 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:23.418189 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:23.418189 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:42:23.418189 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:42:23.418189 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:42:23.418189 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:42:23.419135 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:42:23.419135 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:42:23.419135 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:42:23.419135 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:42:23.419135 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:23.419135 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:23.419135 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:23.419135 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:23.419135 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:23.419135 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:23.419135 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:23.419135 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:23.419135 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:23.419135 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:23.419135 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:23.419135 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:23.420018 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:23.420018 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:23.420018 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:23.420018 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:23.420018 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:42:23.420018 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:42:23.420018 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:42:23.420018 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:42:23.420018 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:42:23.420018 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:42:23.420018 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:42:23.420018 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:23.420018 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 340/670] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 19 14:42:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:23.420713 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7168c2-0ff3-4e6d-aad7-ba398d97dfa9 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:23.486616 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:23.500180 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c9dc77-a6df-451b-9dbb-d24f1eadb1ad None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:23.517134 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:23.532041 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7168c2-0ff3-4e6d-aad7-ba398d97dfa9 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:23.536784 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f1a72c-73a1-474c-bb9e-7cd3a6e84255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:23.537462 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f1a72c-73a1-474c-bb9e-7cd3a6e84255 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:23.537736 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f1a72c-73a1-474c-bb9e-7cd3a6e84255 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:23.538000 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f1a72c-73a1-474c-bb9e-7cd3a6e84255 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:23.545351 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f1a72c-73a1-474c-bb9e-7cd3a6e84255 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:23.546834 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f1a72c-73a1-474c-bb9e-7cd3a6e84255 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:23.558328 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-74f1a72c-73a1-474c-bb9e-7cd3a6e84255 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:42:23.558328 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:23.558328 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:23.558328 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:23.558328 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:23.558328 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:23.558328 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:23.558328 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:23.558328 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:23.558328 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:23.558328 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:23.558328 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:23.558328 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:42:23.558328 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:42:23.558328 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:42:23.559241 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:42:23.559241 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:23.559241 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:23.559241 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:23.559241 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:23.559241 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:23.559241 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:23.559241 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:23.559241 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:23.559241 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:23.559241 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:23.559241 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:23.559241 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:23.559241 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:23.559241 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:23.559241 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:23.559241 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:23.560103 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:42:23.560103 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:42:23.560103 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:42:23.560103 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:42:23.560103 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:42:23.560103 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:42:23.560103 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:42:23.560103 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:42:23.560103 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 331/671] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 19 14:42:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:23.560570 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f1a72c-73a1-474c-bb9e-7cd3a6e84255 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:23.572910 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cc9cd0-5b26-407a-85f6-702712b8a8b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:23.573668 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc9cd0-5b26-407a-85f6-702712b8a8b2 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:23.573953 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc9cd0-5b26-407a-85f6-702712b8a8b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:23.574225 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc9cd0-5b26-407a-85f6-702712b8a8b2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:23.581636 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cc9cd0-5b26-407a-85f6-702712b8a8b2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:23.583114 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cc9cd0-5b26-407a-85f6-702712b8a8b2 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:23.594923 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-55cc9cd0-5b26-407a-85f6-702712b8a8b2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:42:23.594923 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:23.594923 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:23.594923 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:23.594923 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:23.594923 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:23.594923 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:23.594923 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:23.594923 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:23.594923 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:23.594923 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:23.594923 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:23.594923 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:42:23.594923 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:42:23.594923 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:42:23.595828 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:42:23.595828 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:23.595828 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:23.595828 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:23.595828 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:23.595828 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:23.595828 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:23.595828 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:23.595828 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:23.595828 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:23.595828 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:23.595828 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:23.595828 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:23.595828 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:23.595828 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:23.595828 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:23.595828 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:23.596692 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:42:23.596692 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:42:23.596692 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:42:23.596692 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:42:23.596692 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:42:23.596692 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:42:23.596692 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:42:23.596692 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:23.596692 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 341/672] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 19 14:42:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:23.597656 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cc9cd0-5b26-407a-85f6-702712b8a8b2 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:23.666623 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f1a72c-73a1-474c-bb9e-7cd3a6e84255 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:23.703269 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994d38d6-f1b1-4959-b45c-1f3f56a67a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:23.703922 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d38d6-f1b1-4959-b45c-1f3f56a67a2b None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:23.704208 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d38d6-f1b1-4959-b45c-1f3f56a67a2b None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:23.704471 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d38d6-f1b1-4959-b45c-1f3f56a67a2b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:23.707704 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cc9cd0-5b26-407a-85f6-702712b8a8b2 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:23.712866 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994d38d6-f1b1-4959-b45c-1f3f56a67a2b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:23.714691 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994d38d6-f1b1-4959-b45c-1f3f56a67a2b None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:23.726778 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-994d38d6-f1b1-4959-b45c-1f3f56a67a2b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:42:23.726778 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:23.726778 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:23.726778 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:23.726778 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:23.726778 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:23.726778 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:23.726778 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:23.726778 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:23.726778 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:23.726778 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:23.726778 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:23.726778 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:42:23.726778 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:42:23.726778 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:42:23.727762 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:42:23.727762 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:23.727762 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:23.727762 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:23.727762 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:23.727762 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:23.727762 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:23.727762 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:23.727762 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:23.727762 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:23.727762 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:23.727762 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:23.727762 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:23.727762 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:23.727762 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:23.727762 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:23.727762 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:23.728626 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:42:23.728626 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:42:23.728626 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:42:23.728626 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:42:23.728626 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:42:23.728626 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:42:23.728626 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:42:23.728626 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:42:23.728626 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 332/673] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 19 14:42:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:23.729151 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994d38d6-f1b1-4959-b45c-1f3f56a67a2b None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:23.736007 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:23.752805 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25a80da-45a7-4040-9f32-723a857d29bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:23.753401 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a80da-45a7-4040-9f32-723a857d29bc None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:23.753673 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a80da-45a7-4040-9f32-723a857d29bc None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:23.753935 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a80da-45a7-4040-9f32-723a857d29bc None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:23.754699 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25a80da-45a7-4040-9f32-723a857d29bc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:23.754951 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25a80da-45a7-4040-9f32-723a857d29bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:23.756398 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25a80da-45a7-4040-9f32-723a857d29bc None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:23.771695 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 342/674] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 19 14:42:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:23.771695 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25a80da-45a7-4040-9f32-723a857d29bc None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:23.780065 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:23.846794 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994d38d6-f1b1-4959-b45c-1f3f56a67a2b None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:23.872625 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25a80da-45a7-4040-9f32-723a857d29bc None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:23.880736 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916bba80-0bce-4004-88d2-e49f7309834c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:23.881379 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916bba80-0bce-4004-88d2-e49f7309834c None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:23.881655 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916bba80-0bce-4004-88d2-e49f7309834c None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:23.881923 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916bba80-0bce-4004-88d2-e49f7309834c None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:23.882624 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916bba80-0bce-4004-88d2-e49f7309834c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:23.882927 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916bba80-0bce-4004-88d2-e49f7309834c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:23.884363 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916bba80-0bce-4004-88d2-e49f7309834c None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:23.896513 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 333/675] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 19 14:42:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:23.897353 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916bba80-0bce-4004-88d2-e49f7309834c None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:23.912898 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf1cee3-91aa-4d61-8607-0e85c280085c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:23.913533 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1cee3-91aa-4d61-8607-0e85c280085c None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:23.913811 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1cee3-91aa-4d61-8607-0e85c280085c None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:23.914076 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1cee3-91aa-4d61-8607-0e85c280085c None admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:23.914775 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf1cee3-91aa-4d61-8607-0e85c280085c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:23.915089 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf1cee3-91aa-4d61-8607-0e85c280085c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:23.916526 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf1cee3-91aa-4d61-8607-0e85c280085c None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:23.928834 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 343/676] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 19 14:42:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:23.929748 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf1cee3-91aa-4d61-8607-0e85c280085c None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:23.974087 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:23.996288 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:24.002730 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916bba80-0bce-4004-88d2-e49f7309834c None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:24.034867 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf1cee3-91aa-4d61-8607-0e85c280085c None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:24.036576 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2307f2-5b57-495d-89ba-9788c856fcb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:24.037201 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2307f2-5b57-495d-89ba-9788c856fcb1 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:24.037479 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2307f2-5b57-495d-89ba-9788c856fcb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:24.037745 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2307f2-5b57-495d-89ba-9788c856fcb1 None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:24.038428 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2307f2-5b57-495d-89ba-9788c856fcb1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:24.038728 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2307f2-5b57-495d-89ba-9788c856fcb1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:24.040169 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2307f2-5b57-495d-89ba-9788c856fcb1 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:24.052725 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 334/677] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 19 14:42:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:24.053929 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08498ab3-9736-42ea-910c-94e50304954e None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:24.054211 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08498ab3-9736-42ea-910c-94e50304954e None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:24.054481 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08498ab3-9736-42ea-910c-94e50304954e None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:24.055844 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 335/678] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:42:24 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:42:24.056355 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08498ab3-9736-42ea-910c-94e50304954e None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:24.074261 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591de712-f493-4d7f-8d94-8555a66c1fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:24.075047 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591de712-f493-4d7f-8d94-8555a66c1fb4 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:24.075615 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591de712-f493-4d7f-8d94-8555a66c1fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:24.075887 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591de712-f493-4d7f-8d94-8555a66c1fb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:24.085971 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591de712-f493-4d7f-8d94-8555a66c1fb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:24.087417 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591de712-f493-4d7f-8d94-8555a66c1fb4 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:24.102890 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-591de712-f493-4d7f-8d94-8555a66c1fb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:24.102890 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:24.102890 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:24.102890 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:24.102890 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:24.102890 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:24.102890 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:24.102890 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:24.102890 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:24.102890 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:24.102890 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:24.102890 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:24.102890 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:42:24.102890 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:42:24.102890 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:42:24.102890 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:42:24.103858 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:24.103858 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:24.103858 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:24.103858 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:24.103858 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:24.103858 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:24.103858 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:24.103858 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:24.103858 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:24.103858 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:24.103858 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:24.103858 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:24.103858 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:24.103858 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:24.103858 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:24.103858 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:24.103858 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:42:24.104930 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:42:24.104930 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:24.104930 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:24.104930 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 344/679] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:42:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:24.105372 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591de712-f493-4d7f-8d94-8555a66c1fb4 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:24.158657 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08498ab3-9736-42ea-910c-94e50304954e None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:24.191514 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1711343-2cce-4699-ac9e-382da537ac1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:24.192103 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1711343-2cce-4699-ac9e-382da537ac1d None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:24.192375 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1711343-2cce-4699-ac9e-382da537ac1d None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:24.192641 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1711343-2cce-4699-ac9e-382da537ac1d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:24.193376 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1711343-2cce-4699-ac9e-382da537ac1d None admin] RBAC: Adding query filter params (role.id=3d5d4018951045e18e7577ee742c10ca, scope.project.id=9ede5dc59ece4d9282867a99e94c4c41, user.id=df648c909ddb41418128b43f925f5ed4) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:24.193672 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1711343-2cce-4699-ac9e-382da537ac1d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:24.195096 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1711343-2cce-4699-ac9e-382da537ac1d None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:24.205613 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 336/680] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 19 14:42:24 2022] GET /identity/v3/role_assignments?user.id=df648c909ddb41418128b43f925f5ed4&scope.project.id=9ede5dc59ece4d9282867a99e94c4c41&role.id=3d5d4018951045e18e7577ee742c10ca => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:24.205613 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1711343-2cce-4699-ac9e-382da537ac1d None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:24.211430 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:24.214190 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591de712-f493-4d7f-8d94-8555a66c1fb4 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:24.242475 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:24.257786 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f8c626-e193-4b10-af53-65a9eb08fbce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:24.258401 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f8c626-e193-4b10-af53-65a9eb08fbce None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:24.258674 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f8c626-e193-4b10-af53-65a9eb08fbce None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:24.258940 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f8c626-e193-4b10-af53-65a9eb08fbce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:24.259708 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f8c626-e193-4b10-af53-65a9eb08fbce None admin] RBAC: Adding query filter params (role.id=3d5d4018951045e18e7577ee742c10ca, scope.project.id=9ede5dc59ece4d9282867a99e94c4c41, user.id=f5d4e9c3da83402dbe7938aaf2dcbb8f) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:24.260015 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f8c626-e193-4b10-af53-65a9eb08fbce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:24.261619 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f8c626-e193-4b10-af53-65a9eb08fbce None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:24.269047 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 345/681] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 19 14:42:24 2022] GET /identity/v3/role_assignments?user.id=f5d4e9c3da83402dbe7938aaf2dcbb8f&scope.project.id=9ede5dc59ece4d9282867a99e94c4c41&role.id=3d5d4018951045e18e7577ee742c10ca => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:24.274574 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f34826-177f-407b-98e6-3879b463929c None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:24.277037 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f34826-177f-407b-98e6-3879b463929c None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:24.277923 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f34826-177f-407b-98e6-3879b463929c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:24.301164 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-a4f34826-177f-407b-98e6-3879b463929c None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:42:24.302404 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-a4f34826-177f-407b-98e6-3879b463929c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:42:24.366968 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1711343-2cce-4699-ac9e-382da537ac1d None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:24.397831 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 346/682] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:42:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:42:24.398568 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f34826-177f-407b-98e6-3879b463929c None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:24.418269 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b788249-4ed0-4941-af29-de587ffcb23e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:24.419918 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b788249-4ed0-4941-af29-de587ffcb23e None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:24.420194 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b788249-4ed0-4941-af29-de587ffcb23e None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:24.420464 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b788249-4ed0-4941-af29-de587ffcb23e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:24.421611 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b788249-4ed0-4941-af29-de587ffcb23e None admin] RBAC: Adding query filter params (role.id=3d5d4018951045e18e7577ee742c10ca, scope.project.id=9ede5dc59ece4d9282867a99e94c4c41, user.id=d20a0d24e7034b6db447ba842ac986dd) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:24.421929 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b788249-4ed0-4941-af29-de587ffcb23e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:24.423498 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b788249-4ed0-4941-af29-de587ffcb23e None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:24.431874 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 337/683] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 19 14:42:24 2022] GET /identity/v3/role_assignments?user.id=d20a0d24e7034b6db447ba842ac986dd&scope.project.id=9ede5dc59ece4d9282867a99e94c4c41&role.id=3d5d4018951045e18e7577ee742c10ca => generated 608 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:24.535332 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:24.549790 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f34826-177f-407b-98e6-3879b463929c None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:24.589716 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75364a0-0e0b-4a2f-9022-7d4d60770e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:24.590706 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75364a0-0e0b-4a2f-9022-7d4d60770e9f None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:24.591183 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75364a0-0e0b-4a2f-9022-7d4d60770e9f None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:24.591647 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75364a0-0e0b-4a2f-9022-7d4d60770e9f None admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:24.592819 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75364a0-0e0b-4a2f-9022-7d4d60770e9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:24.593337 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75364a0-0e0b-4a2f-9022-7d4d60770e9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:24.594948 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75364a0-0e0b-4a2f-9022-7d4d60770e9f None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:24.610028 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 347/684] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 19 14:42:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:24.616072 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b788249-4ed0-4941-af29-de587ffcb23e None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:24.678828 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75364a0-0e0b-4a2f-9022-7d4d60770e9f None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:24.732599 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:24.754470 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b788249-4ed0-4941-af29-de587ffcb23e None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:24.808293 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75364a0-0e0b-4a2f-9022-7d4d60770e9f None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:24.816312 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3df7ea4-00d4-4ea2-86c6-8c2995aad46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:24.816944 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df7ea4-00d4-4ea2-86c6-8c2995aad46e None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:24.817268 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df7ea4-00d4-4ea2-86c6-8c2995aad46e None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:24.817533 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df7ea4-00d4-4ea2-86c6-8c2995aad46e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:24.827444 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3df7ea4-00d4-4ea2-86c6-8c2995aad46e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:24.828910 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3df7ea4-00d4-4ea2-86c6-8c2995aad46e None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:24.854351 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-c3df7ea4-00d4-4ea2-86c6-8c2995aad46e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 19 14:42:24.854351 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:24.854351 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:24.854351 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:24.854351 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:24.854351 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:24.854351 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:24.854351 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:24.854351 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:24.854351 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:24.854351 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:24.854351 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:24.854351 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:42:24.854351 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:42:24.854351 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:42:24.854351 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:42:24.855321 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:24.855321 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:24.855321 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:42:24.855321 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:42:24.855321 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:42:24.855321 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:42:24.855321 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:24.855321 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:24.855321 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:24.855321 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:24.855321 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:24.855321 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:24.855321 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:24.855321 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:24.855321 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:24.855321 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:24.855321 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:24.855321 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:24.856272 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:24.856272 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:24.856272 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:42:24.856272 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:42:24.856272 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:42:24.856272 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:42:24.856272 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:42:24.856272 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:42:24.856272 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 19 14:42:24.856272 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:42:24.860319 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 338/685] 10.222.0.26 () {56 vars in 1093 bytes} [Mon Sep 19 14:42:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:24.863145 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3df7ea4-00d4-4ea2-86c6-8c2995aad46e None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:24.870443 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8676f7-2b68-4535-bfdc-4420e0f512eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:24.871089 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8676f7-2b68-4535-bfdc-4420e0f512eb None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:24.871363 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8676f7-2b68-4535-bfdc-4420e0f512eb None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:24.871628 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8676f7-2b68-4535-bfdc-4420e0f512eb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:24.895254 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8676f7-2b68-4535-bfdc-4420e0f512eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:42:24.903334 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-cc8676f7-2b68-4535-bfdc-4420e0f512eb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:42:24.903334 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:24.903334 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:24.903334 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:24.903334 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:24.903334 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:24.903334 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:24.903334 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:24.903334 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:24.903334 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:24.903334 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:24.903334 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:24.903334 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:42:24.903334 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:42:24.903334 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:42:24.903334 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:42:24.905759 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:42:24.905759 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:42:24.905759 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:42:24.905759 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:42:24.905759 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:24.905759 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:24.905759 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:24.905759 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:24.905759 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:24.905759 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:24.905759 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:24.905759 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:24.905759 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:24.905759 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:24.905759 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:24.905759 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:24.907672 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:24.907672 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:24.907672 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:24.907672 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:24.907672 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:42:24.907672 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:42:24.907672 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:42:24.907672 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:42:24.907672 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:42:24.907672 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:42:24.907672 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:42:24.907672 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:24.909717 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 348/686] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Sep 19 14:42:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:42:24.910584 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8676f7-2b68-4535-bfdc-4420e0f512eb None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:24.926052 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:25.007275 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3df7ea4-00d4-4ea2-86c6-8c2995aad46e None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:25.044577 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5d3d8a-ae0c-46dd-ad11-08dfd0b2c4a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:25.045713 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d3d8a-ae0c-46dd-ad11-08dfd0b2c4a8 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:25.046287 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d3d8a-ae0c-46dd-ad11-08dfd0b2c4a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:25.046763 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d3d8a-ae0c-46dd-ad11-08dfd0b2c4a8 None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:25.047774 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5d3d8a-ae0c-46dd-ad11-08dfd0b2c4a8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:25.048275 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5d3d8a-ae0c-46dd-ad11-08dfd0b2c4a8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:25.050073 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5d3d8a-ae0c-46dd-ad11-08dfd0b2c4a8 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:25.064208 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8676f7-2b68-4535-bfdc-4420e0f512eb None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:25.071221 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 339/687] 10.222.0.26 () {56 vars in 1133 bytes} [Mon Sep 19 14:42:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:25.077247 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5d3d8a-ae0c-46dd-ad11-08dfd0b2c4a8 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:25.080608 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:25.102295 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f0c734-dd36-402d-95ad-92811ef9d22f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:25.102899 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0c734-dd36-402d-95ad-92811ef9d22f None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:25.103174 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0c734-dd36-402d-95ad-92811ef9d22f None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:25.103439 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0c734-dd36-402d-95ad-92811ef9d22f None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:25.104095 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f0c734-dd36-402d-95ad-92811ef9d22f None admin] RBAC: Adding query filter params (name=service) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:25.104472 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f0c734-dd36-402d-95ad-92811ef9d22f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:25.105841 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f0c734-dd36-402d-95ad-92811ef9d22f None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:25.114868 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 349/688] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Sep 19 14:42:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:42:25.120408 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f0c734-dd36-402d-95ad-92811ef9d22f None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:25.213457 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:25.215836 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5d3d8a-ae0c-46dd-ad11-08dfd0b2c4a8 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:25.238393 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f0c734-dd36-402d-95ad-92811ef9d22f None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:25.275999 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfa5f9b-cb65-4255-b45d-d1143b614673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:25.277115 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa5f9b-cb65-4255-b45d-d1143b614673 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:25.277706 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa5f9b-cb65-4255-b45d-d1143b614673 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:25.278248 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa5f9b-cb65-4255-b45d-d1143b614673 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:25.281983 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0cbb53-f839-453d-9436-7bbb1b423e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:25.281983 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0cbb53-f839-453d-9436-7bbb1b423e06 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:25.281983 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0cbb53-f839-453d-9436-7bbb1b423e06 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:25.281983 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0cbb53-f839-453d-9436-7bbb1b423e06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:25.291541 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0cbb53-f839-453d-9436-7bbb1b423e06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:25.293200 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0cbb53-f839-453d-9436-7bbb1b423e06 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:25.308143 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-6a0cbb53-f839-453d-9436-7bbb1b423e06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:25.308143 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:25.308143 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:25.308143 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:25.308143 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:25.308143 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:25.308143 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:25.308143 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:25.308143 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:25.308143 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:25.308143 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:25.308143 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:25.308143 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:42:25.308143 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:42:25.308143 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:42:25.308143 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:42:25.309447 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:25.309447 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:25.309447 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:25.309447 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:25.309447 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:25.309447 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:25.309447 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:25.309447 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:25.309447 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:25.309447 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:25.309447 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:25.309447 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:25.309447 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:25.309447 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:25.309447 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:25.309447 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:25.309447 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:42:25.310334 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:42:25.310334 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:25.310334 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:25.310334 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 350/689] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:42:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:25.322049 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0cbb53-f839-453d-9436-7bbb1b423e06 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:25.368427 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfa5f9b-cb65-4255-b45d-d1143b614673 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:25.370423 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfa5f9b-cb65-4255-b45d-d1143b614673 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:25.372939 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:25.481075 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 340/690] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 19 14:42:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 19 14:42:25.487406 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfa5f9b-cb65-4255-b45d-d1143b614673 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:25.523598 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0cbb53-f839-453d-9436-7bbb1b423e06 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:25.577112 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:25.603148 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfa5f9b-cb65-4255-b45d-d1143b614673 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:25.605101 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:25.605366 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddcee1a-a85a-4c86-a1e4-9d2a68557d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:25.606363 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddcee1a-a85a-4c86-a1e4-9d2a68557d7b None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:25.607847 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddcee1a-a85a-4c86-a1e4-9d2a68557d7b None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:25.607847 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddcee1a-a85a-4c86-a1e4-9d2a68557d7b None admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:25.608203 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddcee1a-a85a-4c86-a1e4-9d2a68557d7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:25.608509 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddcee1a-a85a-4c86-a1e4-9d2a68557d7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:25.610209 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddcee1a-a85a-4c86-a1e4-9d2a68557d7b None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:25.630789 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 351/691] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 19 14:42:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:25.636179 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddcee1a-a85a-4c86-a1e4-9d2a68557d7b None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:25.643464 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ec4773-9b5c-43d6-a2de-fc490914e5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:25.644404 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec4773-9b5c-43d6-a2de-fc490914e5ff None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:25.644917 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec4773-9b5c-43d6-a2de-fc490914e5ff None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:25.645426 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec4773-9b5c-43d6-a2de-fc490914e5ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:25.656408 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ec4773-9b5c-43d6-a2de-fc490914e5ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:25.658249 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ec4773-9b5c-43d6-a2de-fc490914e5ff None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:25.674728 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-52ec4773-9b5c-43d6-a2de-fc490914e5ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:25.674728 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:25.674728 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:25.674728 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:25.674728 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:25.674728 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:25.674728 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:25.674728 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:25.674728 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:25.674728 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:25.674728 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:25.674728 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:25.674728 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:42:25.674728 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:42:25.674728 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:42:25.674728 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:42:25.675758 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:25.675758 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:25.675758 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:25.675758 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:25.675758 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:25.675758 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:25.675758 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:25.675758 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:25.675758 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:25.675758 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:25.675758 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:25.675758 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:25.675758 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:25.675758 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:25.675758 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:25.675758 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:25.675758 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:42:25.676661 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:42:25.676661 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:25.676661 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:42:25.678863 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 341/692] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:42:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:25.684868 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ec4773-9b5c-43d6-a2de-fc490914e5ff None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:25.793514 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ec4773-9b5c-43d6-a2de-fc490914e5ff None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:25.830020 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddcee1a-a85a-4c86-a1e4-9d2a68557d7b None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:25.831787 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b58a6a-4b0b-47a7-a2f6-5d87f7f34569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:25.833087 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b58a6a-4b0b-47a7-a2f6-5d87f7f34569 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:25.833560 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b58a6a-4b0b-47a7-a2f6-5d87f7f34569 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:25.834018 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b58a6a-4b0b-47a7-a2f6-5d87f7f34569 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:25.834848 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b58a6a-4b0b-47a7-a2f6-5d87f7f34569 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:25.835354 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b58a6a-4b0b-47a7-a2f6-5d87f7f34569 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:25.836938 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b58a6a-4b0b-47a7-a2f6-5d87f7f34569 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:25.850630 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 342/693] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 19 14:42:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:25.856549 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b58a6a-4b0b-47a7-a2f6-5d87f7f34569 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:25.873348 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:25.914277 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b525b2c-1d4c-4148-98b4-b84df0d3e3f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:25.914930 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b525b2c-1d4c-4148-98b4-b84df0d3e3f5 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:25.915207 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b525b2c-1d4c-4148-98b4-b84df0d3e3f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:25.915474 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b525b2c-1d4c-4148-98b4-b84df0d3e3f5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:25.930125 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b525b2c-1d4c-4148-98b4-b84df0d3e3f5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:25.931625 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b525b2c-1d4c-4148-98b4-b84df0d3e3f5 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:25.961348 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-3b525b2c-1d4c-4148-98b4-b84df0d3e3f5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 19 14:42:25.961348 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:25.961348 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:25.961348 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:25.961348 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:25.961348 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:25.961348 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:25.961348 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:25.961348 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:25.961348 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:25.961348 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:25.961348 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:25.961348 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:42:25.961348 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:42:25.961348 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:42:25.961348 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:42:25.962340 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:25.962340 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:25.962340 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:42:25.962340 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:42:25.962340 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:42:25.962340 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:42:25.962340 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:25.962340 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:25.962340 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:25.962340 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:25.962340 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:25.962340 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:25.962340 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:25.962340 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:25.962340 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:25.962340 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:25.962340 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:25.962340 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:25.963258 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:25.963258 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:25.963258 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:42:25.963258 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:42:25.963258 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:42:25.963258 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:42:25.963258 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:42:25.963258 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:42:25.963258 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 19 14:42:25.963258 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:25.965845 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b58a6a-4b0b-47a7-a2f6-5d87f7f34569 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:25.968215 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 352/694] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 19 14:42:25 2022] GET /identity/v3/users/swift => generated 83 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:25.973408 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b525b2c-1d4c-4148-98b4-b84df0d3e3f5 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:26.004959 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239317fe-c982-4d5e-948a-beb4687b9e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:26.013016 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239317fe-c982-4d5e-948a-beb4687b9e1d None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:26.013016 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239317fe-c982-4d5e-948a-beb4687b9e1d None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:26.013016 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239317fe-c982-4d5e-948a-beb4687b9e1d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:26.014317 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239317fe-c982-4d5e-948a-beb4687b9e1d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:26.015919 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239317fe-c982-4d5e-948a-beb4687b9e1d None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:26.028077 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-239317fe-c982-4d5e-948a-beb4687b9e1d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:42:26.028077 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:26.028077 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:26.028077 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:26.028077 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:26.028077 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:26.028077 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:26.028077 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:26.028077 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:26.028077 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:26.028077 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:26.028077 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:26.028077 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:42:26.028077 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:42:26.028077 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:42:26.029011 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:42:26.029011 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:26.029011 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:26.029011 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:26.029011 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:26.029011 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:26.029011 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:26.029011 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:26.029011 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:26.029011 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:26.029011 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:26.029011 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:26.029011 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:26.029011 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:26.029011 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:26.029011 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:26.029011 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:26.029902 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:42:26.029902 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:42:26.029902 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:42:26.029902 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:42:26.029902 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:42:26.029902 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:42:26.029902 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:42:26.029902 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:42:26.029902 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 343/695] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 19 14:42:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:26.035612 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239317fe-c982-4d5e-948a-beb4687b9e1d None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:26.072134 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:26.161344 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:26.186585 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b525b2c-1d4c-4148-98b4-b84df0d3e3f5 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:26.216352 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239317fe-c982-4d5e-948a-beb4687b9e1d None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:26.230270 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a5bbea-669d-4739-9876-2f8a0bcdea12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:26.230888 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a5bbea-669d-4739-9876-2f8a0bcdea12 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:26.231164 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a5bbea-669d-4739-9876-2f8a0bcdea12 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:26.231432 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a5bbea-669d-4739-9876-2f8a0bcdea12 None admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:26.232169 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a5bbea-669d-4739-9876-2f8a0bcdea12 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:26.232471 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a5bbea-669d-4739-9876-2f8a0bcdea12 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:26.235053 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a5bbea-669d-4739-9876-2f8a0bcdea12 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:26.273406 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 353/696] 10.222.0.26 () {56 vars in 1135 bytes} [Mon Sep 19 14:42:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:26.279918 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a5bbea-669d-4739-9876-2f8a0bcdea12 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:26.290810 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae01db2-fcdf-4127-acc9-62255b5a5c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:26.291442 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae01db2-fcdf-4127-acc9-62255b5a5c1d None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:26.291818 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae01db2-fcdf-4127-acc9-62255b5a5c1d None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:26.292727 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae01db2-fcdf-4127-acc9-62255b5a5c1d None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:26.301088 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae01db2-fcdf-4127-acc9-62255b5a5c1d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:26.301088 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae01db2-fcdf-4127-acc9-62255b5a5c1d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:26.301088 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae01db2-fcdf-4127-acc9-62255b5a5c1d None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:26.317504 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 344/697] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 19 14:42:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:26.323142 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae01db2-fcdf-4127-acc9-62255b5a5c1d None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:26.402081 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:26.406710 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a5bbea-669d-4739-9876-2f8a0bcdea12 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:26.452556 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93d9518-f4e3-4aad-b084-4740daac7ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:26.453521 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d9518-f4e3-4aad-b084-4740daac7ba9 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:26.453974 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d9518-f4e3-4aad-b084-4740daac7ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:26.454434 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d9518-f4e3-4aad-b084-4740daac7ba9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:26.533587 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93d9518-f4e3-4aad-b084-4740daac7ba9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:26.535384 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93d9518-f4e3-4aad-b084-4740daac7ba9 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:26.561213 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae01db2-fcdf-4127-acc9-62255b5a5c1d None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:26.645538 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:26.648472 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d89283d-469e-4a47-a486-7c9bd5a97fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:26.649122 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d89283d-469e-4a47-a486-7c9bd5a97fc1 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:26.649408 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d89283d-469e-4a47-a486-7c9bd5a97fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:26.649721 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d89283d-469e-4a47-a486-7c9bd5a97fc1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:26.650473 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d89283d-469e-4a47-a486-7c9bd5a97fc1 None admin] RBAC: Adding query filter params (role.id=019bde1756cb40de8ce06cef6b261f79, scope.project.id=9ede5dc59ece4d9282867a99e94c4c41, user.id=3017e5d92bef4cc2aeae4f28c78ba233) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:26.650796 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d89283d-469e-4a47-a486-7c9bd5a97fc1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:26.652425 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 354/698] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 19 14:42:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 14:42:26.652552 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d89283d-469e-4a47-a486-7c9bd5a97fc1 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:26.655266 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:26.658457 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93d9518-f4e3-4aad-b084-4740daac7ba9 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:26.662385 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 345/699] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 19 14:42:26 2022] GET /identity/v3/role_assignments?user.id=3017e5d92bef4cc2aeae4f28c78ba233&scope.project.id=9ede5dc59ece4d9282867a99e94c4c41&role.id=019bde1756cb40de8ce06cef6b261f79 => generated 259 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:26.808787 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93d9518-f4e3-4aad-b084-4740daac7ba9 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:26.867796 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfac59c3-9908-4ed5-a5a6-3f66a8ed43b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:26.868444 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfac59c3-9908-4ed5-a5a6-3f66a8ed43b6 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:26.868721 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfac59c3-9908-4ed5-a5a6-3f66a8ed43b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:26.868980 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfac59c3-9908-4ed5-a5a6-3f66a8ed43b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:26.881897 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfac59c3-9908-4ed5-a5a6-3f66a8ed43b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:26.883365 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfac59c3-9908-4ed5-a5a6-3f66a8ed43b6 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:26.900018 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-bfac59c3-9908-4ed5-a5a6-3f66a8ed43b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:26.900018 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:26.900018 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:26.900018 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:26.900018 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:26.900018 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:26.900018 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:26.900018 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:26.900018 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:26.900018 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:26.900018 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:26.900018 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:26.900018 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:42:26.900018 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:42:26.900018 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:42:26.900018 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:42:26.901138 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:26.901138 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:26.901138 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:26.901138 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:26.901138 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:26.901138 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:26.901138 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:26.901138 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:26.901138 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:26.901138 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:26.901138 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:26.901138 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:26.901138 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:26.901138 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:26.901138 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:26.901138 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:26.901138 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:42:26.902300 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:42:26.902300 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:26.902300 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:26.902300 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 355/700] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:42:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:26.907233 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d89283d-469e-4a47-a486-7c9bd5a97fc1 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:26.976121 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e656d-272d-4ffe-bcc0-71d1437388c2 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:26.976462 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e656d-272d-4ffe-bcc0-71d1437388c2 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:26.976666 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e656d-272d-4ffe-bcc0-71d1437388c2 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:26.978047 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 356/701] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:42:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:42:26.991355 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2f3c53-0226-4596-8ffc-e5121cf8eb74 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:26.991681 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2f3c53-0226-4596-8ffc-e5121cf8eb74 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:26.991953 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2f3c53-0226-4596-8ffc-e5121cf8eb74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:27.031551 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-7c2f3c53-0226-4596-8ffc-e5121cf8eb74 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:42:27.039135 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-7c2f3c53-0226-4596-8ffc-e5121cf8eb74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:42:27.093850 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d89283d-469e-4a47-a486-7c9bd5a97fc1 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:27.139139 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:27.165012 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f1f3e9-cff9-48bd-8c54-51b232923ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:27.167418 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f1f3e9-cff9-48bd-8c54-51b232923ddf None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:27.167997 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f1f3e9-cff9-48bd-8c54-51b232923ddf None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:27.168469 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f1f3e9-cff9-48bd-8c54-51b232923ddf None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:27.169721 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f1f3e9-cff9-48bd-8c54-51b232923ddf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:27.170656 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f1f3e9-cff9-48bd-8c54-51b232923ddf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:27.173204 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f1f3e9-cff9-48bd-8c54-51b232923ddf None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:27.177694 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 357/702] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:42:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:42:27.178989 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2298c7-a8f2-4198-9e3f-3d6fed58d6a4 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:27.179265 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2298c7-a8f2-4198-9e3f-3d6fed58d6a4 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:27.179529 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2298c7-a8f2-4198-9e3f-3d6fed58d6a4 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:27.185310 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 358/703] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:42:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:42:27.189620 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 346/704] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 19 14:42:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:27.190760 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15175b4d-c707-4694-95d8-1af2b80cc682 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:27.191042 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15175b4d-c707-4694-95d8-1af2b80cc682 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:27.191310 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15175b4d-c707-4694-95d8-1af2b80cc682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:27.194887 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f1f3e9-cff9-48bd-8c54-51b232923ddf None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:27.229801 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-15175b4d-c707-4694-95d8-1af2b80cc682 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:42:27.232370 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-15175b4d-c707-4694-95d8-1af2b80cc682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:42:27.297717 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:27.364222 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 359/705] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:42:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 14:42:27.372104 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f1f3e9-cff9-48bd-8c54-51b232923ddf None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:27.408468 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb703a4b-1ce4-439e-87f1-90fa798e0dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:27.410631 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64085762-883e-4658-bf18-6ac2ee522887 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:27.411160 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64085762-883e-4658-bf18-6ac2ee522887 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:27.411629 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64085762-883e-4658-bf18-6ac2ee522887 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:27.413322 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 360/706] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:42:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 14:42:27.414083 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb703a4b-1ce4-439e-87f1-90fa798e0dc8 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:27.414610 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb703a4b-1ce4-439e-87f1-90fa798e0dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:27.415080 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb703a4b-1ce4-439e-87f1-90fa798e0dc8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:27.419417 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b24eea-d476-4805-b252-f5c12e8cac4a None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:27.419703 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b24eea-d476-4805-b252-f5c12e8cac4a None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:27.420324 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b24eea-d476-4805-b252-f5c12e8cac4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:27.428409 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb703a4b-1ce4-439e-87f1-90fa798e0dc8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:27.430138 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb703a4b-1ce4-439e-87f1-90fa798e0dc8 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:27.444356 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-fb703a4b-1ce4-439e-87f1-90fa798e0dc8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:42:27.444356 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:27.444356 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:27.444356 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:27.444356 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:27.444356 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:27.444356 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:27.444356 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:27.444356 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:27.444356 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:27.444356 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:27.444356 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:27.444356 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:42:27.444356 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:42:27.444356 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:42:27.445315 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:42:27.445315 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:27.445315 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:27.445315 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:27.445315 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:27.445315 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:27.445315 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:27.445315 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:27.445315 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:27.445315 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:27.445315 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:27.445315 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:27.445315 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:27.445315 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:27.445315 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:27.445315 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:27.445315 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:27.446189 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:42:27.446189 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:42:27.446189 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:42:27.446189 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:42:27.446189 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:42:27.446189 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:42:27.446189 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:42:27.446189 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:42:27.449506 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 347/707] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 19 14:42:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:42:27.451430 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-00b24eea-d476-4805-b252-f5c12e8cac4a None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:42:27.452864 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-00b24eea-d476-4805-b252-f5c12e8cac4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:42:27.455006 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb703a4b-1ce4-439e-87f1-90fa798e0dc8 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:27.537097 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 361/708] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:42:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:42:27.538342 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b24eea-d476-4805-b252-f5c12e8cac4a None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:27.587429 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb703a4b-1ce4-439e-87f1-90fa798e0dc8 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:27.607610 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:27.627295 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e4ef29-fbe1-4603-b856-cbd76361c968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:27.627828 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e4ef29-fbe1-4603-b856-cbd76361c968 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:27.628107 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e4ef29-fbe1-4603-b856-cbd76361c968 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:27.628377 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e4ef29-fbe1-4603-b856-cbd76361c968 None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:27.629163 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e4ef29-fbe1-4603-b856-cbd76361c968 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:27.629473 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e4ef29-fbe1-4603-b856-cbd76361c968 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:27.633012 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e4ef29-fbe1-4603-b856-cbd76361c968 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:27.645344 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 348/709] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 19 14:42:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:27.657046 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e4ef29-fbe1-4603-b856-cbd76361c968 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:27.660828 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:27.751642 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b24eea-d476-4805-b252-f5c12e8cac4a None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:27.789987 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51652da-a078-428e-8606-e35e046803ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:27.790950 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51652da-a078-428e-8606-e35e046803ac None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:27.791230 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51652da-a078-428e-8606-e35e046803ac None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:27.791870 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51652da-a078-428e-8606-e35e046803ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:27.800652 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e4ef29-fbe1-4603-b856-cbd76361c968 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:27.803148 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51652da-a078-428e-8606-e35e046803ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:27.804608 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51652da-a078-428e-8606-e35e046803ac None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:27.820510 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-e51652da-a078-428e-8606-e35e046803ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:27.820510 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:27.820510 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:27.820510 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:27.820510 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:27.820510 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:27.820510 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:27.820510 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:27.820510 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:27.820510 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:27.820510 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:27.820510 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:27.820510 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:42:27.820510 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:42:27.820510 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:42:27.820510 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:42:27.821666 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:27.821666 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:27.821666 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:27.821666 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:27.821666 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:27.821666 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:27.821666 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:27.821666 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:27.821666 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:27.821666 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:27.821666 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:27.821666 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:27.821666 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:27.821666 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:27.821666 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:27.821666 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:27.821666 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:42:27.823566 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:42:27.823566 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:27.823566 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:27.823566 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 362/710] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:42:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:27.823566 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51652da-a078-428e-8606-e35e046803ac None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:27.843772 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1d6161-d95e-4fee-9f49-2769fc4e0978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:27.844539 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d6161-d95e-4fee-9f49-2769fc4e0978 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:27.844815 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d6161-d95e-4fee-9f49-2769fc4e0978 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:27.845398 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d6161-d95e-4fee-9f49-2769fc4e0978 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:27.846131 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1d6161-d95e-4fee-9f49-2769fc4e0978 None admin] RBAC: Adding query filter params (role.id=3d5d4018951045e18e7577ee742c10ca, scope.project.id=9ede5dc59ece4d9282867a99e94c4c41, user.id=76cb60a5e90343e69a38db4356cb3a90) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:27.846441 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1d6161-d95e-4fee-9f49-2769fc4e0978 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:27.847893 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1d6161-d95e-4fee-9f49-2769fc4e0978 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:27.861187 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 349/711] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 19 14:42:27 2022] GET /identity/v3/role_assignments?user.id=76cb60a5e90343e69a38db4356cb3a90&scope.project.id=9ede5dc59ece4d9282867a99e94c4c41&role.id=3d5d4018951045e18e7577ee742c10ca => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:27.862040 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1d6161-d95e-4fee-9f49-2769fc4e0978 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:27.920681 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:27.945808 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:27.954963 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51652da-a078-428e-8606-e35e046803ac None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:27.994935 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e61c65-83c0-4022-9bb3-be13fa436af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:27.996125 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e61c65-83c0-4022-9bb3-be13fa436af5 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:27.996605 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e61c65-83c0-4022-9bb3-be13fa436af5 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:27.997099 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e61c65-83c0-4022-9bb3-be13fa436af5 None admin] PATH_INFO: `/v3/services/network` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:27.998446 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e61c65-83c0-4022-9bb3-be13fa436af5 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:28.000206 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e61c65-83c0-4022-9bb3-be13fa436af5 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:28.012062 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1d6161-d95e-4fee-9f49-2769fc4e0978 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:28.013523 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-77e61c65-83c0-4022-9bb3-be13fa436af5 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 19 14:42:28.013523 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:28.013523 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 14:42:28.013523 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 14:42:28.013523 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 14:42:28.013523 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 14:42:28.013523 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 14:42:28.013523 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:42:28.013523 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 19 14:42:28.013523 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:28.013523 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 14:42:28.013523 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:28.013523 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:28.013523 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:28.013523 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:28.013523 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:28.013523 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:28.014539 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:28.014539 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:28.014539 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:28.014539 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:28.014539 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:28.014539 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:28.014539 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 14:42:28.014539 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 14:42:28.014539 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 14:42:28.014539 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 14:42:28.014539 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:28.014539 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:28.014539 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:28.014539 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:28.014539 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:28.014539 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:28.015387 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:28.015387 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:28.015387 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:28.015387 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:28.015387 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:28.015387 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:28.015387 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:28.015387 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:28.015387 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:28.015387 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:28.015387 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 14:42:28.015387 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:42:28.015387 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 19 14:42:28.015387 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:28.018050 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 363/712] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 19 14:42:27 2022] GET /identity/v3/services/network => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:28.019316 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e61c65-83c0-4022-9bb3-be13fa436af5 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:28.069938 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6812df-b688-4ee9-a166-3ce8dfd1368a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:28.070556 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6812df-b688-4ee9-a166-3ce8dfd1368a None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:28.070880 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6812df-b688-4ee9-a166-3ce8dfd1368a None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:28.071163 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6812df-b688-4ee9-a166-3ce8dfd1368a None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:28.071817 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6812df-b688-4ee9-a166-3ce8dfd1368a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:28.072118 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6812df-b688-4ee9-a166-3ce8dfd1368a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:28.074295 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6812df-b688-4ee9-a166-3ce8dfd1368a None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:28.089297 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 350/713] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 19 14:42:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:28.090017 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6812df-b688-4ee9-a166-3ce8dfd1368a None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:28.152091 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e61c65-83c0-4022-9bb3-be13fa436af5 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:28.201829 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8710d94-6f4c-4fe0-963f-b6a2d5bdb54c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:28.202633 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8710d94-6f4c-4fe0-963f-b6a2d5bdb54c None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:28.202919 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8710d94-6f4c-4fe0-963f-b6a2d5bdb54c None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:28.203192 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8710d94-6f4c-4fe0-963f-b6a2d5bdb54c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:28.203823 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8710d94-6f4c-4fe0-963f-b6a2d5bdb54c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:28.205938 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8710d94-6f4c-4fe0-963f-b6a2d5bdb54c None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:28.207445 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6812df-b688-4ee9-a166-3ce8dfd1368a None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:28.210681 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:28.218941 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-f8710d94-6f4c-4fe0-963f-b6a2d5bdb54c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 19 14:42:28.218941 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:28.218941 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 14:42:28.218941 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 14:42:28.218941 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 14:42:28.218941 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 14:42:28.218941 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 14:42:28.218941 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:42:28.218941 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 19 14:42:28.218941 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:28.218941 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 14:42:28.218941 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:28.218941 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:28.218941 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:28.218941 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:28.218941 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:28.218941 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:28.220019 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:28.220019 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:28.220019 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:28.220019 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:28.220019 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:28.220019 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:28.220019 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 14:42:28.220019 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 14:42:28.220019 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 14:42:28.220019 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 14:42:28.220019 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:28.220019 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:28.220019 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:28.220019 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:28.220019 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:28.220019 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:28.220863 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:28.220863 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:28.220863 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:28.220863 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:28.220863 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:28.220863 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:28.220863 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:28.220863 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:28.220863 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:28.220863 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:28.220863 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 14:42:28.220863 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:42:28.220863 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 19 14:42:28.220863 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:28.220863 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 364/714] 10.222.0.26 () {56 vars in 1129 bytes} [Mon Sep 19 14:42:28 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:28.221731 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8710d94-6f4c-4fe0-963f-b6a2d5bdb54c None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:28.253779 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:28.260432 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044b0ccb-f693-4804-b3ad-fdb15c5f5faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:28.261848 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b0ccb-f693-4804-b3ad-fdb15c5f5faa None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:28.262713 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b0ccb-f693-4804-b3ad-fdb15c5f5faa None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:28.263427 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b0ccb-f693-4804-b3ad-fdb15c5f5faa None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:28.264251 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044b0ccb-f693-4804-b3ad-fdb15c5f5faa None admin] RBAC: Adding query filter params (name=network) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:28.264753 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044b0ccb-f693-4804-b3ad-fdb15c5f5faa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:28.267486 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044b0ccb-f693-4804-b3ad-fdb15c5f5faa None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:28.273423 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 351/715] 10.222.0.26 () {56 vars in 1112 bytes} [Mon Sep 19 14:42:28 2022] GET /identity/v3/services?name=network => generated 124 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:28.274476 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044b0ccb-f693-4804-b3ad-fdb15c5f5faa None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:28.352765 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8710d94-6f4c-4fe0-963f-b6a2d5bdb54c None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:28.395842 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de25627a-5fe2-4bff-a49d-9a5a83b1412a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:28.396571 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25627a-5fe2-4bff-a49d-9a5a83b1412a None admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:28.396921 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25627a-5fe2-4bff-a49d-9a5a83b1412a None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:28.397307 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25627a-5fe2-4bff-a49d-9a5a83b1412a None admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:28.398181 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de25627a-5fe2-4bff-a49d-9a5a83b1412a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:28.400308 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de25627a-5fe2-4bff-a49d-9a5a83b1412a None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:28.405422 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044b0ccb-f693-4804-b3ad-fdb15c5f5faa None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:28.437301 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 365/716] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Sep 19 14:42:28 2022] POST /identity/v3/users => generated 254 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:42:28.438662 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de25627a-5fe2-4bff-a49d-9a5a83b1412a None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:28.451358 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e7ba4f-7f77-43aa-8dd7-f55add66fe79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:28.453800 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e7ba4f-7f77-43aa-8dd7-f55add66fe79 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:28.454196 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e7ba4f-7f77-43aa-8dd7-f55add66fe79 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:28.454827 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e7ba4f-7f77-43aa-8dd7-f55add66fe79 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:28.455773 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e7ba4f-7f77-43aa-8dd7-f55add66fe79 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:28.456147 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e7ba4f-7f77-43aa-8dd7-f55add66fe79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:28.457874 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e7ba4f-7f77-43aa-8dd7-f55add66fe79 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:28.464798 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 352/717] 10.222.0.26 () {56 vars in 1124 bytes} [Mon Sep 19 14:42:28 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:28.470909 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e7ba4f-7f77-43aa-8dd7-f55add66fe79 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:28.528912 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:28.604583 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:28.632588 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de25627a-5fe2-4bff-a49d-9a5a83b1412a None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:28.672930 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e7ba4f-7f77-43aa-8dd7-f55add66fe79 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:28.693440 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3ff2a0-6cc2-490e-8a60-c318e441eac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:28.694069 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ff2a0-6cc2-490e-8a60-c318e441eac8 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:28.694346 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ff2a0-6cc2-490e-8a60-c318e441eac8 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:28.694617 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ff2a0-6cc2-490e-8a60-c318e441eac8 None admin] PATH_INFO: `/v3/services` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:28.695253 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3ff2a0-6cc2-490e-8a60-c318e441eac8 None admin] RBAC: Adding query filter params (type=network) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:28.695556 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3ff2a0-6cc2-490e-8a60-c318e441eac8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:28.696940 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3ff2a0-6cc2-490e-8a60-c318e441eac8 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:28.705108 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 366/718] 10.222.0.26 () {56 vars in 1112 bytes} [Mon Sep 19 14:42:28 2022] GET /identity/v3/services?type=network => generated 124 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:28.731145 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790d091a-252d-4fb2-b482-5454020634d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:28.732257 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d091a-252d-4fb2-b482-5454020634d3 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:28.732737 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d091a-252d-4fb2-b482-5454020634d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:28.733255 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d091a-252d-4fb2-b482-5454020634d3 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:28.734129 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790d091a-252d-4fb2-b482-5454020634d3 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:28.734666 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790d091a-252d-4fb2-b482-5454020634d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:28.736298 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790d091a-252d-4fb2-b482-5454020634d3 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:28.745435 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 353/719] 10.222.0.26 () {56 vars in 1124 bytes} [Mon Sep 19 14:42:28 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:28.989937 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaec3c7-b827-4326-a526-215791df7843 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:28.990403 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaec3c7-b827-4326-a526-215791df7843 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:28.990552 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaec3c7-b827-4326-a526-215791df7843 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:28.991934 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 367/720] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:42:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:42:29.001068 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e660882a-06c2-4714-8ec6-40e9b97ad3e7 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:29.001852 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e660882a-06c2-4714-8ec6-40e9b97ad3e7 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:29.002303 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e660882a-06c2-4714-8ec6-40e9b97ad3e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:29.026173 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-e660882a-06c2-4714-8ec6-40e9b97ad3e7 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:42:29.027527 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e660882a-06c2-4714-8ec6-40e9b97ad3e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:42:29.109839 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 354/721] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:42:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:42:29.564301 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaec3c7-b827-4326-a526-215791df7843 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:29.685116 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaec3c7-b827-4326-a526-215791df7843 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:29.722478 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9099238-c883-4ec4-9d48-98166226124d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:29.723120 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9099238-c883-4ec4-9d48-98166226124d None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:29.723400 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9099238-c883-4ec4-9d48-98166226124d None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:29.723673 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9099238-c883-4ec4-9d48-98166226124d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:29.735351 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9099238-c883-4ec4-9d48-98166226124d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:42:29.740161 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-e9099238-c883-4ec4-9d48-98166226124d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:42:29.740161 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:29.740161 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:29.740161 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:29.740161 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:29.740161 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:29.740161 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:29.740161 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:29.740161 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:29.740161 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:29.740161 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:29.740161 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:29.740161 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:42:29.740161 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:42:29.740161 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:42:29.740161 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:42:29.741072 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:42:29.741072 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:42:29.741072 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:42:29.741072 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:42:29.741072 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:29.741072 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:29.741072 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:29.741072 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:29.741072 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:29.741072 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:29.741072 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:29.741072 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:29.741072 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:29.741072 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:29.741072 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:29.741072 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:29.741905 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:29.741905 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:29.741905 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:29.741905 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:29.741905 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:42:29.741905 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:42:29.741905 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:42:29.741905 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:42:29.741905 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:42:29.741905 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:42:29.741905 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:42:29.741905 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:29.741905 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 368/722] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 19 14:42:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:29.750731 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e660882a-06c2-4714-8ec6-40e9b97ad3e7 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:29.788521 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:29.923703 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e660882a-06c2-4714-8ec6-40e9b97ad3e7 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:29.960480 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542a0fc4-c99e-4c67-84f2-73af57974bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:29.961115 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542a0fc4-c99e-4c67-84f2-73af57974bf8 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:29.961393 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542a0fc4-c99e-4c67-84f2-73af57974bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:29.961662 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542a0fc4-c99e-4c67-84f2-73af57974bf8 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:29.962331 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542a0fc4-c99e-4c67-84f2-73af57974bf8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:29.962638 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542a0fc4-c99e-4c67-84f2-73af57974bf8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:29.964184 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542a0fc4-c99e-4c67-84f2-73af57974bf8 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:29.977098 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 355/723] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 19 14:42:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:29.979722 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9099238-c883-4ec4-9d48-98166226124d None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:29.985303 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:30.094161 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9099238-c883-4ec4-9d48-98166226124d None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:30.137800 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c90f0df-8cd5-451a-91d9-c79ccd2a51f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:30.138433 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c90f0df-8cd5-451a-91d9-c79ccd2a51f5 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:30.138705 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c90f0df-8cd5-451a-91d9-c79ccd2a51f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:30.138974 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c90f0df-8cd5-451a-91d9-c79ccd2a51f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:30.161162 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c90f0df-8cd5-451a-91d9-c79ccd2a51f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:30.162615 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c90f0df-8cd5-451a-91d9-c79ccd2a51f5 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:30.180981 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-1c90f0df-8cd5-451a-91d9-c79ccd2a51f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:30.180981 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:30.180981 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:30.180981 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:30.180981 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:30.180981 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:30.180981 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:30.180981 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:30.180981 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:30.180981 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:30.180981 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:30.180981 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:30.180981 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:42:30.180981 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:42:30.180981 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:42:30.180981 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:42:30.182099 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:30.182099 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:30.182099 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:30.182099 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:30.182099 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:30.182099 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:30.182099 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:30.182099 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:30.182099 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:30.182099 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:30.182099 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:30.182099 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:30.182099 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:30.182099 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:30.182099 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:30.182099 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:30.182099 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:42:30.183294 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:42:30.183294 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:30.183294 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:30.183294 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 369/724] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:42:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:30.190824 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542a0fc4-c99e-4c67-84f2-73af57974bf8 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:30.354265 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:30.374445 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542a0fc4-c99e-4c67-84f2-73af57974bf8 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:30.419302 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf9432d-80e6-494b-b081-969db1eda89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:30.419910 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf9432d-80e6-494b-b081-969db1eda89e None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:30.420192 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf9432d-80e6-494b-b081-969db1eda89e None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:30.420464 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf9432d-80e6-494b-b081-969db1eda89e None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:30.421133 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf9432d-80e6-494b-b081-969db1eda89e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:30.421436 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf9432d-80e6-494b-b081-969db1eda89e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:30.422830 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf9432d-80e6-494b-b081-969db1eda89e None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:30.439958 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 356/725] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 19 14:42:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:30.445425 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c90f0df-8cd5-451a-91d9-c79ccd2a51f5 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:30.548494 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:30.608742 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c90f0df-8cd5-451a-91d9-c79ccd2a51f5 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:30.658585 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc245043-d920-4081-9835-7da130e2153c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:30.659218 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc245043-d920-4081-9835-7da130e2153c None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:30.659495 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc245043-d920-4081-9835-7da130e2153c None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:30.659763 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc245043-d920-4081-9835-7da130e2153c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:30.670032 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc245043-d920-4081-9835-7da130e2153c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:30.671490 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc245043-d920-4081-9835-7da130e2153c None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:30.676153 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196de0ef-c0d5-4955-b26e-6019277b4f8c None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:30.676439 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196de0ef-c0d5-4955-b26e-6019277b4f8c None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:30.676716 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196de0ef-c0d5-4955-b26e-6019277b4f8c None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:30.678221 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 357/726] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:42:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 14:42:30.688056 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-bc245043-d920-4081-9835-7da130e2153c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 19 14:42:30.688056 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:30.688056 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:30.688056 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:30.688056 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:30.688056 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:30.688056 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:30.688056 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:30.688056 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:30.688056 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:30.688056 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:30.688056 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:30.688056 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:42:30.688056 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:42:30.688056 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:42:30.688056 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:42:30.688983 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:30.688983 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:30.688983 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:42:30.688983 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:42:30.688983 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:42:30.688983 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:42:30.688983 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:30.688983 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:30.688983 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:30.688983 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:30.688983 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:30.688983 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:30.688983 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:30.688983 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:30.688983 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:30.688983 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:30.688983 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:30.688983 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:30.689934 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:30.689934 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:30.689934 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:42:30.689934 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:42:30.689934 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:42:30.689934 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:42:30.689934 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:42:30.689934 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:42:30.689934 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 19 14:42:30.689934 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:30.693146 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 370/727] 10.222.0.26 () {56 vars in 1093 bytes} [Mon Sep 19 14:42:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:30.694422 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1280454e-a732-4cc3-b41b-7bbca747d1f3 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:30.694708 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1280454e-a732-4cc3-b41b-7bbca747d1f3 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:30.694985 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1280454e-a732-4cc3-b41b-7bbca747d1f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:30.695091 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc245043-d920-4081-9835-7da130e2153c None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:30.734312 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-1280454e-a732-4cc3-b41b-7bbca747d1f3 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:42:30.736629 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-1280454e-a732-4cc3-b41b-7bbca747d1f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:42:30.876827 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 358/728] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:42:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:42:30.882828 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc245043-d920-4081-9835-7da130e2153c None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:30.918250 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abedc0a4-be12-443a-b367-ed137cfddecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:30.919075 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abedc0a4-be12-443a-b367-ed137cfddecc None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:30.919448 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abedc0a4-be12-443a-b367-ed137cfddecc None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:30.919818 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abedc0a4-be12-443a-b367-ed137cfddecc None admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:30.920680 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abedc0a4-be12-443a-b367-ed137cfddecc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:30.921140 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abedc0a4-be12-443a-b367-ed137cfddecc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:30.922686 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abedc0a4-be12-443a-b367-ed137cfddecc None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:30.945477 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:30.945753 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 371/729] 10.222.0.26 () {56 vars in 1133 bytes} [Mon Sep 19 14:42:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:30.948950 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1280454e-a732-4cc3-b41b-7bbca747d1f3 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:31.058996 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:31.090309 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1280454e-a732-4cc3-b41b-7bbca747d1f3 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:31.127598 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4f6a33-8cc8-4ff4-9bdd-14d8a60971da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:31.128255 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4f6a33-8cc8-4ff4-9bdd-14d8a60971da None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:31.128529 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4f6a33-8cc8-4ff4-9bdd-14d8a60971da None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:31.128794 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4f6a33-8cc8-4ff4-9bdd-14d8a60971da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:31.141736 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4f6a33-8cc8-4ff4-9bdd-14d8a60971da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:31.143234 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4f6a33-8cc8-4ff4-9bdd-14d8a60971da None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:31.161841 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-ec4f6a33-8cc8-4ff4-9bdd-14d8a60971da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:31.161841 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:31.161841 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:31.161841 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:31.161841 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:31.161841 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:31.161841 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:31.161841 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:31.161841 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:31.161841 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:31.161841 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:31.161841 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:31.161841 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:42:31.161841 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:42:31.161841 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:42:31.161841 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:42:31.162850 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:31.162850 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:31.162850 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:31.162850 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:31.162850 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:31.162850 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:31.162850 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:31.162850 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:31.162850 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:31.162850 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:31.162850 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:31.162850 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:31.162850 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:31.162850 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:31.162850 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:31.162850 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:31.162850 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:42:31.163720 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:42:31.163720 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:31.163720 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:42:31.168756 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 359/730] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:42:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:31.170449 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abedc0a4-be12-443a-b367-ed137cfddecc None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:31.270362 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a79126-ca33-47ef-b536-c45ea1f84e87 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:31.270890 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a79126-ca33-47ef-b536-c45ea1f84e87 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:31.270890 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a79126-ca33-47ef-b536-c45ea1f84e87 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:31.272672 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 360/731] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:42:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:42:31.273309 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a79126-ca33-47ef-b536-c45ea1f84e87 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:31.299256 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abedc0a4-be12-443a-b367-ed137cfddecc None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:31.336730 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b6f2c5-e30d-4be8-9dab-1c9ef086359b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:31.337384 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b6f2c5-e30d-4be8-9dab-1c9ef086359b None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:31.337662 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b6f2c5-e30d-4be8-9dab-1c9ef086359b None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:31.337930 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b6f2c5-e30d-4be8-9dab-1c9ef086359b None admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:31.338728 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b6f2c5-e30d-4be8-9dab-1c9ef086359b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:31.339031 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b6f2c5-e30d-4be8-9dab-1c9ef086359b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:31.340650 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b6f2c5-e30d-4be8-9dab-1c9ef086359b None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:31.355378 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 372/732] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 19 14:42:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:42:31.356718 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66810194-7940-4348-bbb8-59e288363b6c None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:31.357019 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66810194-7940-4348-bbb8-59e288363b6c None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:31.357294 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66810194-7940-4348-bbb8-59e288363b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:31.377933 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-66810194-7940-4348-bbb8-59e288363b6c None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:42:31.379226 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-66810194-7940-4348-bbb8-59e288363b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:42:31.407883 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:31.424776 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a79126-ca33-47ef-b536-c45ea1f84e87 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:31.454923 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 373/733] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:42:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:42:31.455974 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66810194-7940-4348-bbb8-59e288363b6c None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:31.462402 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:31.474631 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66c0b67-a4b0-4a85-9a05-7e630475daae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:31.475285 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66c0b67-a4b0-4a85-9a05-7e630475daae None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:31.475837 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66c0b67-a4b0-4a85-9a05-7e630475daae None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:31.476112 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66c0b67-a4b0-4a85-9a05-7e630475daae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:31.498907 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66c0b67-a4b0-4a85-9a05-7e630475daae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:42:31.505506 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-c66c0b67-a4b0-4a85-9a05-7e630475daae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:42:31.505506 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:31.505506 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:31.505506 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:31.505506 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:31.505506 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:31.505506 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:31.505506 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:31.505506 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:31.505506 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:31.505506 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:31.505506 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:31.505506 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:42:31.505506 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:42:31.505506 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:42:31.505506 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:42:31.506638 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:42:31.506638 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:42:31.506638 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:42:31.506638 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:42:31.506638 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:31.506638 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:31.506638 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:31.506638 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:31.506638 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:31.506638 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:31.506638 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:31.506638 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:31.506638 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:31.506638 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:31.506638 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:31.506638 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:31.507544 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:31.507544 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:31.507544 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:31.507544 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:31.507544 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:42:31.507544 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:42:31.507544 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:42:31.507544 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:42:31.507544 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:42:31.507544 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:42:31.507544 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:42:31.507544 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:42:31.507544 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 361/734] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 19 14:42:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:31.513037 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39378545-be38-477c-867a-3abc3610106b None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:31.513037 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39378545-be38-477c-867a-3abc3610106b None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:31.513037 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39378545-be38-477c-867a-3abc3610106b None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:31.513037 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 362/735] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:42:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:42:31.514707 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39378545-be38-477c-867a-3abc3610106b None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:31.586749 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66810194-7940-4348-bbb8-59e288363b6c None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:31.628841 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d42d4d3-76d7-4fa3-9719-c4cbfa8fec76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:31.629565 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d42d4d3-76d7-4fa3-9719-c4cbfa8fec76 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:31.629789 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d42d4d3-76d7-4fa3-9719-c4cbfa8fec76 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:31.630081 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d42d4d3-76d7-4fa3-9719-c4cbfa8fec76 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:31.637140 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d42d4d3-76d7-4fa3-9719-c4cbfa8fec76 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:31.638602 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d42d4d3-76d7-4fa3-9719-c4cbfa8fec76 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:31.649962 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-5d42d4d3-76d7-4fa3-9719-c4cbfa8fec76 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:42:31.649962 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:31.649962 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:31.649962 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:31.649962 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:31.649962 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:31.649962 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:31.649962 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:31.649962 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:31.649962 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:31.649962 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:31.649962 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:31.649962 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:42:31.649962 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:42:31.649962 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:42:31.650881 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:42:31.650881 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:31.650881 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:31.650881 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:31.650881 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:31.650881 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:31.650881 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:31.650881 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:31.650881 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:31.650881 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:31.650881 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:31.650881 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:31.650881 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:31.650881 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:31.650881 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:31.650881 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:31.650881 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:31.651905 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:42:31.651905 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:42:31.651905 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:42:31.651905 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:42:31.651905 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:42:31.651905 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:42:31.651905 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:42:31.651905 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:31.651905 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 374/736] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 19 14:42:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:31.652396 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e434b2ec-54e7-4d20-a8f6-29a1c3cb1264 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:31.652961 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e434b2ec-54e7-4d20-a8f6-29a1c3cb1264 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:31.652961 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e434b2ec-54e7-4d20-a8f6-29a1c3cb1264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:31.659541 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39378545-be38-477c-867a-3abc3610106b None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:31.671367 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-e434b2ec-54e7-4d20-a8f6-29a1c3cb1264 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:42:31.672556 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-e434b2ec-54e7-4d20-a8f6-29a1c3cb1264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:42:31.690201 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:31.696835 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d06b8e-0d4d-4d6c-b7e9-708029852ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:31.697491 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d06b8e-0d4d-4d6c-b7e9-708029852ad4 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:31.697823 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d06b8e-0d4d-4d6c-b7e9-708029852ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:31.698093 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d06b8e-0d4d-4d6c-b7e9-708029852ad4 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:31.698759 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d06b8e-0d4d-4d6c-b7e9-708029852ad4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:31.699056 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d06b8e-0d4d-4d6c-b7e9-708029852ad4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:31.700438 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d06b8e-0d4d-4d6c-b7e9-708029852ad4 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:31.709167 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 363/737] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 19 14:42:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:31.710139 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2270665d-5159-4514-9ee4-5dd7d5c4563a None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:31.710417 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2270665d-5159-4514-9ee4-5dd7d5c4563a None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:31.710679 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2270665d-5159-4514-9ee4-5dd7d5c4563a None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:31.711998 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 364/738] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:42:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:42:31.712516 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2270665d-5159-4514-9ee4-5dd7d5c4563a None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:31.749852 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 375/739] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:42:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:42:31.750697 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e434b2ec-54e7-4d20-a8f6-29a1c3cb1264 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:31.764286 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:31.820143 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2270665d-5159-4514-9ee4-5dd7d5c4563a None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:31.856043 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2669512b-1aae-4512-840d-0456dfd19638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:31.856575 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2669512b-1aae-4512-840d-0456dfd19638 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:31.856859 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2669512b-1aae-4512-840d-0456dfd19638 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:31.857174 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2669512b-1aae-4512-840d-0456dfd19638 None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:31.857857 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2669512b-1aae-4512-840d-0456dfd19638 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:31.858162 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2669512b-1aae-4512-840d-0456dfd19638 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:31.859605 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2669512b-1aae-4512-840d-0456dfd19638 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:31.867598 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e434b2ec-54e7-4d20-a8f6-29a1c3cb1264 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:31.871901 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 365/740] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 19 14:42:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:31.873144 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1390754b-9537-4270-b03e-36cfea0eda94 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:31.873429 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1390754b-9537-4270-b03e-36cfea0eda94 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:31.873700 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1390754b-9537-4270-b03e-36cfea0eda94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:31.893036 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-1390754b-9537-4270-b03e-36cfea0eda94 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:42:31.893253 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-1390754b-9537-4270-b03e-36cfea0eda94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:42:31.915314 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b8da3-f966-4c7b-9cc3-ab09d6d9e526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:31.915931 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b8da3-f966-4c7b-9cc3-ab09d6d9e526 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:31.916211 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b8da3-f966-4c7b-9cc3-ab09d6d9e526 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:31.916562 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b8da3-f966-4c7b-9cc3-ab09d6d9e526 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:31.927177 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864b8da3-f966-4c7b-9cc3-ab09d6d9e526 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:31.928740 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864b8da3-f966-4c7b-9cc3-ab09d6d9e526 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:31.945811 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-864b8da3-f966-4c7b-9cc3-ab09d6d9e526 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:31.945811 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:31.945811 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:31.945811 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:31.945811 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:31.945811 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:31.945811 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:31.945811 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:31.945811 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:31.945811 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:31.945811 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:31.945811 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:31.945811 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:42:31.945811 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:42:31.945811 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:42:31.945811 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:42:31.946782 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:31.946782 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:31.946782 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:31.946782 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:31.946782 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:31.946782 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:31.946782 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:31.946782 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:31.946782 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:31.946782 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:31.946782 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:31.946782 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:31.946782 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:31.946782 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:31.946782 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:31.946782 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:31.946782 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:42:31.947656 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:42:31.947656 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:31.947656 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:31.949142 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 376/741] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:42:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:31.949965 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b8da3-f966-4c7b-9cc3-ab09d6d9e526 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:31.955726 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:31.977266 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 366/742] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:42:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 14:42:31.978051 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1390754b-9537-4270-b03e-36cfea0eda94 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:32.027857 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:32.072405 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b8da3-f966-4c7b-9cc3-ab09d6d9e526 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:32.088661 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1390754b-9537-4270-b03e-36cfea0eda94 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:32.109573 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a0f46c-4f19-4e29-a295-1ad5bd64e084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:32.110588 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a0f46c-4f19-4e29-a295-1ad5bd64e084 None admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:32.110862 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a0f46c-4f19-4e29-a295-1ad5bd64e084 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:32.111385 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a0f46c-4f19-4e29-a295-1ad5bd64e084 None admin] PATH_INFO: `/v3/services` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:32.112033 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a0f46c-4f19-4e29-a295-1ad5bd64e084 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:32.113624 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a0f46c-4f19-4e29-a295-1ad5bd64e084 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:32.125065 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7523da88-0a55-4c3f-adae-021a5804490c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:32.125744 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7523da88-0a55-4c3f-adae-021a5804490c None admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:32.126011 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7523da88-0a55-4c3f-adae-021a5804490c None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:32.126290 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7523da88-0a55-4c3f-adae-021a5804490c None admin] PATH_INFO: `/v3/projects/9ede5dc59ece4d9282867a99e94c4c41/users/3017e5d92bef4cc2aeae4f28c78ba233/roles/019bde1756cb40de8ce06cef6b261f79` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:32.128500 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7523da88-0a55-4c3f-adae-021a5804490c None admin] RBAC: Authorizing `identity:create_grant(project_id=9ede5dc59ece4d9282867a99e94c4c41, user_id=3017e5d92bef4cc2aeae4f28c78ba233, role_id=019bde1756cb40de8ce06cef6b261f79)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:32.129962 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7523da88-0a55-4c3f-adae-021a5804490c None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:32.132401 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 377/743] 10.222.0.26 () {60 vars in 1141 bytes} [Mon Sep 19 14:42:31 2022] POST /identity/v3/services => generated 240 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:42:32.134049 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a0f46c-4f19-4e29-a295-1ad5bd64e084 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:32.156534 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 367/744] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Sep 19 14:42:31 2022] PUT /identity/v3/projects/9ede5dc59ece4d9282867a99e94c4c41/users/3017e5d92bef4cc2aeae4f28c78ba233/roles/019bde1756cb40de8ce06cef6b261f79 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:42:32.157959 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7523da88-0a55-4c3f-adae-021a5804490c None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:32.258092 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:32.302513 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:32.305655 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7523da88-0a55-4c3f-adae-021a5804490c None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:32.356106 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a0f46c-4f19-4e29-a295-1ad5bd64e084 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:32.360051 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffa4898-01e6-4898-9a37-729a733ef46b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:32.360596 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffa4898-01e6-4898-9a37-729a733ef46b None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:32.360881 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffa4898-01e6-4898-9a37-729a733ef46b None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:32.361189 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffa4898-01e6-4898-9a37-729a733ef46b None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:32.361855 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffa4898-01e6-4898-9a37-729a733ef46b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:32.363264 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffa4898-01e6-4898-9a37-729a733ef46b None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:32.388792 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 368/745] 10.222.0.26 () {60 vars in 1141 bytes} [Mon Sep 19 14:42:32 2022] POST /identity/v3/services => generated 251 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:42:32.390260 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffa4898-01e6-4898-9a37-729a733ef46b None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:32.421971 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa10a089-c18d-42ef-ab37-e6d882235afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:32.421971 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa10a089-c18d-42ef-ab37-e6d882235afa None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:32.421971 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa10a089-c18d-42ef-ab37-e6d882235afa None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:32.421971 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa10a089-c18d-42ef-ab37-e6d882235afa None admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:32.422445 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa10a089-c18d-42ef-ab37-e6d882235afa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:32.422638 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa10a089-c18d-42ef-ab37-e6d882235afa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:32.424079 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa10a089-c18d-42ef-ab37-e6d882235afa None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:32.441033 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 378/746] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 19 14:42:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:32.450240 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa10a089-c18d-42ef-ab37-e6d882235afa None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:32.541152 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffa4898-01e6-4898-9a37-729a733ef46b None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:32.584739 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bca7480-9e7c-44a9-b930-e9d4bcd97bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:32.585428 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca7480-9e7c-44a9-b930-e9d4bcd97bce None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:32.585703 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca7480-9e7c-44a9-b930-e9d4bcd97bce None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:32.585975 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca7480-9e7c-44a9-b930-e9d4bcd97bce None admin] PATH_INFO: `/v3/roles/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:32.601022 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bca7480-9e7c-44a9-b930-e9d4bcd97bce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:42:32.603949 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-6bca7480-9e7c-44a9-b930-e9d4bcd97bce None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:42:32.603949 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:32.603949 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:32.603949 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:32.603949 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:32.603949 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:32.603949 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:32.603949 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:32.603949 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:32.603949 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:32.603949 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:32.603949 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:32.603949 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:42:32.603949 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:42:32.603949 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:42:32.603949 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:42:32.604828 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:42:32.604828 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:42:32.604828 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:42:32.604828 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:42:32.604828 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:32.604828 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:32.604828 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:32.604828 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:32.604828 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:32.604828 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:32.604828 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:32.604828 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:32.604828 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:32.604828 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:32.604828 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:32.604828 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:32.605706 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:32.605706 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:32.605706 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:32.605706 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:32.605706 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:42:32.605706 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:42:32.605706 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:42:32.605706 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:42:32.605706 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:42:32.605706 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:42:32.605706 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:42:32.605706 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:42:32.605706 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 369/747] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Sep 19 14:42:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:32.614227 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bca7480-9e7c-44a9-b930-e9d4bcd97bce None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:32.622691 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa10a089-c18d-42ef-ab37-e6d882235afa None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:32.642761 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:32.645455 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:32.664350 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bd7716-4ff8-428e-bc73-71f766c7f8ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:32.665015 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd7716-4ff8-428e-bc73-71f766c7f8ab None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:32.665315 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd7716-4ff8-428e-bc73-71f766c7f8ab None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:32.665647 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd7716-4ff8-428e-bc73-71f766c7f8ab None admin] PATH_INFO: `/v3/users/swift` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:32.676565 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bd7716-4ff8-428e-bc73-71f766c7f8ab None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:32.678278 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bd7716-4ff8-428e-bc73-71f766c7f8ab None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:32.692849 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-94bd7716-4ff8-428e-bc73-71f766c7f8ab None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 19 14:42:32.692849 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:32.692849 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:32.692849 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:32.692849 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:32.692849 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:32.692849 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:32.692849 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:32.692849 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:32.692849 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:32.692849 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:32.692849 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:32.692849 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:42:32.692849 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:42:32.692849 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:42:32.692849 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:42:32.693876 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:32.693876 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:32.693876 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:42:32.693876 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:42:32.693876 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:42:32.693876 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:42:32.693876 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:32.693876 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:32.693876 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:32.693876 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:32.693876 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:32.693876 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:32.693876 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:32.693876 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:32.693876 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:32.693876 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:32.693876 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:32.693876 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:32.694803 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:32.694803 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:32.694803 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:42:32.694803 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:42:32.694803 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:42:32.694803 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:42:32.694803 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:42:32.694803 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:42:32.694803 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 19 14:42:32.694803 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:32.694803 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 379/748] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 19 14:42:32 2022] GET /identity/v3/users/swift => generated 83 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:42:32.700261 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bd7716-4ff8-428e-bc73-71f766c7f8ab None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:32.749326 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bca7480-9e7c-44a9-b930-e9d4bcd97bce None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:32.819244 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93971ce2-a96f-4b3e-97e4-308bda066222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:32.820168 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93971ce2-a96f-4b3e-97e4-308bda066222 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:32.821388 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93971ce2-a96f-4b3e-97e4-308bda066222 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:32.821857 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93971ce2-a96f-4b3e-97e4-308bda066222 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:32.827433 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93971ce2-a96f-4b3e-97e4-308bda066222 None admin] RBAC: Adding query filter params (name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:32.827949 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93971ce2-a96f-4b3e-97e4-308bda066222 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:32.829609 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93971ce2-a96f-4b3e-97e4-308bda066222 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:32.844281 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 370/749] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Sep 19 14:42:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:42:32.850065 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93971ce2-a96f-4b3e-97e4-308bda066222 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:32.879841 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bd7716-4ff8-428e-bc73-71f766c7f8ab None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:32.949384 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:32.969024 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098f1768-7a87-44e4-8be6-3b637c39a2af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:32.971019 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f1768-7a87-44e4-8be6-3b637c39a2af None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:32.971640 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f1768-7a87-44e4-8be6-3b637c39a2af None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:32.973273 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f1768-7a87-44e4-8be6-3b637c39a2af None admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:32.974195 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098f1768-7a87-44e4-8be6-3b637c39a2af None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:32.975446 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098f1768-7a87-44e4-8be6-3b637c39a2af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:32.977101 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098f1768-7a87-44e4-8be6-3b637c39a2af None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:32.993908 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93971ce2-a96f-4b3e-97e4-308bda066222 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:33.016238 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 380/750] 10.222.0.26 () {56 vars in 1135 bytes} [Mon Sep 19 14:42:32 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:33.021048 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098f1768-7a87-44e4-8be6-3b637c39a2af None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:33.067176 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad6f0c4-f8a1-4c07-827d-44eac46b856e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:33.068061 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad6f0c4-f8a1-4c07-827d-44eac46b856e None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:33.068497 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad6f0c4-f8a1-4c07-827d-44eac46b856e None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:33.068910 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad6f0c4-f8a1-4c07-827d-44eac46b856e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:33.087366 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad6f0c4-f8a1-4c07-827d-44eac46b856e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:33.088914 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad6f0c4-f8a1-4c07-827d-44eac46b856e None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:33.089350 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:33.115795 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-9ad6f0c4-f8a1-4c07-827d-44eac46b856e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:33.115795 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:33.115795 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:33.115795 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:33.115795 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:33.115795 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:33.115795 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:33.115795 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:33.115795 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:33.115795 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:33.115795 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:33.115795 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:33.115795 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:42:33.115795 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:42:33.115795 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:42:33.115795 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:42:33.116797 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:33.116797 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:33.116797 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:33.116797 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:33.116797 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:33.116797 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:33.116797 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:33.116797 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:33.116797 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:33.116797 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:33.116797 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:33.116797 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:33.116797 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:33.116797 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:33.116797 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:33.116797 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:33.116797 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:42:33.117710 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:42:33.117710 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:33.117710 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:42:33.117710 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 371/751] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:42:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:42:33.126606 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad6f0c4-f8a1-4c07-827d-44eac46b856e None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:33.220634 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098f1768-7a87-44e4-8be6-3b637c39a2af None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:33.299646 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36702c33-386e-4503-9ee1-71998612bdf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:33.300275 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36702c33-386e-4503-9ee1-71998612bdf6 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:33.300545 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36702c33-386e-4503-9ee1-71998612bdf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:33.300812 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36702c33-386e-4503-9ee1-71998612bdf6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:33.321054 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad6f0c4-f8a1-4c07-827d-44eac46b856e None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:33.375122 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36702c33-386e-4503-9ee1-71998612bdf6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:33.376597 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36702c33-386e-4503-9ee1-71998612bdf6 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:33.395360 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:33.413670 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb964346-e81c-41ad-9337-5d18d38b876a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:33.414286 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb964346-e81c-41ad-9337-5d18d38b876a None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:33.414568 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb964346-e81c-41ad-9337-5d18d38b876a None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:33.414842 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb964346-e81c-41ad-9337-5d18d38b876a None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:33.415494 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb964346-e81c-41ad-9337-5d18d38b876a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:33.415803 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb964346-e81c-41ad-9337-5d18d38b876a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:33.417360 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb964346-e81c-41ad-9337-5d18d38b876a None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:33.425358 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:33.444424 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 372/752] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 19 14:42:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:33.450203 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb964346-e81c-41ad-9337-5d18d38b876a None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:33.489703 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 381/753] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 19 14:42:33 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 19 14:42:33.495707 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36702c33-386e-4503-9ee1-71998612bdf6 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:33.607652 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36702c33-386e-4503-9ee1-71998612bdf6 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:33.644569 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdebac9d-dfdc-4e5f-8593-45f7f6da65bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:33.645353 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdebac9d-dfdc-4e5f-8593-45f7f6da65bc None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:33.645513 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdebac9d-dfdc-4e5f-8593-45f7f6da65bc None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:33.645734 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdebac9d-dfdc-4e5f-8593-45f7f6da65bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:33.647949 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:33.657329 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdebac9d-dfdc-4e5f-8593-45f7f6da65bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:33.659470 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdebac9d-dfdc-4e5f-8593-45f7f6da65bc None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:33.663965 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb964346-e81c-41ad-9337-5d18d38b876a None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:33.676544 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-fdebac9d-dfdc-4e5f-8593-45f7f6da65bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:33.676544 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:33.676544 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:33.676544 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:33.676544 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:33.676544 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:33.676544 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:33.676544 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:33.676544 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:33.676544 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:33.676544 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:33.676544 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:33.676544 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:42:33.676544 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:42:33.676544 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:42:33.676544 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:42:33.678805 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:33.678805 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:33.678805 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:33.678805 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:33.678805 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:33.678805 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:33.678805 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:33.678805 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:33.678805 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:33.678805 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:33.678805 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:33.678805 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:33.678805 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:33.678805 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:33.678805 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:33.678805 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:33.678805 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:42:33.680906 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:42:33.680906 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:33.680906 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:33.680906 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 382/754] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:42:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:33.684004 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdebac9d-dfdc-4e5f-8593-45f7f6da65bc None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:33.747766 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aee4d85-4516-4251-b5a2-7dd968bf7ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:33.748321 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee4d85-4516-4251-b5a2-7dd968bf7ad3 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:33.749650 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee4d85-4516-4251-b5a2-7dd968bf7ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:33.749940 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee4d85-4516-4251-b5a2-7dd968bf7ad3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:33.766025 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aee4d85-4516-4251-b5a2-7dd968bf7ad3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:33.767526 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aee4d85-4516-4251-b5a2-7dd968bf7ad3 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:33.795756 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-6aee4d85-4516-4251-b5a2-7dd968bf7ad3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 14:42:33.795756 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:33.795756 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:33.795756 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:33.795756 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:33.795756 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:33.795756 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:33.795756 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:33.795756 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:33.795756 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:33.795756 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:33.795756 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:33.795756 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:42:33.795756 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:42:33.795756 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:42:33.795756 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:42:33.798016 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:33.798016 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:33.798016 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:42:33.798016 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:42:33.798016 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:42:33.798016 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:42:33.798016 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:33.798016 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:33.798016 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:33.798016 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:33.798016 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:33.798016 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:33.798016 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:33.798016 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:33.798016 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:33.798016 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:33.798016 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:33.798016 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:33.800269 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:33.800269 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:33.800269 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:42:33.800269 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:42:33.800269 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:42:33.800269 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:42:33.800269 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:42:33.800269 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:42:33.800269 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 14:42:33.800269 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:42:33.800269 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 373/755] 10.222.0.26 () {56 vars in 1117 bytes} [Mon Sep 19 14:42:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:42:33.810222 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aee4d85-4516-4251-b5a2-7dd968bf7ad3 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:33.820002 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdebac9d-dfdc-4e5f-8593-45f7f6da65bc None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:33.857633 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a54c37-bac0-4a12-a385-e2a715006882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:33.858296 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a54c37-bac0-4a12-a385-e2a715006882 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:33.858683 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a54c37-bac0-4a12-a385-e2a715006882 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:33.858954 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a54c37-bac0-4a12-a385-e2a715006882 None admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:33.859597 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a54c37-bac0-4a12-a385-e2a715006882 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:33.859891 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a54c37-bac0-4a12-a385-e2a715006882 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:33.861299 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a54c37-bac0-4a12-a385-e2a715006882 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:33.875410 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 383/756] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 19 14:42:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:42:33.881224 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a54c37-bac0-4a12-a385-e2a715006882 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:33.931502 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:33.946154 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:34.001797 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a54c37-bac0-4a12-a385-e2a715006882 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:34.039249 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feece6c-a24f-483b-bbf3-ef1adf64c161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:34.039884 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feece6c-a24f-483b-bbf3-ef1adf64c161 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:34.040159 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feece6c-a24f-483b-bbf3-ef1adf64c161 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:34.040423 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feece6c-a24f-483b-bbf3-ef1adf64c161 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:34.047515 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feece6c-a24f-483b-bbf3-ef1adf64c161 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:34.048977 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feece6c-a24f-483b-bbf3-ef1adf64c161 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:34.061198 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-8feece6c-a24f-483b-bbf3-ef1adf64c161 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:42:34.061198 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:34.061198 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:34.061198 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:34.061198 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:34.061198 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:34.061198 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:34.061198 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:34.061198 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:34.061198 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:34.061198 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:34.061198 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:34.061198 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:42:34.061198 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:42:34.061198 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:42:34.063375 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:42:34.063375 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:34.063375 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:34.063375 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:34.063375 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:34.063375 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:34.063375 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:34.063375 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:34.063375 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:34.063375 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:34.063375 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:34.063375 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:34.063375 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:34.063375 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:34.063375 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:34.063375 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:34.063375 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:34.065497 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:42:34.065497 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:42:34.065497 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:42:34.065497 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:42:34.065497 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:42:34.065497 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:42:34.065497 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:42:34.065497 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:34.065497 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 384/757] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 19 14:42:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:42:34.074303 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feece6c-a24f-483b-bbf3-ef1adf64c161 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:34.126967 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aee4d85-4516-4251-b5a2-7dd968bf7ad3 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:34.181369 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feece6c-a24f-483b-bbf3-ef1adf64c161 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:34.189403 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:34.219977 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e9add8-fecc-49c8-aad5-2e0a78e3dbf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:34.220603 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e9add8-fecc-49c8-aad5-2e0a78e3dbf0 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:34.220877 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e9add8-fecc-49c8-aad5-2e0a78e3dbf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:34.221161 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e9add8-fecc-49c8-aad5-2e0a78e3dbf0 None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:34.224880 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e9add8-fecc-49c8-aad5-2e0a78e3dbf0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:34.224880 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e9add8-fecc-49c8-aad5-2e0a78e3dbf0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:34.227161 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e9add8-fecc-49c8-aad5-2e0a78e3dbf0 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:34.233933 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4bbb6c-c224-48bc-9ec8-11208d188d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:34.234615 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4bbb6c-c224-48bc-9ec8-11208d188d4c None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:34.234894 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4bbb6c-c224-48bc-9ec8-11208d188d4c None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:34.235162 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4bbb6c-c224-48bc-9ec8-11208d188d4c None admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:34.235913 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4bbb6c-c224-48bc-9ec8-11208d188d4c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:34.236217 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4bbb6c-c224-48bc-9ec8-11208d188d4c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:34.237684 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4bbb6c-c224-48bc-9ec8-11208d188d4c None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:34.251482 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 385/758] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 19 14:42:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:34.257433 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4bbb6c-c224-48bc-9ec8-11208d188d4c None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:34.275779 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 374/759] 10.222.0.26 () {56 vars in 1149 bytes} [Mon Sep 19 14:42:33 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 466 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:42:34.281615 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e9add8-fecc-49c8-aad5-2e0a78e3dbf0 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:34.403612 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4bbb6c-c224-48bc-9ec8-11208d188d4c None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:34.463219 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e9add8-fecc-49c8-aad5-2e0a78e3dbf0 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:34.477340 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6948b3d-416d-47c1-80d2-c4b309de21e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:34.480236 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6948b3d-416d-47c1-80d2-c4b309de21e2 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:34.480665 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6948b3d-416d-47c1-80d2-c4b309de21e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:34.481114 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6948b3d-416d-47c1-80d2-c4b309de21e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:34.482259 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6948b3d-416d-47c1-80d2-c4b309de21e2 None admin] RBAC: Adding query filter params (role.id=019bde1756cb40de8ce06cef6b261f79, scope.project.id=9ede5dc59ece4d9282867a99e94c4c41, user.id=76cb60a5e90343e69a38db4356cb3a90) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:34.482709 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6948b3d-416d-47c1-80d2-c4b309de21e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:34.485966 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6948b3d-416d-47c1-80d2-c4b309de21e2 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:34.486446 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:34.498653 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 386/760] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 19 14:42:34 2022] GET /identity/v3/role_assignments?user.id=76cb60a5e90343e69a38db4356cb3a90&scope.project.id=9ede5dc59ece4d9282867a99e94c4c41&role.id=019bde1756cb40de8ce06cef6b261f79 => generated 259 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:34.528823 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c092f4b-fdcb-4208-8981-8269ae2d4add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:34.529710 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c092f4b-fdcb-4208-8981-8269ae2d4add None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:34.530142 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c092f4b-fdcb-4208-8981-8269ae2d4add None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:34.530561 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c092f4b-fdcb-4208-8981-8269ae2d4add None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:34.627284 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c092f4b-fdcb-4208-8981-8269ae2d4add None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:34.629082 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c092f4b-fdcb-4208-8981-8269ae2d4add None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:34.760629 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 375/761] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 19 14:42:34 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 14:42:34.766962 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6948b3d-416d-47c1-80d2-c4b309de21e2 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:34.790807 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e2c6fa-959e-4a5f-827d-91997aa76c07 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:34.791423 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e2c6fa-959e-4a5f-827d-91997aa76c07 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:34.791966 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e2c6fa-959e-4a5f-827d-91997aa76c07 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:34.794298 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 376/762] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:42:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:42:34.808759 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca8a515-e286-4457-afad-ffe27fe1de72 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:34.809429 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca8a515-e286-4457-afad-ffe27fe1de72 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:34.809918 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca8a515-e286-4457-afad-ffe27fe1de72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:34.831810 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:34.832327 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-6ca8a515-e286-4457-afad-ffe27fe1de72 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:42:34.834012 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-6ca8a515-e286-4457-afad-ffe27fe1de72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:42:34.837093 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:34.932420 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6948b3d-416d-47c1-80d2-c4b309de21e2 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:34.938709 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 377/763] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:42:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:42:34.939837 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a575d1-6f2b-4ff6-8637-d60f046b2afd None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:34.940121 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a575d1-6f2b-4ff6-8637-d60f046b2afd None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:34.940446 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a575d1-6f2b-4ff6-8637-d60f046b2afd None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:34.941939 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 378/764] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:42:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:42:34.942988 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427409b4-ed7e-41c7-a3da-6df01ce088d0 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:34.943267 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427409b4-ed7e-41c7-a3da-6df01ce088d0 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:34.943538 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427409b4-ed7e-41c7-a3da-6df01ce088d0 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:34.949451 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 379/765] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:42:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:42:34.950657 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccc0bbe-2f9f-4b7f-b1f8-d7a1dbe607dd None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:34.950940 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccc0bbe-2f9f-4b7f-b1f8-d7a1dbe607dd None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:34.951214 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccc0bbe-2f9f-4b7f-b1f8-d7a1dbe607dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:34.972040 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f74f55d-4220-4ce4-8ce9-b501b1fadc5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:34.972689 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f74f55d-4220-4ce4-8ce9-b501b1fadc5b None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:34.972962 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f74f55d-4220-4ce4-8ce9-b501b1fadc5b None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:34.973274 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f74f55d-4220-4ce4-8ce9-b501b1fadc5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:34.976509 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-bccc0bbe-2f9f-4b7f-b1f8-d7a1dbe607dd None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:42:34.977730 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-bccc0bbe-2f9f-4b7f-b1f8-d7a1dbe607dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:42:34.989029 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f74f55d-4220-4ce4-8ce9-b501b1fadc5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:34.990474 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f74f55d-4220-4ce4-8ce9-b501b1fadc5b None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:35.013665 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-0f74f55d-4220-4ce4-8ce9-b501b1fadc5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:35.013665 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:35.013665 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:35.013665 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:35.013665 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:35.013665 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:35.013665 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:35.013665 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:35.013665 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:35.013665 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:35.013665 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:35.013665 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:35.013665 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:42:35.013665 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:42:35.013665 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:42:35.013665 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:42:35.014633 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:35.014633 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:35.014633 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:35.014633 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:35.014633 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:35.014633 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:35.014633 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:35.014633 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:35.014633 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:35.014633 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:35.014633 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:35.014633 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:35.014633 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:35.014633 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:35.014633 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:35.014633 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:35.014633 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:42:35.015494 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:42:35.015494 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:35.015494 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:35.016230 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 387/766] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:42:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:35.018076 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f1657b-3fe1-4ee7-86e1-06b6159455bd None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:35.018550 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f1657b-3fe1-4ee7-86e1-06b6159455bd None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:35.019028 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f1657b-3fe1-4ee7-86e1-06b6159455bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:35.038178 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-c3f1657b-3fe1-4ee7-86e1-06b6159455bd None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:42:35.039685 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-c3f1657b-3fe1-4ee7-86e1-06b6159455bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:42:35.067785 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 380/767] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:42:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:42:35.069043 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccc0bbe-2f9f-4b7f-b1f8-d7a1dbe607dd None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:35.124396 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 388/768] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:42:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:42:35.147961 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:35.170482 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccc0bbe-2f9f-4b7f-b1f8-d7a1dbe607dd None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:35.205174 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93686ac7-c9d8-4669-9227-420e8c703053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:35.205858 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93686ac7-c9d8-4669-9227-420e8c703053 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:35.206211 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93686ac7-c9d8-4669-9227-420e8c703053 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:35.206539 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93686ac7-c9d8-4669-9227-420e8c703053 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:35.207270 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93686ac7-c9d8-4669-9227-420e8c703053 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:35.207627 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93686ac7-c9d8-4669-9227-420e8c703053 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:35.209081 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93686ac7-c9d8-4669-9227-420e8c703053 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:35.221212 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 381/769] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 19 14:42:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:35.227844 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f1657b-3fe1-4ee7-86e1-06b6159455bd None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:35.261558 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:35.267339 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93686ac7-c9d8-4669-9227-420e8c703053 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:35.409279 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f1657b-3fe1-4ee7-86e1-06b6159455bd None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:35.447251 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eada99b9-d39b-4b7e-9a49-eb82c40100a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:35.447920 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada99b9-d39b-4b7e-9a49-eb82c40100a2 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:35.448039 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93686ac7-c9d8-4669-9227-420e8c703053 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:35.448202 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada99b9-d39b-4b7e-9a49-eb82c40100a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:35.448469 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada99b9-d39b-4b7e-9a49-eb82c40100a2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:35.455525 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eada99b9-d39b-4b7e-9a49-eb82c40100a2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:35.456972 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eada99b9-d39b-4b7e-9a49-eb82c40100a2 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:35.468793 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-eada99b9-d39b-4b7e-9a49-eb82c40100a2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:42:35.468793 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:35.468793 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:35.468793 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:35.468793 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:35.468793 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:35.468793 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:35.468793 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:35.468793 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:35.468793 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:35.468793 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:35.468793 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:35.468793 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:42:35.468793 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:42:35.468793 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:42:35.469703 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:42:35.469703 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:35.469703 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:35.469703 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:35.469703 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:35.469703 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:35.469703 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:35.469703 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:35.469703 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:35.469703 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:35.469703 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:35.469703 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:35.469703 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:35.469703 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:35.469703 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:35.469703 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:35.469703 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:35.470581 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:42:35.470581 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:42:35.470581 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:42:35.470581 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:42:35.470581 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:42:35.470581 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:42:35.470581 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:42:35.470581 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:35.473148 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 389/770] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 19 14:42:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:35.474001 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eada99b9-d39b-4b7e-9a49-eb82c40100a2 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:35.481159 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:35.492230 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a7c7fe-b068-4e0b-a526-a9b051d64599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:35.493700 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a7c7fe-b068-4e0b-a526-a9b051d64599 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:35.493986 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a7c7fe-b068-4e0b-a526-a9b051d64599 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:35.494635 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a7c7fe-b068-4e0b-a526-a9b051d64599 None admin] PATH_INFO: `/v3/services/network` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:35.495331 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a7c7fe-b068-4e0b-a526-a9b051d64599 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:35.496718 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a7c7fe-b068-4e0b-a526-a9b051d64599 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:35.508332 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-71a7c7fe-b068-4e0b-a526-a9b051d64599 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 19 14:42:35.508332 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:35.508332 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 14:42:35.508332 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 14:42:35.508332 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 14:42:35.508332 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 14:42:35.508332 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 14:42:35.508332 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:42:35.508332 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 19 14:42:35.508332 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:42:35.508332 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 14:42:35.508332 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:42:35.508332 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:35.508332 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:35.508332 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:35.508332 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:35.508332 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:35.509367 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:35.509367 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:35.509367 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:35.509367 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:35.509367 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:35.509367 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:35.509367 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 14:42:35.509367 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 14:42:35.509367 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 14:42:35.509367 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 14:42:35.509367 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:35.509367 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:35.509367 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:35.509367 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:35.509367 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:35.509367 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:35.510368 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:35.510368 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:35.510368 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:35.510368 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:35.510368 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:35.510368 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:35.510368 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:35.510368 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:35.510368 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:35.510368 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:35.510368 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 14:42:35.510368 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:42:35.510368 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 19 14:42:35.510368 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:42:35.510368 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 382/771] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 19 14:42:35 2022] GET /identity/v3/services/network => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:42:35.511266 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a7c7fe-b068-4e0b-a526-a9b051d64599 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:35.558067 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:35.591096 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eada99b9-d39b-4b7e-9a49-eb82c40100a2 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:35.617531 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a7c7fe-b068-4e0b-a526-a9b051d64599 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:35.627385 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2543b29-6c79-4eeb-861a-9afa99d9977d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:35.628018 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2543b29-6c79-4eeb-861a-9afa99d9977d None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:35.628297 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2543b29-6c79-4eeb-861a-9afa99d9977d None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:35.628564 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2543b29-6c79-4eeb-861a-9afa99d9977d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:35.639217 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2543b29-6c79-4eeb-861a-9afa99d9977d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:42:35.645449 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-e2543b29-6c79-4eeb-861a-9afa99d9977d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:42:35.645449 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:35.645449 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:35.645449 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:35.645449 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:35.645449 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:35.645449 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:35.645449 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:35.645449 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:35.645449 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:35.645449 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:35.645449 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:35.645449 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:42:35.645449 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:42:35.645449 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:42:35.645449 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:42:35.646363 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:42:35.646363 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:42:35.646363 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:42:35.646363 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:42:35.646363 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:35.646363 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:35.646363 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:35.646363 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:35.646363 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:35.646363 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:35.646363 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:35.646363 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:35.646363 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:35.646363 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:35.646363 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:35.646363 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:35.647206 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:35.647206 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:35.647206 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:35.647206 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:35.647206 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:42:35.647206 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:42:35.647206 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:42:35.647206 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:42:35.647206 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:42:35.647206 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:42:35.647206 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:42:35.647206 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:35.651595 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 390/772] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 19 14:42:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:35.652444 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2543b29-6c79-4eeb-861a-9afa99d9977d None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:35.658125 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6508e669-2024-4a8f-a8df-12fc10f513d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:35.658787 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6508e669-2024-4a8f-a8df-12fc10f513d5 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:35.659065 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6508e669-2024-4a8f-a8df-12fc10f513d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:35.659386 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6508e669-2024-4a8f-a8df-12fc10f513d5 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:35.659909 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6508e669-2024-4a8f-a8df-12fc10f513d5 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:35.661755 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6508e669-2024-4a8f-a8df-12fc10f513d5 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:35.671284 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-6508e669-2024-4a8f-a8df-12fc10f513d5 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 19 14:42:35.671284 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:35.671284 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 14:42:35.671284 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 14:42:35.671284 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 14:42:35.671284 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 14:42:35.671284 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 14:42:35.671284 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:42:35.671284 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 19 14:42:35.671284 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:42:35.671284 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 14:42:35.671284 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:42:35.671284 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:35.671284 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:35.671284 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:35.671284 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:35.671284 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:35.672266 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:35.672266 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:35.672266 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:35.672266 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:35.672266 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:35.672266 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:35.672266 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 14:42:35.672266 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 14:42:35.672266 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 14:42:35.672266 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 14:42:35.672266 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:35.672266 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:35.672266 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:35.672266 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:35.672266 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:35.672266 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:35.673157 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:35.673157 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:35.673157 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:35.673157 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:35.673157 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:35.673157 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:35.673157 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:35.673157 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:35.673157 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:35.673157 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:35.673157 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 14:42:35.673157 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:42:35.673157 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 19 14:42:35.673157 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:42:35.673157 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 383/773] 10.222.0.26 () {56 vars in 1129 bytes} [Mon Sep 19 14:42:35 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:35.673955 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6508e669-2024-4a8f-a8df-12fc10f513d5 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:35.736291 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:35.769649 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2543b29-6c79-4eeb-861a-9afa99d9977d None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:35.784835 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6508e669-2024-4a8f-a8df-12fc10f513d5 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:35.800486 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:35.806939 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bee666-1f4d-4987-b142-42cd34485570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:35.807996 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bee666-1f4d-4987-b142-42cd34485570 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:35.808651 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bee666-1f4d-4987-b142-42cd34485570 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:35.809503 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bee666-1f4d-4987-b142-42cd34485570 None admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:35.810777 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bee666-1f4d-4987-b142-42cd34485570 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:35.811466 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bee666-1f4d-4987-b142-42cd34485570 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:35.813788 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bee666-1f4d-4987-b142-42cd34485570 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:35.819516 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd062386-31d7-4720-acd1-70b6d13522e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:35.820117 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd062386-31d7-4720-acd1-70b6d13522e6 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:35.820395 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd062386-31d7-4720-acd1-70b6d13522e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:35.820663 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd062386-31d7-4720-acd1-70b6d13522e6 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:35.821325 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd062386-31d7-4720-acd1-70b6d13522e6 None admin] RBAC: Adding query filter params (name=network) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:35.821895 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd062386-31d7-4720-acd1-70b6d13522e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:35.823265 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd062386-31d7-4720-acd1-70b6d13522e6 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:35.827849 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 391/774] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 19 14:42:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:35.829117 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bee666-1f4d-4987-b142-42cd34485570 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:35.832805 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 384/775] 10.222.0.26 () {56 vars in 1112 bytes} [Mon Sep 19 14:42:35 2022] GET /identity/v3/services?name=network => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:35.833718 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd062386-31d7-4720-acd1-70b6d13522e6 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:35.935734 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd062386-31d7-4720-acd1-70b6d13522e6 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:35.944908 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bee666-1f4d-4987-b142-42cd34485570 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:35.956682 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:35.975008 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd926b0-0077-47d7-9189-4eb15867d962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:35.975877 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd926b0-0077-47d7-9189-4eb15867d962 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:35.976010 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd926b0-0077-47d7-9189-4eb15867d962 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:35.976281 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd926b0-0077-47d7-9189-4eb15867d962 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:35.976910 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd926b0-0077-47d7-9189-4eb15867d962 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:35.977263 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd926b0-0077-47d7-9189-4eb15867d962 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:35.978702 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd926b0-0077-47d7-9189-4eb15867d962 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:35.983457 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 385/776] 10.222.0.26 () {56 vars in 1124 bytes} [Mon Sep 19 14:42:35 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:35.991080 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd926b0-0077-47d7-9189-4eb15867d962 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:36.000220 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cbcccb-c73b-4bce-8028-10e26854fc0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:36.000843 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cbcccb-c73b-4bce-8028-10e26854fc0e None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:36.001437 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cbcccb-c73b-4bce-8028-10e26854fc0e None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:36.001437 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cbcccb-c73b-4bce-8028-10e26854fc0e None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:36.002113 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cbcccb-c73b-4bce-8028-10e26854fc0e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:36.002389 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cbcccb-c73b-4bce-8028-10e26854fc0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:36.003946 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cbcccb-c73b-4bce-8028-10e26854fc0e None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:36.014610 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 392/777] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 19 14:42:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:36.015555 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cbcccb-c73b-4bce-8028-10e26854fc0e None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:36.073680 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:36.098115 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd926b0-0077-47d7-9189-4eb15867d962 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:36.124935 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cbcccb-c73b-4bce-8028-10e26854fc0e None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:36.132095 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d8cf72-e94e-485a-aa75-d86417fa0f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:36.132765 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d8cf72-e94e-485a-aa75-d86417fa0f65 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:36.133068 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d8cf72-e94e-485a-aa75-d86417fa0f65 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:36.133334 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d8cf72-e94e-485a-aa75-d86417fa0f65 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:36.133949 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d8cf72-e94e-485a-aa75-d86417fa0f65 None admin] RBAC: Adding query filter params (type=network) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:36.134243 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d8cf72-e94e-485a-aa75-d86417fa0f65 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:36.135793 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d8cf72-e94e-485a-aa75-d86417fa0f65 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:36.145364 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 386/778] 10.222.0.26 () {56 vars in 1112 bytes} [Mon Sep 19 14:42:35 2022] GET /identity/v3/services?type=network => generated 350 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:36.145364 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d8cf72-e94e-485a-aa75-d86417fa0f65 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:36.165998 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c630487-f6e0-4909-a2c3-303aa4928487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:36.166677 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c630487-f6e0-4909-a2c3-303aa4928487 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:36.166944 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c630487-f6e0-4909-a2c3-303aa4928487 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:36.167212 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c630487-f6e0-4909-a2c3-303aa4928487 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:36.167938 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c630487-f6e0-4909-a2c3-303aa4928487 None admin] RBAC: Adding query filter params (role.id=3d5d4018951045e18e7577ee742c10ca, scope.project.id=9ede5dc59ece4d9282867a99e94c4c41, user.id=2c2b1ac1a17c43d28da8f7e9a199dea4) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:36.168246 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c630487-f6e0-4909-a2c3-303aa4928487 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:36.169734 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c630487-f6e0-4909-a2c3-303aa4928487 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:36.175257 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 393/779] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 19 14:42:36 2022] GET /identity/v3/role_assignments?user.id=2c2b1ac1a17c43d28da8f7e9a199dea4&scope.project.id=9ede5dc59ece4d9282867a99e94c4c41&role.id=3d5d4018951045e18e7577ee742c10ca => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:36.176022 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c630487-f6e0-4909-a2c3-303aa4928487 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:36.213878 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:36.290897 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d8cf72-e94e-485a-aa75-d86417fa0f65 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:36.291515 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c630487-f6e0-4909-a2c3-303aa4928487 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:36.312022 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:36.332316 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed4a07d-9f39-4417-9d2d-546a77e024a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:36.332965 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4a07d-9f39-4417-9d2d-546a77e024a7 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:36.333325 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4a07d-9f39-4417-9d2d-546a77e024a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:36.333714 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4a07d-9f39-4417-9d2d-546a77e024a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:36.342800 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb043e0-01dc-4b8b-8767-97c167dd0fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:36.343805 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb043e0-01dc-4b8b-8767-97c167dd0fa0 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:36.343805 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb043e0-01dc-4b8b-8767-97c167dd0fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:36.344062 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb043e0-01dc-4b8b-8767-97c167dd0fa0 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:36.344651 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb043e0-01dc-4b8b-8767-97c167dd0fa0 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:36.344960 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb043e0-01dc-4b8b-8767-97c167dd0fa0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:36.346558 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb043e0-01dc-4b8b-8767-97c167dd0fa0 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:36.349350 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed4a07d-9f39-4417-9d2d-546a77e024a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:36.351317 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed4a07d-9f39-4417-9d2d-546a77e024a7 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:36.358205 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 387/780] 10.222.0.26 () {56 vars in 1124 bytes} [Mon Sep 19 14:42:36 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:36.358205 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb043e0-01dc-4b8b-8767-97c167dd0fa0 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:36.377154 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-5ed4a07d-9f39-4417-9d2d-546a77e024a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:36.377154 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:36.377154 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:36.377154 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:36.377154 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:36.377154 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:36.377154 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:36.377154 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:36.377154 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:36.377154 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:36.377154 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:36.377154 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:36.377154 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:42:36.377154 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:42:36.377154 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:42:36.377154 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:42:36.378165 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:36.378165 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:36.378165 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:36.378165 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:36.378165 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:36.378165 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:36.378165 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:36.378165 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:36.378165 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:36.378165 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:36.378165 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:36.378165 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:36.378165 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:36.378165 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:36.378165 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:36.378165 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:36.378165 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:42:36.379040 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:42:36.379040 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:36.379040 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:36.381316 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 394/781] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:42:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:36.383001 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed4a07d-9f39-4417-9d2d-546a77e024a7 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:36.470616 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb043e0-01dc-4b8b-8767-97c167dd0fa0 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:36.486528 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:36.512418 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8b97f0-8ff4-42fa-b62b-7b18c1346115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:36.513106 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b97f0-8ff4-42fa-b62b-7b18c1346115 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:36.513553 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b97f0-8ff4-42fa-b62b-7b18c1346115 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:36.513922 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b97f0-8ff4-42fa-b62b-7b18c1346115 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:36.514671 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8b97f0-8ff4-42fa-b62b-7b18c1346115 None admin] RBAC: Adding query filter params (interface=public, service_id=3d7f90bd30684ae092c1ea8ab8b28c64, region_id=RegionOne) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:36.515102 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8b97f0-8ff4-42fa-b62b-7b18c1346115 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:36.516578 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8b97f0-8ff4-42fa-b62b-7b18c1346115 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:36.522607 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed4a07d-9f39-4417-9d2d-546a77e024a7 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:36.524640 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 388/782] 10.222.0.26 () {56 vars in 1251 bytes} [Mon Sep 19 14:42:36 2022] GET /identity/v3/endpoints?service_id=3d7f90bd30684ae092c1ea8ab8b28c64&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:36.529668 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8b97f0-8ff4-42fa-b62b-7b18c1346115 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:36.570065 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529d27d2-047e-44a9-9fe5-34f425c0a470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:36.571392 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d27d2-047e-44a9-9fe5-34f425c0a470 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:36.571876 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d27d2-047e-44a9-9fe5-34f425c0a470 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:36.572829 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d27d2-047e-44a9-9fe5-34f425c0a470 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:36.574060 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529d27d2-047e-44a9-9fe5-34f425c0a470 None admin] RBAC: Adding query filter params (interface=public, service_id=bf4822d50c7245c2a0fc9b9089e4a8f0, region_id=RegionOne) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:36.574516 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529d27d2-047e-44a9-9fe5-34f425c0a470 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:36.576599 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529d27d2-047e-44a9-9fe5-34f425c0a470 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:36.587112 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 395/783] 10.222.0.26 () {56 vars in 1251 bytes} [Mon Sep 19 14:42:36 2022] GET /identity/v3/endpoints?service_id=bf4822d50c7245c2a0fc9b9089e4a8f0&interface=public®ion_id=RegionOne => generated 194 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:36.588363 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529d27d2-047e-44a9-9fe5-34f425c0a470 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:36.641779 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8b97f0-8ff4-42fa-b62b-7b18c1346115 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:36.684691 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e6330e-71d2-4fbd-b175-540cc519567b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:36.685606 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e6330e-71d2-4fbd-b175-540cc519567b None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:36.686078 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e6330e-71d2-4fbd-b175-540cc519567b None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:36.686518 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e6330e-71d2-4fbd-b175-540cc519567b None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:36.687417 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e6330e-71d2-4fbd-b175-540cc519567b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:36.687868 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e6330e-71d2-4fbd-b175-540cc519567b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:36.689496 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e6330e-71d2-4fbd-b175-540cc519567b None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:36.704769 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 389/784] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 19 14:42:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:36.706199 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e6330e-71d2-4fbd-b175-540cc519567b None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:36.746314 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:36.763928 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:36.816787 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e6330e-71d2-4fbd-b175-540cc519567b None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:36.845699 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529d27d2-047e-44a9-9fe5-34f425c0a470 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:36.854272 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9dee86-418c-4460-88a3-9715c9b17f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:36.855061 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9dee86-418c-4460-88a3-9715c9b17f63 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:36.855428 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9dee86-418c-4460-88a3-9715c9b17f63 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:36.855795 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9dee86-418c-4460-88a3-9715c9b17f63 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:36.856495 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9dee86-418c-4460-88a3-9715c9b17f63 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:36.858027 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9dee86-418c-4460-88a3-9715c9b17f63 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:36.873026 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 390/785] 10.222.0.26 () {56 vars in 1087 bytes} [Mon Sep 19 14:42:36 2022] GET /identity/v3/services => generated 772 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:36.873026 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9dee86-418c-4460-88a3-9715c9b17f63 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:36.929020 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103a8d27-365f-4231-a87e-418a5cf8d494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:36.931981 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103a8d27-365f-4231-a87e-418a5cf8d494 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:36.934286 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103a8d27-365f-4231-a87e-418a5cf8d494 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:36.934873 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103a8d27-365f-4231-a87e-418a5cf8d494 None admin] PATH_INFO: `/v3/services` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:36.935804 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103a8d27-365f-4231-a87e-418a5cf8d494 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:36.938181 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103a8d27-365f-4231-a87e-418a5cf8d494 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:36.953076 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 396/786] 10.222.0.26 () {56 vars in 1087 bytes} [Mon Sep 19 14:42:36 2022] GET /identity/v3/services => generated 772 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:37.033412 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e06d13e-f6c5-4a9d-aad0-60c8e4afc709 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:37.033793 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e06d13e-f6c5-4a9d-aad0-60c8e4afc709 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:37.033978 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e06d13e-f6c5-4a9d-aad0-60c8e4afc709 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:37.035634 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 397/787] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:42:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 14:42:37.041524 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1baaf2-393a-4d42-88c5-c01478d380f4 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:37.041875 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1baaf2-393a-4d42-88c5-c01478d380f4 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:37.042077 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1baaf2-393a-4d42-88c5-c01478d380f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:37.056118 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:37.059875 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9dee86-418c-4460-88a3-9715c9b17f63 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:37.079034 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-5e1baaf2-393a-4d42-88c5-c01478d380f4 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:42:37.080267 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-5e1baaf2-393a-4d42-88c5-c01478d380f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:42:37.133781 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eadb568-70aa-4d84-b61a-1eab303fe9fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:37.134437 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eadb568-70aa-4d84-b61a-1eab303fe9fd None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:37.134708 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eadb568-70aa-4d84-b61a-1eab303fe9fd None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:37.135274 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eadb568-70aa-4d84-b61a-1eab303fe9fd None admin] PATH_INFO: `/v3/users/nova` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:37.153268 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eadb568-70aa-4d84-b61a-1eab303fe9fd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:37.154771 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eadb568-70aa-4d84-b61a-1eab303fe9fd None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:37.175569 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-0eadb568-70aa-4d84-b61a-1eab303fe9fd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 19 14:42:37.175569 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:37.175569 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:37.175569 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:37.175569 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:37.175569 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:37.175569 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:37.175569 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:37.175569 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:37.175569 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:37.175569 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:37.175569 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:37.175569 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:42:37.175569 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:42:37.175569 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:42:37.175569 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:42:37.176571 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:37.176571 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:37.176571 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:42:37.176571 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:42:37.176571 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:42:37.176571 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:42:37.176571 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:37.176571 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:37.176571 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:37.176571 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:37.176571 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:37.176571 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:37.176571 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:37.176571 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:37.176571 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:37.176571 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:37.176571 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:37.176571 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:37.177554 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:37.177554 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:37.177554 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:42:37.177554 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:42:37.177554 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:42:37.177554 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:42:37.177554 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:42:37.177554 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:42:37.177554 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 19 14:42:37.177554 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:42:37.178074 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 391/788] 10.222.0.26 () {56 vars in 1093 bytes} [Mon Sep 19 14:42:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:37.184543 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eadb568-70aa-4d84-b61a-1eab303fe9fd None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:37.215857 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 398/789] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:42:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:42:37.299869 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eadb568-70aa-4d84-b61a-1eab303fe9fd None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:37.355378 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691a51bb-a915-4d1b-b636-f298bbd55141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:37.356252 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a51bb-a915-4d1b-b636-f298bbd55141 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:37.356704 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a51bb-a915-4d1b-b636-f298bbd55141 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:37.357160 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a51bb-a915-4d1b-b636-f298bbd55141 None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:37.358038 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691a51bb-a915-4d1b-b636-f298bbd55141 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:37.358486 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691a51bb-a915-4d1b-b636-f298bbd55141 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:37.360089 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691a51bb-a915-4d1b-b636-f298bbd55141 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:37.385333 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 392/790] 10.222.0.26 () {56 vars in 1133 bytes} [Mon Sep 19 14:42:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:37.390536 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1baaf2-393a-4d42-88c5-c01478d380f4 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:37.433808 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:37.519032 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691a51bb-a915-4d1b-b636-f298bbd55141 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:37.525597 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1baaf2-393a-4d42-88c5-c01478d380f4 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:37.545036 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:37.564620 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8ada88-89cf-4cde-b8d2-292e1cb2dcf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:37.565188 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8ada88-89cf-4cde-b8d2-292e1cb2dcf1 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:37.565464 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8ada88-89cf-4cde-b8d2-292e1cb2dcf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:37.565781 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8ada88-89cf-4cde-b8d2-292e1cb2dcf1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:37.639835 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691a51bb-a915-4d1b-b636-f298bbd55141 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:37.658256 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8ada88-89cf-4cde-b8d2-292e1cb2dcf1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:37.660020 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8ada88-89cf-4cde-b8d2-292e1cb2dcf1 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:37.679707 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09af5b0-65c5-4e81-8146-5d3d3a3e63d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:37.680335 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09af5b0-65c5-4e81-8146-5d3d3a3e63d5 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:37.680607 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09af5b0-65c5-4e81-8146-5d3d3a3e63d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:37.680870 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09af5b0-65c5-4e81-8146-5d3d3a3e63d5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:37.701659 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09af5b0-65c5-4e81-8146-5d3d3a3e63d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:42:37.709407 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-c09af5b0-65c5-4e81-8146-5d3d3a3e63d5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:42:37.709407 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:37.709407 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:37.709407 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:37.709407 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:37.709407 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:37.709407 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:37.709407 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:37.709407 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:37.709407 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:37.709407 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:37.709407 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:37.709407 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:42:37.709407 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:42:37.709407 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:42:37.709407 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:42:37.710324 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:42:37.710324 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:42:37.710324 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:42:37.710324 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:42:37.710324 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:37.710324 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:37.710324 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:37.710324 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:37.710324 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:37.710324 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:37.710324 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:37.710324 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:37.710324 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:37.710324 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:37.710324 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:37.710324 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:37.711132 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:37.711132 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:37.711132 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:37.711132 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:37.711132 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:42:37.711132 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:42:37.711132 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:42:37.711132 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:42:37.711132 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:42:37.711132 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:42:37.711132 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:42:37.711132 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:42:37.722467 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 393/791] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 19 14:42:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:42:37.726926 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09af5b0-65c5-4e81-8146-5d3d3a3e63d5 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:37.729178 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:37.868289 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 399/792] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 19 14:42:37 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 14:42:37.875499 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8ada88-89cf-4cde-b8d2-292e1cb2dcf1 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:37.886650 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:37.925077 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09af5b0-65c5-4e81-8146-5d3d3a3e63d5 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:37.999826 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e2189b-51f4-4bf9-9e30-ccf688725dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:38.000790 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e2189b-51f4-4bf9-9e30-ccf688725dde None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:38.001307 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e2189b-51f4-4bf9-9e30-ccf688725dde None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:38.001768 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e2189b-51f4-4bf9-9e30-ccf688725dde None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:38.003179 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e2189b-51f4-4bf9-9e30-ccf688725dde None admin] RBAC: Adding query filter params (name=admin) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:38.003671 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e2189b-51f4-4bf9-9e30-ccf688725dde None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:38.005278 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e2189b-51f4-4bf9-9e30-ccf688725dde None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:38.025026 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 394/793] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 19 14:42:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:38.032621 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e2189b-51f4-4bf9-9e30-ccf688725dde None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:38.071080 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8ada88-89cf-4cde-b8d2-292e1cb2dcf1 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:38.130601 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:38.140945 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70acab0e-25c6-4826-b5e0-18e15daa9a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:38.142097 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70acab0e-25c6-4826-b5e0-18e15daa9a5e None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:38.142618 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70acab0e-25c6-4826-b5e0-18e15daa9a5e None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:38.143101 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70acab0e-25c6-4826-b5e0-18e15daa9a5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:38.163708 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70acab0e-25c6-4826-b5e0-18e15daa9a5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:38.165904 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70acab0e-25c6-4826-b5e0-18e15daa9a5e None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:38.201665 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-70acab0e-25c6-4826-b5e0-18e15daa9a5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:38.201665 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:38.201665 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:38.201665 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:38.201665 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:38.201665 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:38.201665 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:38.201665 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:38.201665 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:38.201665 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:38.201665 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:38.201665 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:38.201665 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:42:38.201665 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:42:38.201665 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:42:38.201665 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:42:38.202659 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:38.202659 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:38.202659 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:38.202659 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:38.202659 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:38.202659 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:38.202659 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:38.202659 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:38.202659 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:38.202659 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:38.202659 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:38.202659 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:38.202659 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:38.202659 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:38.202659 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:38.202659 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:38.202659 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:42:38.203545 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:42:38.203545 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:38.203545 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:38.209310 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 400/794] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:42:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:38.215194 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70acab0e-25c6-4826-b5e0-18e15daa9a5e None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:38.250550 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e2189b-51f4-4bf9-9e30-ccf688725dde None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:38.286717 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aaa6db-f932-4176-8f0b-d4cf48103716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:38.287706 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aaa6db-f932-4176-8f0b-d4cf48103716 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:38.288183 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aaa6db-f932-4176-8f0b-d4cf48103716 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:38.288659 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aaa6db-f932-4176-8f0b-d4cf48103716 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:38.298774 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:38.301484 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aaa6db-f932-4176-8f0b-d4cf48103716 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:38.303181 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aaa6db-f932-4176-8f0b-d4cf48103716 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:38.318042 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-44aaa6db-f932-4176-8f0b-d4cf48103716 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:38.318042 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:38.318042 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:38.318042 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:38.318042 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:38.318042 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:38.318042 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:38.318042 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:38.318042 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:38.318042 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:38.318042 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:38.318042 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:38.318042 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:42:38.318042 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:42:38.318042 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:42:38.318042 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:42:38.318972 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:38.318972 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:38.318972 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:38.318972 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:38.318972 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:38.318972 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:38.318972 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:38.318972 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:38.318972 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:38.318972 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:38.318972 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:38.318972 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:38.318972 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:38.318972 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:38.318972 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:38.318972 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:38.318972 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:42:38.319833 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:42:38.319833 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:38.319833 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:42:38.321909 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 395/795] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:42:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:42:38.327639 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aaa6db-f932-4176-8f0b-d4cf48103716 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:38.446905 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70acab0e-25c6-4826-b5e0-18e15daa9a5e None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:38.459660 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aaa6db-f932-4176-8f0b-d4cf48103716 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:38.516224 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a2c5e3-e572-44a7-af61-3a4fed1d9cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:38.517365 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a2c5e3-e572-44a7-af61-3a4fed1d9cee None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:38.517874 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a2c5e3-e572-44a7-af61-3a4fed1d9cee None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:38.518405 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a2c5e3-e572-44a7-af61-3a4fed1d9cee None admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:38.519313 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a2c5e3-e572-44a7-af61-3a4fed1d9cee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:38.519802 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a2c5e3-e572-44a7-af61-3a4fed1d9cee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:38.521373 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a2c5e3-e572-44a7-af61-3a4fed1d9cee None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:38.527382 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77819cc-dfa3-420b-b6c5-80f2c1741646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:38.528023 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77819cc-dfa3-420b-b6c5-80f2c1741646 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:38.528300 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77819cc-dfa3-420b-b6c5-80f2c1741646 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:38.528570 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77819cc-dfa3-420b-b6c5-80f2c1741646 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:38.529258 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77819cc-dfa3-420b-b6c5-80f2c1741646 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:38.529559 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77819cc-dfa3-420b-b6c5-80f2c1741646 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:38.530966 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77819cc-dfa3-420b-b6c5-80f2c1741646 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:38.543236 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 401/796] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 19 14:42:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:38.545651 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 396/797] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 19 14:42:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:42:38.547457 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbda45d-fd32-4bad-9f98-863fb0a188bf None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:38.547750 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbda45d-fd32-4bad-9f98-863fb0a188bf None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:38.548024 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbda45d-fd32-4bad-9f98-863fb0a188bf None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:38.549060 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77819cc-dfa3-420b-b6c5-80f2c1741646 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:38.549314 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 402/798] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:42:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:42:38.551005 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbda45d-fd32-4bad-9f98-863fb0a188bf None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:38.605163 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:38.622542 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:38.680917 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbda45d-fd32-4bad-9f98-863fb0a188bf None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:38.685261 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77819cc-dfa3-420b-b6c5-80f2c1741646 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:38.723515 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3196214f-1e03-4e39-8d00-0300b94fd3c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:38.724379 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3196214f-1e03-4e39-8d00-0300b94fd3c6 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:38.724886 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3196214f-1e03-4e39-8d00-0300b94fd3c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:38.725334 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3196214f-1e03-4e39-8d00-0300b94fd3c6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:38.728723 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba68cf7b-ad6c-4df5-8ea9-870b18417855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:38.729401 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba68cf7b-ad6c-4df5-8ea9-870b18417855 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:38.729684 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba68cf7b-ad6c-4df5-8ea9-870b18417855 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:38.729957 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba68cf7b-ad6c-4df5-8ea9-870b18417855 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:38.734497 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3196214f-1e03-4e39-8d00-0300b94fd3c6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:38.736135 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3196214f-1e03-4e39-8d00-0300b94fd3c6 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:38.737457 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba68cf7b-ad6c-4df5-8ea9-870b18417855 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:38.740076 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba68cf7b-ad6c-4df5-8ea9-870b18417855 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:38.749736 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-3196214f-1e03-4e39-8d00-0300b94fd3c6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 19 14:42:38.749736 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:38.749736 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:38.749736 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:38.749736 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:38.749736 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:38.749736 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:38.749736 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:38.749736 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:38.749736 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:38.749736 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:38.749736 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:38.749736 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:42:38.749736 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:42:38.749736 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:42:38.749736 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:42:38.750657 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:38.750657 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:38.750657 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:42:38.750657 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:42:38.750657 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:42:38.750657 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:42:38.750657 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:38.750657 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:38.750657 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:38.750657 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:38.750657 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:38.750657 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:38.750657 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:38.750657 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:38.750657 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:38.750657 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:38.750657 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:38.750657 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:38.751659 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:38.751659 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:38.751659 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:42:38.751659 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:42:38.751659 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:42:38.751659 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:42:38.751659 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:42:38.751659 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:42:38.751659 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 19 14:42:38.751659 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:38.752511 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-ba68cf7b-ad6c-4df5-8ea9-870b18417855 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:42:38.752511 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:38.752511 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:38.752511 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:38.752511 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:38.752511 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:38.752511 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:38.752511 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:38.752511 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:38.752511 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:38.752511 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:38.752511 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:38.752511 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:42:38.752511 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:42:38.752511 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:42:38.753432 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:42:38.753432 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:38.753432 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:38.753432 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:38.753432 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:38.753432 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:38.753432 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:38.753432 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:38.753432 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:38.753432 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:38.753432 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:38.753432 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:38.753432 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:38.753432 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:38.753432 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:38.753432 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:38.753432 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:38.754282 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:42:38.754282 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:42:38.754282 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:42:38.754282 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:42:38.754282 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:42:38.754282 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:42:38.754282 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:42:38.754282 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:42:38.756597 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 403/800] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 19 14:42:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:42:38.758093 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9983a6-5164-4117-b634-da31c5686969 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:38.758610 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 397/800] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 19 14:42:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:42:38.758843 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9983a6-5164-4117-b634-da31c5686969 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:38.759291 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9983a6-5164-4117-b634-da31c5686969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:38.759436 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba68cf7b-ad6c-4df5-8ea9-870b18417855 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:38.782207 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-aa9983a6-5164-4117-b634-da31c5686969 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:42:38.783411 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-aa9983a6-5164-4117-b634-da31c5686969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:42:38.860504 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 404/801] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:42:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:42:38.861811 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9983a6-5164-4117-b634-da31c5686969 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:38.869905 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba68cf7b-ad6c-4df5-8ea9-870b18417855 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:38.886631 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:38.899747 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:38.916805 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e9095a-5205-4eb7-bce1-1cdf320d708c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:38.917625 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e9095a-5205-4eb7-bce1-1cdf320d708c None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:38.918005 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e9095a-5205-4eb7-bce1-1cdf320d708c None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:38.918773 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e9095a-5205-4eb7-bce1-1cdf320d708c None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:38.919848 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e9095a-5205-4eb7-bce1-1cdf320d708c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:38.920254 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e9095a-5205-4eb7-bce1-1cdf320d708c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:38.922091 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e9095a-5205-4eb7-bce1-1cdf320d708c None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:38.939305 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 398/802] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 19 14:42:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:38.945129 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e9095a-5205-4eb7-bce1-1cdf320d708c None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:38.993628 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9983a6-5164-4117-b634-da31c5686969 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:39.034822 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b1e597-fc62-48c4-a9dc-2f77f64398fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:39.035839 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b1e597-fc62-48c4-a9dc-2f77f64398fe None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:39.036307 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b1e597-fc62-48c4-a9dc-2f77f64398fe None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:39.036799 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b1e597-fc62-48c4-a9dc-2f77f64398fe None admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:39.038049 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b1e597-fc62-48c4-a9dc-2f77f64398fe None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:39.038571 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b1e597-fc62-48c4-a9dc-2f77f64398fe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:39.040467 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b1e597-fc62-48c4-a9dc-2f77f64398fe None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:39.061207 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 405/803] 10.222.0.26 () {56 vars in 1135 bytes} [Mon Sep 19 14:42:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:39.067374 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b1e597-fc62-48c4-a9dc-2f77f64398fe None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:39.147088 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e9095a-5205-4eb7-bce1-1cdf320d708c None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:39.170076 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:39.184154 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b1e597-fc62-48c4-a9dc-2f77f64398fe None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:39.223593 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833537cc-32c0-46e5-b49b-f2727c58aa23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:39.224597 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833537cc-32c0-46e5-b49b-f2727c58aa23 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:39.225092 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833537cc-32c0-46e5-b49b-f2727c58aa23 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:39.225548 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833537cc-32c0-46e5-b49b-f2727c58aa23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:39.237505 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833537cc-32c0-46e5-b49b-f2727c58aa23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:39.239731 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833537cc-32c0-46e5-b49b-f2727c58aa23 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:39.250465 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14f34b0-e26f-4dd4-8692-3724bc866371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:39.251040 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14f34b0-e26f-4dd4-8692-3724bc866371 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:39.251275 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14f34b0-e26f-4dd4-8692-3724bc866371 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:39.251543 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14f34b0-e26f-4dd4-8692-3724bc866371 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:39.252272 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14f34b0-e26f-4dd4-8692-3724bc866371 None admin] RBAC: Adding query filter params (role.id=019bde1756cb40de8ce06cef6b261f79, scope.project.id=9ede5dc59ece4d9282867a99e94c4c41, user.id=3017e5d92bef4cc2aeae4f28c78ba233) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:39.252571 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14f34b0-e26f-4dd4-8692-3724bc866371 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:39.254029 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14f34b0-e26f-4dd4-8692-3724bc866371 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:39.258801 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-833537cc-32c0-46e5-b49b-f2727c58aa23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:39.258801 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:39.258801 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:39.258801 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:39.258801 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:39.258801 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:39.258801 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:39.258801 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:39.258801 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:39.258801 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:39.258801 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:39.258801 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:39.258801 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:42:39.258801 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:42:39.258801 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:42:39.258801 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:42:39.259778 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:39.259778 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:39.259778 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:39.259778 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:39.259778 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:39.259778 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:39.259778 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:39.259778 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:39.259778 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:39.259778 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:39.259778 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:39.259778 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:39.259778 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:39.259778 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:39.259778 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:39.259778 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:39.259778 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:42:39.260640 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:42:39.260640 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:39.260640 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:39.261316 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 399/804] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 19 14:42:38 2022] GET /identity/v3/role_assignments?user.id=3017e5d92bef4cc2aeae4f28c78ba233&scope.project.id=9ede5dc59ece4d9282867a99e94c4c41&role.id=019bde1756cb40de8ce06cef6b261f79 => generated 608 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:42:39.261661 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14f34b0-e26f-4dd4-8692-3724bc866371 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:39.263234 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 406/805] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:42:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:39.269993 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833537cc-32c0-46e5-b49b-f2727c58aa23 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:39.307929 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:39.403075 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833537cc-32c0-46e5-b49b-f2727c58aa23 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:39.443668 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14f34b0-e26f-4dd4-8692-3724bc866371 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:39.458713 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947c88e0-0e55-4385-94ca-b6e619bcb504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:39.459809 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c88e0-0e55-4385-94ca-b6e619bcb504 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:39.460286 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c88e0-0e55-4385-94ca-b6e619bcb504 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:39.460754 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c88e0-0e55-4385-94ca-b6e619bcb504 None admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:39.461644 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947c88e0-0e55-4385-94ca-b6e619bcb504 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:39.462162 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947c88e0-0e55-4385-94ca-b6e619bcb504 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:39.468151 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947c88e0-0e55-4385-94ca-b6e619bcb504 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:39.489255 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:39.494148 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 407/806] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 19 14:42:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:39.500249 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947c88e0-0e55-4385-94ca-b6e619bcb504 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:39.551702 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227798f3-1b88-40b8-ba46-bb0c44bf44ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:39.553140 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227798f3-1b88-40b8-ba46-bb0c44bf44ca None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:39.553630 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227798f3-1b88-40b8-ba46-bb0c44bf44ca None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:39.554095 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227798f3-1b88-40b8-ba46-bb0c44bf44ca None admin] PATH_INFO: `/v3/roles/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:39.569225 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227798f3-1b88-40b8-ba46-bb0c44bf44ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:42:39.579963 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-227798f3-1b88-40b8-ba46-bb0c44bf44ca None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:42:39.579963 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:39.579963 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:39.579963 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:39.579963 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:39.579963 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:39.579963 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:39.579963 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:39.579963 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:39.579963 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:39.579963 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:39.579963 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:39.579963 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:42:39.579963 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:42:39.579963 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:42:39.579963 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:42:39.581429 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:42:39.581429 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:42:39.581429 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:42:39.581429 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:42:39.581429 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:39.581429 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:39.581429 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:39.581429 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:39.581429 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:39.581429 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:39.581429 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:39.581429 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:39.581429 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:39.581429 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:39.581429 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:39.581429 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:39.582258 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:39.582258 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:39.582258 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:39.582258 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:39.582258 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:42:39.582258 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:42:39.582258 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:42:39.582258 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:42:39.582258 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:42:39.582258 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:42:39.582258 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:42:39.582258 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:42:39.584905 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 400/807] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Sep 19 14:42:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:39.591405 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227798f3-1b88-40b8-ba46-bb0c44bf44ca None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:39.648525 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947c88e0-0e55-4385-94ca-b6e619bcb504 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:39.690951 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd32334e-1856-4c63-921a-b9572acbc45c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:39.691998 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32334e-1856-4c63-921a-b9572acbc45c None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:39.692615 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32334e-1856-4c63-921a-b9572acbc45c None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:39.692947 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32334e-1856-4c63-921a-b9572acbc45c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:39.700568 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd32334e-1856-4c63-921a-b9572acbc45c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:39.702343 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd32334e-1856-4c63-921a-b9572acbc45c None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:39.714746 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-cd32334e-1856-4c63-921a-b9572acbc45c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:42:39.714746 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:39.714746 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:39.714746 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:39.714746 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:39.714746 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:39.714746 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:39.714746 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:39.714746 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:39.714746 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:39.714746 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:39.714746 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:39.714746 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:42:39.714746 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:42:39.714746 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:42:39.715855 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:42:39.715855 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:39.715855 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:39.715855 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:39.715855 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:39.715855 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:39.715855 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:39.715855 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:39.715855 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:39.715855 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:39.715855 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:39.715855 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:39.715855 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:39.715855 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:39.715855 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:39.715855 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:39.715855 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:39.717468 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:42:39.717468 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:42:39.717468 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:42:39.717468 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:42:39.717468 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:42:39.717468 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:42:39.717468 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:42:39.717468 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:39.717468 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 408/808] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 19 14:42:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:39.718193 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e0d7f-6d39-4eec-8a99-6e1ce38a8b2c None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:39.718193 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e0d7f-6d39-4eec-8a99-6e1ce38a8b2c None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:39.718193 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e0d7f-6d39-4eec-8a99-6e1ce38a8b2c None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:39.719494 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 409/809] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:42:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:42:39.720343 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c6ebc1-8758-4d7c-acc2-ed8ae0d6d687 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:39.720625 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c6ebc1-8758-4d7c-acc2-ed8ae0d6d687 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:39.720876 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c6ebc1-8758-4d7c-acc2-ed8ae0d6d687 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:39.722308 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 410/810] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:42:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:42:39.723008 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c6ebc1-8758-4d7c-acc2-ed8ae0d6d687 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:39.727824 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227798f3-1b88-40b8-ba46-bb0c44bf44ca None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:39.730414 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:39.765855 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7c87f6-184e-44b9-9f8d-65167d61a272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:39.766467 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c87f6-184e-44b9-9f8d-65167d61a272 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:39.766742 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c87f6-184e-44b9-9f8d-65167d61a272 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:39.767007 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c87f6-184e-44b9-9f8d-65167d61a272 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:39.767665 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7c87f6-184e-44b9-9f8d-65167d61a272 None admin] RBAC: Adding query filter params (name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:39.767965 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7c87f6-184e-44b9-9f8d-65167d61a272 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:39.769394 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7c87f6-184e-44b9-9f8d-65167d61a272 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:39.778215 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 401/811] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Sep 19 14:42:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:39.779510 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5030c21f-1cd0-47c3-a67e-382823f63336 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:39.779793 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5030c21f-1cd0-47c3-a67e-382823f63336 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:39.780063 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5030c21f-1cd0-47c3-a67e-382823f63336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:39.793092 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:39.801007 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-5030c21f-1cd0-47c3-a67e-382823f63336 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:42:39.802709 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-5030c21f-1cd0-47c3-a67e-382823f63336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:42:39.851388 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c6ebc1-8758-4d7c-acc2-ed8ae0d6d687 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:39.878918 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 402/812] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:42:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:42:39.880222 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83728f38-4839-4670-87d9-c44130188417 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:39.880505 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83728f38-4839-4670-87d9-c44130188417 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:39.880776 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83728f38-4839-4670-87d9-c44130188417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:39.894024 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6deed25-0dca-4dd1-93d6-0d3d42bc4997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:39.895480 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6deed25-0dca-4dd1-93d6-0d3d42bc4997 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:39.896052 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6deed25-0dca-4dd1-93d6-0d3d42bc4997 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:39.896760 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6deed25-0dca-4dd1-93d6-0d3d42bc4997 None admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:39.897699 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6deed25-0dca-4dd1-93d6-0d3d42bc4997 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:39.898217 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6deed25-0dca-4dd1-93d6-0d3d42bc4997 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:39.899982 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6deed25-0dca-4dd1-93d6-0d3d42bc4997 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:39.901266 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-83728f38-4839-4670-87d9-c44130188417 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:42:39.902650 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-83728f38-4839-4670-87d9-c44130188417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:42:39.922903 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 411/813] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 19 14:42:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:39.922903 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6deed25-0dca-4dd1-93d6-0d3d42bc4997 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:39.996264 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 403/814] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:42:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:42:39.996264 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83728f38-4839-4670-87d9-c44130188417 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:40.041017 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:40.078695 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6deed25-0dca-4dd1-93d6-0d3d42bc4997 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:40.114703 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:40.145316 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e641067d-8b50-444c-b64a-93616b5db3aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:40.145986 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e641067d-8b50-444c-b64a-93616b5db3aa None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:40.146255 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e641067d-8b50-444c-b64a-93616b5db3aa None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:40.146522 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e641067d-8b50-444c-b64a-93616b5db3aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:40.161830 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e641067d-8b50-444c-b64a-93616b5db3aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:40.163575 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e641067d-8b50-444c-b64a-93616b5db3aa None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:40.173572 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83728f38-4839-4670-87d9-c44130188417 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:40.180387 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-e641067d-8b50-444c-b64a-93616b5db3aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:40.180387 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:40.180387 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:40.180387 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:40.180387 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:40.180387 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:40.180387 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:40.180387 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:40.180387 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:40.180387 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:40.180387 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:40.180387 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:40.180387 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:42:40.180387 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:42:40.180387 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:42:40.180387 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:42:40.181442 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:40.181442 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:40.181442 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:40.181442 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:40.181442 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:40.181442 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:40.181442 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:40.181442 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:40.181442 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:40.181442 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:40.181442 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:40.181442 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:40.181442 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:40.181442 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:40.181442 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:40.181442 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:40.181442 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:42:40.182562 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:42:40.182562 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:40.182562 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:40.182562 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 412/815] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:42:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:40.183732 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e641067d-8b50-444c-b64a-93616b5db3aa None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:40.211168 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73ba9e5-811b-4b0c-9360-99d51f525795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:40.212152 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ba9e5-811b-4b0c-9360-99d51f525795 None admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:40.212434 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ba9e5-811b-4b0c-9360-99d51f525795 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:40.213267 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ba9e5-811b-4b0c-9360-99d51f525795 None admin] PATH_INFO: `/v3/projects/9ede5dc59ece4d9282867a99e94c4c41/users/76cb60a5e90343e69a38db4356cb3a90/roles/019bde1756cb40de8ce06cef6b261f79` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:40.216305 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73ba9e5-811b-4b0c-9360-99d51f525795 None admin] RBAC: Authorizing `identity:create_grant(project_id=9ede5dc59ece4d9282867a99e94c4c41, user_id=76cb60a5e90343e69a38db4356cb3a90, role_id=019bde1756cb40de8ce06cef6b261f79)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:40.218607 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73ba9e5-811b-4b0c-9360-99d51f525795 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:40.237676 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 404/816] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Sep 19 14:42:39 2022] PUT /identity/v3/projects/9ede5dc59ece4d9282867a99e94c4c41/users/76cb60a5e90343e69a38db4356cb3a90/roles/019bde1756cb40de8ce06cef6b261f79 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:42:40.239242 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73ba9e5-811b-4b0c-9360-99d51f525795 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:40.311327 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e641067d-8b50-444c-b64a-93616b5db3aa None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:40.352031 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c168f35-9dd9-4531-8fa1-6a16a7ef76ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:40.352701 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c168f35-9dd9-4531-8fa1-6a16a7ef76ec None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:40.353108 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c168f35-9dd9-4531-8fa1-6a16a7ef76ec None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:40.353539 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c168f35-9dd9-4531-8fa1-6a16a7ef76ec None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:40.354349 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c168f35-9dd9-4531-8fa1-6a16a7ef76ec None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:40.355921 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c168f35-9dd9-4531-8fa1-6a16a7ef76ec None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:40.359498 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:40.366400 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-1c168f35-9dd9-4531-8fa1-6a16a7ef76ec None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 19 14:42:40.366400 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:40.366400 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 14:42:40.366400 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 14:42:40.366400 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 14:42:40.366400 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 14:42:40.366400 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 14:42:40.366400 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:42:40.366400 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 19 14:42:40.366400 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:40.366400 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 14:42:40.366400 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:40.366400 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:40.366400 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:40.366400 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:40.366400 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:40.366400 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:40.369865 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:40.369865 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:40.369865 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:40.369865 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:40.369865 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:40.369865 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:40.369865 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 14:42:40.369865 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 14:42:40.369865 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 14:42:40.369865 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 14:42:40.369865 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:40.369865 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:40.369865 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:40.369865 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:40.369865 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:40.369865 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:40.370821 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:40.370821 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:40.370821 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:40.370821 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:40.370821 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:40.370821 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:40.370821 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:40.370821 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:40.370821 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:40.370821 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:40.370821 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 14:42:40.370821 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:42:40.370821 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 19 14:42:40.370821 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:40.370821 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 413/817] 10.222.0.26 () {56 vars in 1129 bytes} [Mon Sep 19 14:42:40 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:40.371800 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c168f35-9dd9-4531-8fa1-6a16a7ef76ec None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:40.389899 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73ba9e5-811b-4b0c-9360-99d51f525795 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:40.414751 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:40.444264 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5845d57-8440-4d1f-8d43-a704e4c15820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:40.445484 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5845d57-8440-4d1f-8d43-a704e4c15820 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:40.445925 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5845d57-8440-4d1f-8d43-a704e4c15820 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:40.446831 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5845d57-8440-4d1f-8d43-a704e4c15820 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:40.448093 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5845d57-8440-4d1f-8d43-a704e4c15820 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:40.448577 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5845d57-8440-4d1f-8d43-a704e4c15820 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:40.450919 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5845d57-8440-4d1f-8d43-a704e4c15820 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:40.467716 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 405/818] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 19 14:42:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:40.468652 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5845d57-8440-4d1f-8d43-a704e4c15820 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:40.500262 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c168f35-9dd9-4531-8fa1-6a16a7ef76ec None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:40.546157 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f0425e-c302-4bef-ab24-a896ee988461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:40.547201 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f0425e-c302-4bef-ab24-a896ee988461 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:40.547680 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f0425e-c302-4bef-ab24-a896ee988461 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:40.548162 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f0425e-c302-4bef-ab24-a896ee988461 None admin] PATH_INFO: `/v3/services/network` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:40.548954 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f0425e-c302-4bef-ab24-a896ee988461 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:40.550584 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f0425e-c302-4bef-ab24-a896ee988461 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:40.560415 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-d4f0425e-c302-4bef-ab24-a896ee988461 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 19 14:42:40.560415 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:40.560415 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 14:42:40.560415 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 14:42:40.560415 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 14:42:40.560415 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 14:42:40.560415 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 14:42:40.560415 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:42:40.560415 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 19 14:42:40.560415 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:40.560415 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 14:42:40.560415 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:40.560415 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:40.560415 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:40.560415 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:40.560415 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:40.560415 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:40.561447 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:40.561447 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:40.561447 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:40.561447 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:40.561447 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:40.561447 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:40.561447 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 14:42:40.561447 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 14:42:40.561447 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 14:42:40.561447 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 14:42:40.561447 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:40.561447 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:40.561447 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:40.561447 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:40.561447 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:40.561447 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:40.562253 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:40.562253 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:40.562253 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:40.562253 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:40.562253 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:40.562253 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:40.562253 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:40.562253 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:40.562253 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:40.562253 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:40.562253 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 14:42:40.562253 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:42:40.562253 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 19 14:42:40.562253 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:40.565051 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 414/819] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 19 14:42:40 2022] GET /identity/v3/services/network => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:40.570706 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f0425e-c302-4bef-ab24-a896ee988461 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:40.600635 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5845d57-8440-4d1f-8d43-a704e4c15820 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:40.644330 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba0d5a8-2909-4a63-9eda-1be3ae4b6c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:40.644937 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba0d5a8-2909-4a63-9eda-1be3ae4b6c27 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:40.645253 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba0d5a8-2909-4a63-9eda-1be3ae4b6c27 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:40.645523 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba0d5a8-2909-4a63-9eda-1be3ae4b6c27 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:40.646159 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba0d5a8-2909-4a63-9eda-1be3ae4b6c27 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:40.646459 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba0d5a8-2909-4a63-9eda-1be3ae4b6c27 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:40.648112 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba0d5a8-2909-4a63-9eda-1be3ae4b6c27 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:40.655252 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 406/820] 10.222.0.26 () {56 vars in 1124 bytes} [Mon Sep 19 14:42:40 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:40.656133 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba0d5a8-2909-4a63-9eda-1be3ae4b6c27 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:40.658986 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:40.687714 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:40.691833 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f0425e-c302-4bef-ab24-a896ee988461 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:40.730787 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6405f509-5aad-48b8-89a1-86435315a7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:40.731903 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6405f509-5aad-48b8-89a1-86435315a7ca None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:40.732390 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6405f509-5aad-48b8-89a1-86435315a7ca None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:40.732867 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6405f509-5aad-48b8-89a1-86435315a7ca None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:40.741933 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6405f509-5aad-48b8-89a1-86435315a7ca None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:40.743676 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6405f509-5aad-48b8-89a1-86435315a7ca None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:40.756651 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-6405f509-5aad-48b8-89a1-86435315a7ca None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 14:42:40.756651 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:40.756651 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:40.756651 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:40.756651 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:40.756651 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:40.756651 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:40.756651 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:40.756651 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:40.756651 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:40.756651 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:40.756651 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:40.756651 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:42:40.756651 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:42:40.756651 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:42:40.756651 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:42:40.757836 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:40.757836 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:40.757836 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:42:40.757836 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:42:40.757836 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:42:40.757836 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:42:40.757836 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:40.757836 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:40.757836 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:40.757836 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:40.757836 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:40.757836 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:40.757836 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:40.757836 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:40.757836 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:40.757836 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:40.757836 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:40.757836 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:40.758789 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:40.758789 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:40.758789 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:42:40.758789 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:42:40.758789 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:42:40.758789 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:42:40.758789 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:42:40.758789 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:42:40.758789 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 14:42:40.758789 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:40.761586 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 415/821] 10.222.0.26 () {56 vars in 1117 bytes} [Mon Sep 19 14:42:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:40.762775 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6405f509-5aad-48b8-89a1-86435315a7ca None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:40.773336 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba0d5a8-2909-4a63-9eda-1be3ae4b6c27 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:40.812484 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1471588e-6a8c-4afd-b859-12bdbd1ef1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:40.813170 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1471588e-6a8c-4afd-b859-12bdbd1ef1ff None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:40.813501 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1471588e-6a8c-4afd-b859-12bdbd1ef1ff None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:40.813770 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1471588e-6a8c-4afd-b859-12bdbd1ef1ff None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:40.814413 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1471588e-6a8c-4afd-b859-12bdbd1ef1ff None admin] RBAC: Adding query filter params (name=network) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:40.814726 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1471588e-6a8c-4afd-b859-12bdbd1ef1ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:40.816119 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1471588e-6a8c-4afd-b859-12bdbd1ef1ff None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:40.821065 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 407/822] 10.222.0.26 () {56 vars in 1112 bytes} [Mon Sep 19 14:42:40 2022] GET /identity/v3/services?name=network => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:40.826987 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1471588e-6a8c-4afd-b859-12bdbd1ef1ff None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:40.896878 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:40.898558 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6405f509-5aad-48b8-89a1-86435315a7ca None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:40.941047 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402d70ad-bdae-4d74-89f5-b05d97077f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:40.941710 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d70ad-bdae-4d74-89f5-b05d97077f74 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:40.941962 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d70ad-bdae-4d74-89f5-b05d97077f74 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:40.942230 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d70ad-bdae-4d74-89f5-b05d97077f74 None admin] PATH_INFO: `/v3/services` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:40.942850 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402d70ad-bdae-4d74-89f5-b05d97077f74 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:40.943145 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402d70ad-bdae-4d74-89f5-b05d97077f74 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:40.943937 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1471588e-6a8c-4afd-b859-12bdbd1ef1ff None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:40.944511 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402d70ad-bdae-4d74-89f5-b05d97077f74 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:40.953147 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 416/823] 10.222.0.26 () {56 vars in 1124 bytes} [Mon Sep 19 14:42:40 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:40.954226 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402d70ad-bdae-4d74-89f5-b05d97077f74 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:40.983416 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:40.991213 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5eba0a-7287-4b28-8261-f2e1383bc062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:40.992058 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5eba0a-7287-4b28-8261-f2e1383bc062 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:40.992198 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5eba0a-7287-4b28-8261-f2e1383bc062 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:40.992397 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5eba0a-7287-4b28-8261-f2e1383bc062 None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:40.998547 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5eba0a-7287-4b28-8261-f2e1383bc062 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:40.999026 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5eba0a-7287-4b28-8261-f2e1383bc062 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:41.000614 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5eba0a-7287-4b28-8261-f2e1383bc062 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:41.024203 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 408/824] 10.222.0.26 () {56 vars in 1149 bytes} [Mon Sep 19 14:42:40 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:41.025395 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5eba0a-7287-4b28-8261-f2e1383bc062 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:41.067391 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402d70ad-bdae-4d74-89f5-b05d97077f74 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:41.105233 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd3c693-5cd0-45e2-bc27-1fdd6f38d0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:41.105870 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd3c693-5cd0-45e2-bc27-1fdd6f38d0f3 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:41.106147 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd3c693-5cd0-45e2-bc27-1fdd6f38d0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:41.106417 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd3c693-5cd0-45e2-bc27-1fdd6f38d0f3 None admin] PATH_INFO: `/v3/services` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:41.107198 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd3c693-5cd0-45e2-bc27-1fdd6f38d0f3 None admin] RBAC: Adding query filter params (type=network) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:41.107512 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd3c693-5cd0-45e2-bc27-1fdd6f38d0f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:41.108876 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd3c693-5cd0-45e2-bc27-1fdd6f38d0f3 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:41.119498 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 417/825] 10.222.0.26 () {56 vars in 1112 bytes} [Mon Sep 19 14:42:40 2022] GET /identity/v3/services?type=network => generated 350 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:41.120587 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd3c693-5cd0-45e2-bc27-1fdd6f38d0f3 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:41.141685 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5eba0a-7287-4b28-8261-f2e1383bc062 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:41.172624 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:41.186671 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09046010-f37e-4ad8-b8ef-b876b4ec50e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:41.187296 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09046010-f37e-4ad8-b8ef-b876b4ec50e0 None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:41.187564 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09046010-f37e-4ad8-b8ef-b876b4ec50e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:41.188215 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09046010-f37e-4ad8-b8ef-b876b4ec50e0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:41.189044 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09046010-f37e-4ad8-b8ef-b876b4ec50e0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:41.190820 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09046010-f37e-4ad8-b8ef-b876b4ec50e0 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:41.221141 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 409/826] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 14:42:41 2022] POST /identity/v3/endpoints => generated 346 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:42:41.222329 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09046010-f37e-4ad8-b8ef-b876b4ec50e0 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:41.240245 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:41.266195 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd3c693-5cd0-45e2-bc27-1fdd6f38d0f3 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:41.343915 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed05d91b-7796-41e3-b1f4-fc2ef9753878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:41.346308 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed05d91b-7796-41e3-b1f4-fc2ef9753878 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:41.347038 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed05d91b-7796-41e3-b1f4-fc2ef9753878 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:41.348188 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed05d91b-7796-41e3-b1f4-fc2ef9753878 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:41.372567 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed05d91b-7796-41e3-b1f4-fc2ef9753878 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:41.374637 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed05d91b-7796-41e3-b1f4-fc2ef9753878 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:41.404885 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-ed05d91b-7796-41e3-b1f4-fc2ef9753878 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:41.404885 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:41.404885 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:41.404885 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:41.404885 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:41.404885 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:41.404885 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:41.404885 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:41.404885 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:41.404885 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:41.404885 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:41.404885 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:41.404885 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:42:41.404885 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:42:41.404885 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:42:41.404885 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:42:41.406114 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:41.406114 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:41.406114 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:41.406114 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:41.406114 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:41.406114 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:41.406114 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:41.406114 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:41.406114 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:41.406114 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:41.406114 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:41.406114 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:41.406114 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:41.406114 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:41.406114 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:41.406114 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:41.406114 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:42:41.407169 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:42:41.407169 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:41.407169 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:41.412247 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 418/827] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:42:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:41.415990 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed05d91b-7796-41e3-b1f4-fc2ef9753878 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:41.459872 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09046010-f37e-4ad8-b8ef-b876b4ec50e0 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:41.506193 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbcabec-ca07-45e6-9cfc-78c2ea69d8eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:41.507236 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbcabec-ca07-45e6-9cfc-78c2ea69d8eb None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:41.507690 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbcabec-ca07-45e6-9cfc-78c2ea69d8eb None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:41.508243 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbcabec-ca07-45e6-9cfc-78c2ea69d8eb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:41.509117 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbcabec-ca07-45e6-9cfc-78c2ea69d8eb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:41.511235 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbcabec-ca07-45e6-9cfc-78c2ea69d8eb None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:41.541359 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 410/828] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 14:42:41 2022] POST /identity/v3/endpoints => generated 337 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:42:41.558133 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed05d91b-7796-41e3-b1f4-fc2ef9753878 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:41.599620 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:41.605288 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b053a13d-31b0-4c0e-ba6b-a4154c51cfc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:41.606032 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b053a13d-31b0-4c0e-ba6b-a4154c51cfc7 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:41.606427 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b053a13d-31b0-4c0e-ba6b-a4154c51cfc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:41.607225 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b053a13d-31b0-4c0e-ba6b-a4154c51cfc7 None admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:41.608284 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b053a13d-31b0-4c0e-ba6b-a4154c51cfc7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:41.608959 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b053a13d-31b0-4c0e-ba6b-a4154c51cfc7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:41.610459 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b053a13d-31b0-4c0e-ba6b-a4154c51cfc7 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:41.625160 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 419/829] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 19 14:42:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:41.630969 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbcabec-ca07-45e6-9cfc-78c2ea69d8eb None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:41.674674 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:41.755271 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbcabec-ca07-45e6-9cfc-78c2ea69d8eb None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:41.808526 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9069cc0-01ea-4ef0-9aac-e4c1185d0c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:41.809524 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9069cc0-01ea-4ef0-9aac-e4c1185d0c6c None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:41.809945 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9069cc0-01ea-4ef0-9aac-e4c1185d0c6c None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:41.810354 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9069cc0-01ea-4ef0-9aac-e4c1185d0c6c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:41.820647 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9069cc0-01ea-4ef0-9aac-e4c1185d0c6c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:41.822515 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9069cc0-01ea-4ef0-9aac-e4c1185d0c6c None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:41.835929 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-e9069cc0-01ea-4ef0-9aac-e4c1185d0c6c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:42:41.835929 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:41.835929 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:41.835929 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:41.835929 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:41.835929 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:41.835929 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:41.835929 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:41.835929 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:41.835929 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:41.835929 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:41.835929 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:41.835929 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:42:41.835929 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:42:41.835929 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:42:41.837126 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:42:41.837126 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:41.837126 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:41.837126 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:41.837126 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:41.837126 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:41.837126 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:41.837126 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:41.837126 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:41.837126 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:41.837126 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:41.837126 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:41.837126 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:41.837126 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:41.837126 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:41.837126 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:41.837126 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:41.838350 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:42:41.838350 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:42:41.838350 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:42:41.838350 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:42:41.838350 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:42:41.838350 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:42:41.838350 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:42:41.838350 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:42:41.840595 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 411/830] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 19 14:42:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:41.846614 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b053a13d-31b0-4c0e-ba6b-a4154c51cfc7 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:41.922588 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25277e27-13bb-4f7d-aaba-f311d784b4cf None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:41.922868 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25277e27-13bb-4f7d-aaba-f311d784b4cf None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:41.923144 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25277e27-13bb-4f7d-aaba-f311d784b4cf None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:41.924670 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 412/831] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:42:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:42:41.930018 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e878480-cbd6-4bbd-b3f1-81a4f4345728 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:41.930530 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e878480-cbd6-4bbd-b3f1-81a4f4345728 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:41.931012 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e878480-cbd6-4bbd-b3f1-81a4f4345728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:41.952819 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-6e878480-cbd6-4bbd-b3f1-81a4f4345728 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:42:41.954406 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-6e878480-cbd6-4bbd-b3f1-81a4f4345728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:42:41.985660 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b053a13d-31b0-4c0e-ba6b-a4154c51cfc7 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:42.037294 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50958827-b06b-4083-9342-968a19863bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:42.038653 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50958827-b06b-4083-9342-968a19863bb2 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:42.038923 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50958827-b06b-4083-9342-968a19863bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:42.039186 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50958827-b06b-4083-9342-968a19863bb2 None admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:42.039884 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50958827-b06b-4083-9342-968a19863bb2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:42.040184 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50958827-b06b-4083-9342-968a19863bb2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:42.042436 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50958827-b06b-4083-9342-968a19863bb2 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:42.056633 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 420/832] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 19 14:42:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:42:42.060957 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 413/833] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:42:41 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 14:42:42.063358 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50958827-b06b-4083-9342-968a19863bb2 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:42.121885 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:42.180573 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50958827-b06b-4083-9342-968a19863bb2 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:42.215840 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c392112-c377-470d-a374-b4ffb33c638a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:42.217196 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c392112-c377-470d-a374-b4ffb33c638a None admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:42.217671 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c392112-c377-470d-a374-b4ffb33c638a None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:42.218117 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c392112-c377-470d-a374-b4ffb33c638a None admin] PATH_INFO: `/v3/projects/9ede5dc59ece4d9282867a99e94c4c41/users/2c2b1ac1a17c43d28da8f7e9a199dea4/roles/3d5d4018951045e18e7577ee742c10ca` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:42.234182 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c392112-c377-470d-a374-b4ffb33c638a None admin] RBAC: Authorizing `identity:create_grant(project_id=9ede5dc59ece4d9282867a99e94c4c41, user_id=2c2b1ac1a17c43d28da8f7e9a199dea4, role_id=3d5d4018951045e18e7577ee742c10ca)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:42.235907 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c392112-c377-470d-a374-b4ffb33c638a None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:42.255627 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 421/834] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Sep 19 14:42:42 2022] PUT /identity/v3/projects/9ede5dc59ece4d9282867a99e94c4c41/users/2c2b1ac1a17c43d28da8f7e9a199dea4/roles/3d5d4018951045e18e7577ee742c10ca => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:42:42.338196 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e878480-cbd6-4bbd-b3f1-81a4f4345728 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:42.369723 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:42.452971 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e878480-cbd6-4bbd-b3f1-81a4f4345728 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:42.492706 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f8c30b-1809-44d9-8d7c-f9c48463b30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:42.493805 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f8c30b-1809-44d9-8d7c-f9c48463b30e None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:42.494390 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f8c30b-1809-44d9-8d7c-f9c48463b30e None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:42.494960 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f8c30b-1809-44d9-8d7c-f9c48463b30e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:42.495790 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f8c30b-1809-44d9-8d7c-f9c48463b30e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:42.497570 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f8c30b-1809-44d9-8d7c-f9c48463b30e None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:42.507922 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-84f8c30b-1809-44d9-8d7c-f9c48463b30e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 19 14:42:42.507922 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:42.507922 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 14:42:42.507922 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 14:42:42.507922 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 14:42:42.507922 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 14:42:42.507922 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 14:42:42.507922 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:42:42.507922 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 19 14:42:42.507922 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:42:42.507922 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 14:42:42.507922 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:42:42.507922 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:42.507922 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:42.507922 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:42.507922 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:42.508980 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:42.508980 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:42.508980 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:42.508980 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:42.508980 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:42.508980 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:42.508980 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:42.508980 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 14:42:42.508980 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 14:42:42.508980 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 14:42:42.508980 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 14:42:42.508980 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:42.508980 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:42.508980 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:42.508980 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:42.508980 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:42.508980 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:42.510030 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:42.510030 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:42.510030 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:42.510030 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:42.510030 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:42.510030 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:42.510030 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:42.510030 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:42.510030 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:42.510030 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:42.510030 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 14:42:42.510030 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:42:42.510030 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 19 14:42:42.510030 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:42:42.517274 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 414/835] 10.222.0.26 () {56 vars in 1132 bytes} [Mon Sep 19 14:42:42 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:42.519652 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c392112-c377-470d-a374-b4ffb33c638a None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:42.619748 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619807ca-274c-41f6-b0f8-b6a73c7bf362 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:42.619973 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619807ca-274c-41f6-b0f8-b6a73c7bf362 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:42.620252 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619807ca-274c-41f6-b0f8-b6a73c7bf362 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:42.621949 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 415/836] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:42:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 14:42:42.627934 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca84580-84cc-47e4-9e0e-d197513d60f6 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:42.628243 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca84580-84cc-47e4-9e0e-d197513d60f6 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:42.628516 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca84580-84cc-47e4-9e0e-d197513d60f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:42.632356 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c392112-c377-470d-a374-b4ffb33c638a None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:42.634250 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:42.651571 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-1ca84580-84cc-47e4-9e0e-d197513d60f6 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:42:42.653611 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-1ca84580-84cc-47e4-9e0e-d197513d60f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:42:42.686692 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677fa138-80d6-4a31-ad45-1284a2992489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:42.687307 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677fa138-80d6-4a31-ad45-1284a2992489 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:42.687585 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677fa138-80d6-4a31-ad45-1284a2992489 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:42.688111 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677fa138-80d6-4a31-ad45-1284a2992489 None admin] PATH_INFO: `/v3/services` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:42.688751 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677fa138-80d6-4a31-ad45-1284a2992489 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:42.689083 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677fa138-80d6-4a31-ad45-1284a2992489 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:42.691202 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677fa138-80d6-4a31-ad45-1284a2992489 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:42.697678 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 422/837] 10.222.0.26 () {56 vars in 1126 bytes} [Mon Sep 19 14:42:42 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:42.704325 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677fa138-80d6-4a31-ad45-1284a2992489 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:42.741925 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 416/838] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:42:42 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 14:42:42.815242 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677fa138-80d6-4a31-ad45-1284a2992489 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:42.850146 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce4aded-d24d-4e41-ac52-bb4b7f6e4b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:42.850754 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce4aded-d24d-4e41-ac52-bb4b7f6e4b43 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:42.851030 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce4aded-d24d-4e41-ac52-bb4b7f6e4b43 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:42.851297 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce4aded-d24d-4e41-ac52-bb4b7f6e4b43 None admin] PATH_INFO: `/v3/services` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:42.851925 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce4aded-d24d-4e41-ac52-bb4b7f6e4b43 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:42.852226 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce4aded-d24d-4e41-ac52-bb4b7f6e4b43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:42.854016 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce4aded-d24d-4e41-ac52-bb4b7f6e4b43 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:42.859345 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 423/839] 10.222.0.26 () {56 vars in 1126 bytes} [Mon Sep 19 14:42:42 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:43.030197 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca84580-84cc-47e4-9e0e-d197513d60f6 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:43.055413 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:43.138840 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca84580-84cc-47e4-9e0e-d197513d60f6 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:43.173852 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e42dc-ce8d-464c-bbaf-a12c42d0fe60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:43.174605 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e42dc-ce8d-464c-bbaf-a12c42d0fe60 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:43.174895 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e42dc-ce8d-464c-bbaf-a12c42d0fe60 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:43.175160 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e42dc-ce8d-464c-bbaf-a12c42d0fe60 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:43.188086 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414e42dc-ce8d-464c-bbaf-a12c42d0fe60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:42:43.193718 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-414e42dc-ce8d-464c-bbaf-a12c42d0fe60 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:42:43.193718 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:43.193718 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:43.193718 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:43.193718 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:43.193718 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:43.193718 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:43.193718 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:43.193718 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:43.193718 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:43.193718 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:43.193718 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:43.193718 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:42:43.193718 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:42:43.193718 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:42:43.193718 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:42:43.195071 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:42:43.195071 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:42:43.195071 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:42:43.195071 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:42:43.195071 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:43.195071 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:43.195071 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:43.195071 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:43.195071 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:43.195071 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:43.195071 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:43.195071 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:43.195071 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:43.195071 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:43.195071 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:43.195071 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:43.196455 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:43.196455 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:43.196455 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:43.196455 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:43.196455 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:42:43.196455 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:42:43.196455 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:42:43.196455 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:42:43.196455 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:42:43.196455 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:42:43.196455 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:42:43.196455 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:42:43.196455 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 417/840] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 19 14:42:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:43.204926 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce4aded-d24d-4e41-ac52-bb4b7f6e4b43 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:43.238066 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:43.319049 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce4aded-d24d-4e41-ac52-bb4b7f6e4b43 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:43.355717 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6155f699-5934-4229-a844-a35fad8165f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:43.356341 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155f699-5934-4229-a844-a35fad8165f2 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:43.356622 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155f699-5934-4229-a844-a35fad8165f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:43.356887 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155f699-5934-4229-a844-a35fad8165f2 None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:43.357658 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6155f699-5934-4229-a844-a35fad8165f2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:43.357952 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6155f699-5934-4229-a844-a35fad8165f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:43.359368 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6155f699-5934-4229-a844-a35fad8165f2 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:43.368448 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 424/841] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 19 14:42:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:43.375446 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e42dc-ce8d-464c-bbaf-a12c42d0fe60 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:43.462428 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:43.484245 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e42dc-ce8d-464c-bbaf-a12c42d0fe60 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:43.522297 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfa9d13-8713-4b53-aafc-67f1d633791c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:43.522945 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa9d13-8713-4b53-aafc-67f1d633791c None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:43.523225 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa9d13-8713-4b53-aafc-67f1d633791c None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:43.523530 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa9d13-8713-4b53-aafc-67f1d633791c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:43.534930 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfa9d13-8713-4b53-aafc-67f1d633791c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:43.536411 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfa9d13-8713-4b53-aafc-67f1d633791c None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:43.679729 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-8bfa9d13-8713-4b53-aafc-67f1d633791c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:43.679729 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:43.679729 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:43.679729 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:43.679729 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:43.679729 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:43.679729 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:43.679729 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:43.679729 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:43.679729 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:43.679729 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:43.679729 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:43.679729 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:42:43.679729 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:42:43.679729 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:42:43.679729 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:42:43.681202 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:43.681202 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:43.681202 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:43.681202 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:43.681202 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:43.681202 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:43.681202 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:43.681202 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:43.681202 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:43.681202 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:43.681202 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:43.681202 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:43.681202 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:43.681202 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:43.681202 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:43.681202 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:43.681202 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:42:43.682135 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:42:43.682135 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:43.682135 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:42:43.685286 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 418/842] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:42:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:43.687830 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6155f699-5934-4229-a844-a35fad8165f2 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:43.784789 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:43.799560 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6155f699-5934-4229-a844-a35fad8165f2 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:43.838282 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c6d3dc-013d-496f-9a73-f819495f7d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:43.838944 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c6d3dc-013d-496f-9a73-f819495f7d29 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:43.839222 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c6d3dc-013d-496f-9a73-f819495f7d29 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:43.839489 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c6d3dc-013d-496f-9a73-f819495f7d29 None admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:43.840132 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c6d3dc-013d-496f-9a73-f819495f7d29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:43.840430 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c6d3dc-013d-496f-9a73-f819495f7d29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:43.842218 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c6d3dc-013d-496f-9a73-f819495f7d29 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:43.855087 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 425/843] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 19 14:42:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:43.860493 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfa9d13-8713-4b53-aafc-67f1d633791c None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:43.923577 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cda237-a7d1-409c-b455-d722c89b37cb None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:43.924201 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cda237-a7d1-409c-b455-d722c89b37cb None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:43.924659 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cda237-a7d1-409c-b455-d722c89b37cb None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:43.926600 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 426/844] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:42:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 14:42:43.932075 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b11ba82-1199-4cb0-8596-70e6aa6cfa63 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:43.932596 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b11ba82-1199-4cb0-8596-70e6aa6cfa63 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:43.933102 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b11ba82-1199-4cb0-8596-70e6aa6cfa63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:43.952006 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-0b11ba82-1199-4cb0-8596-70e6aa6cfa63 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:42:43.953578 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-0b11ba82-1199-4cb0-8596-70e6aa6cfa63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:42:43.981511 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfa9d13-8713-4b53-aafc-67f1d633791c None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:44.026104 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:44.032405 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ef8fdf-10e9-45ae-9374-09f398f5d725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:44.033170 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef8fdf-10e9-45ae-9374-09f398f5d725 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:44.033452 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef8fdf-10e9-45ae-9374-09f398f5d725 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:44.033724 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef8fdf-10e9-45ae-9374-09f398f5d725 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:44.043700 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ef8fdf-10e9-45ae-9374-09f398f5d725 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:44.045543 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ef8fdf-10e9-45ae-9374-09f398f5d725 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:44.046487 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 427/845] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:42:43 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 14:42:44.062559 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-74ef8fdf-10e9-45ae-9374-09f398f5d725 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 19 14:42:44.062559 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:44.062559 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:44.062559 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:44.062559 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:44.062559 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:44.062559 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:44.062559 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:44.062559 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:44.062559 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:44.062559 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:44.062559 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:44.062559 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:42:44.062559 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:42:44.062559 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:42:44.062559 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:42:44.063514 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:44.063514 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:44.063514 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:42:44.063514 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:42:44.063514 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:42:44.063514 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:42:44.063514 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:44.063514 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:44.063514 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:44.063514 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:44.063514 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:44.063514 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:44.063514 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:44.063514 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:44.063514 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:44.063514 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:44.063514 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:44.063514 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:44.064723 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:44.064723 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:44.064723 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:42:44.064723 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:42:44.064723 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:42:44.064723 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:42:44.064723 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:42:44.064723 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:42:44.064723 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 19 14:42:44.064723 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:42:44.064723 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 419/846] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 19 14:42:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:44.071561 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b11ba82-1199-4cb0-8596-70e6aa6cfa63 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:44.157769 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:44.177134 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b11ba82-1199-4cb0-8596-70e6aa6cfa63 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:44.212388 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5842cad-c2b6-4275-9ee0-04ee22cbe155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:44.213605 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5842cad-c2b6-4275-9ee0-04ee22cbe155 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:44.213891 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5842cad-c2b6-4275-9ee0-04ee22cbe155 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:44.214161 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5842cad-c2b6-4275-9ee0-04ee22cbe155 None admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:44.214899 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5842cad-c2b6-4275-9ee0-04ee22cbe155 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:44.215204 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5842cad-c2b6-4275-9ee0-04ee22cbe155 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:44.216976 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5842cad-c2b6-4275-9ee0-04ee22cbe155 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:44.240097 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 428/847] 10.222.0.26 () {56 vars in 1135 bytes} [Mon Sep 19 14:42:44 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:44.242074 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ef8fdf-10e9-45ae-9374-09f398f5d725 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:44.316731 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5842cad-c2b6-4275-9ee0-04ee22cbe155 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:44.365178 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ef8fdf-10e9-45ae-9374-09f398f5d725 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:44.417675 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7787f1f6-3ff2-4ca2-a1ab-da2dc4622877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:44.418479 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7787f1f6-3ff2-4ca2-a1ab-da2dc4622877 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:44.418935 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7787f1f6-3ff2-4ca2-a1ab-da2dc4622877 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:44.419302 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7787f1f6-3ff2-4ca2-a1ab-da2dc4622877 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:44.439079 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5842cad-c2b6-4275-9ee0-04ee22cbe155 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:44.476564 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cd71a3-e005-4708-87d3-7edfcf6b953c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:44.477157 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd71a3-e005-4708-87d3-7edfcf6b953c None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:44.477433 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd71a3-e005-4708-87d3-7edfcf6b953c None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:44.477704 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd71a3-e005-4708-87d3-7edfcf6b953c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:44.478327 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cd71a3-e005-4708-87d3-7edfcf6b953c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:44.480324 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cd71a3-e005-4708-87d3-7edfcf6b953c None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:44.486721 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:44.489963 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-10cd71a3-e005-4708-87d3-7edfcf6b953c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 19 14:42:44.489963 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:44.489963 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 14:42:44.489963 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 14:42:44.489963 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 14:42:44.489963 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 14:42:44.489963 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 14:42:44.489963 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:42:44.489963 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 19 14:42:44.489963 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:44.489963 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 14:42:44.489963 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:44.489963 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:44.489963 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:44.489963 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:44.489963 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:44.489963 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:44.490974 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:44.490974 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:44.490974 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:44.490974 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:44.490974 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:44.490974 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:44.490974 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 14:42:44.490974 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 14:42:44.490974 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 14:42:44.490974 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 14:42:44.490974 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:44.490974 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:44.490974 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:44.490974 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:44.490974 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:44.490974 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:44.491801 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:44.491801 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:44.491801 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:44.491801 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:44.491801 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:44.491801 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:44.491801 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:44.491801 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:44.491801 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:44.491801 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:44.491801 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 14:42:44.491801 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:42:44.491801 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 19 14:42:44.491801 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:44.497199 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 429/848] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Sep 19 14:42:44 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:42:44.498094 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cd71a3-e005-4708-87d3-7edfcf6b953c None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:44.501845 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:44.503970 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7787f1f6-3ff2-4ca2-a1ab-da2dc4622877 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:44.505821 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7787f1f6-3ff2-4ca2-a1ab-da2dc4622877 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:44.607918 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cd71a3-e005-4708-87d3-7edfcf6b953c None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:44.614542 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 420/849] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 19 14:42:44 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 14:42:44.615846 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fbf027-2411-4a71-8eb1-fbf12045f647 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:44.616133 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fbf027-2411-4a71-8eb1-fbf12045f647 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:44.616403 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fbf027-2411-4a71-8eb1-fbf12045f647 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:44.617828 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 421/850] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:42:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:42:44.620303 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fbf027-2411-4a71-8eb1-fbf12045f647 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:44.649568 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7122edb-e61a-4185-98cd-d1ff97569b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:44.650270 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7122edb-e61a-4185-98cd-d1ff97569b6d None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:44.650589 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7122edb-e61a-4185-98cd-d1ff97569b6d None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:44.650943 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7122edb-e61a-4185-98cd-d1ff97569b6d None admin] PATH_INFO: `/v3/services` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:44.651804 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7122edb-e61a-4185-98cd-d1ff97569b6d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:44.652173 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7122edb-e61a-4185-98cd-d1ff97569b6d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:44.653595 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7122edb-e61a-4185-98cd-d1ff97569b6d None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:44.659626 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 430/851] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Sep 19 14:42:44 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:44.665389 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a22b13-7b79-4e73-85de-1144bb52a643 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:44.665683 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a22b13-7b79-4e73-85de-1144bb52a643 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:44.666095 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a22b13-7b79-4e73-85de-1144bb52a643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:44.687595 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-d6a22b13-7b79-4e73-85de-1144bb52a643 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:42:44.689079 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-d6a22b13-7b79-4e73-85de-1144bb52a643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:42:44.722554 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:44.733869 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fbf027-2411-4a71-8eb1-fbf12045f647 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:44.758984 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:44.766444 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 431/852] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:42:44 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:42:44.767280 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a22b13-7b79-4e73-85de-1144bb52a643 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:44.779362 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e609ae-28fd-4f5f-aea7-4bf4f1bd4ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:44.780281 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e609ae-28fd-4f5f-aea7-4bf4f1bd4ae0 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:44.780803 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e609ae-28fd-4f5f-aea7-4bf4f1bd4ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:44.781368 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e609ae-28fd-4f5f-aea7-4bf4f1bd4ae0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:44.793511 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e609ae-28fd-4f5f-aea7-4bf4f1bd4ae0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:44.795414 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e609ae-28fd-4f5f-aea7-4bf4f1bd4ae0 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:44.813687 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-62e609ae-28fd-4f5f-aea7-4bf4f1bd4ae0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:44.813687 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:44.813687 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:44.813687 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:44.813687 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:44.813687 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:44.813687 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:44.813687 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:44.813687 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:44.813687 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:44.813687 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:44.813687 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:44.813687 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:42:44.813687 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:42:44.813687 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:42:44.813687 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:42:44.814824 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:44.814824 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:44.814824 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:44.814824 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:44.814824 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:44.814824 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:44.814824 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:44.814824 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:44.814824 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:44.814824 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:44.814824 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:44.814824 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:44.814824 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:44.814824 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:44.814824 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:44.814824 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:44.814824 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:42:44.815694 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:42:44.815694 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:44.815694 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:42:44.817434 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 422/853] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:42:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:42:44.824295 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e609ae-28fd-4f5f-aea7-4bf4f1bd4ae0 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:44.891327 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a22b13-7b79-4e73-85de-1144bb52a643 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:44.930139 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b51ab8-cd34-47aa-90c7-8f3c5bfd913e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:44.930781 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b51ab8-cd34-47aa-90c7-8f3c5bfd913e None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:44.931060 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b51ab8-cd34-47aa-90c7-8f3c5bfd913e None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:44.931361 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b51ab8-cd34-47aa-90c7-8f3c5bfd913e None admin] PATH_INFO: `/v3/services` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:44.932040 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b51ab8-cd34-47aa-90c7-8f3c5bfd913e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:44.932291 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b51ab8-cd34-47aa-90c7-8f3c5bfd913e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:44.933937 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b51ab8-cd34-47aa-90c7-8f3c5bfd913e None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:44.941034 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 432/854] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Sep 19 14:42:44 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:44.959187 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e609ae-28fd-4f5f-aea7-4bf4f1bd4ae0 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:45.012279 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f92a3e1-3c3f-43c3-86b2-f9acac5d420e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:45.013213 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f92a3e1-3c3f-43c3-86b2-f9acac5d420e None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:45.013651 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f92a3e1-3c3f-43c3-86b2-f9acac5d420e None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:45.014058 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f92a3e1-3c3f-43c3-86b2-f9acac5d420e None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:45.014858 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f92a3e1-3c3f-43c3-86b2-f9acac5d420e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:45.015296 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f92a3e1-3c3f-43c3-86b2-f9acac5d420e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:45.016824 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f92a3e1-3c3f-43c3-86b2-f9acac5d420e None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:45.031483 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 423/855] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 19 14:42:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:45.040232 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b51ab8-cd34-47aa-90c7-8f3c5bfd913e None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:45.082509 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f92a3e1-3c3f-43c3-86b2-f9acac5d420e None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:45.086701 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:45.118526 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:45.170707 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b51ab8-cd34-47aa-90c7-8f3c5bfd913e None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:45.203693 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f92a3e1-3c3f-43c3-86b2-f9acac5d420e None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:45.214870 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd25be4-6334-4f19-bc57-3007c49c3150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:45.215732 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd25be4-6334-4f19-bc57-3007c49c3150 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:45.215858 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd25be4-6334-4f19-bc57-3007c49c3150 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:45.216023 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd25be4-6334-4f19-bc57-3007c49c3150 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:45.223280 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd25be4-6334-4f19-bc57-3007c49c3150 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:45.224722 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd25be4-6334-4f19-bc57-3007c49c3150 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:45.237023 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-9cd25be4-6334-4f19-bc57-3007c49c3150 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:42:45.237023 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:45.237023 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:45.237023 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:45.237023 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:45.237023 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:45.237023 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:45.237023 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:45.237023 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:45.237023 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:45.237023 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:45.237023 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:45.237023 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:42:45.237023 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:42:45.237023 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:42:45.237931 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:42:45.237931 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:45.237931 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:45.237931 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:45.237931 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:45.237931 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:45.237931 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:45.237931 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:45.237931 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:45.237931 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:45.237931 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:45.237931 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:45.237931 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:45.237931 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:45.237931 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:45.237931 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:45.237931 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:45.238833 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:42:45.238833 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:42:45.238833 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:42:45.238833 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:42:45.238833 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:42:45.238833 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:42:45.238833 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:42:45.238833 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:45.238833 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 433/856] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 19 14:42:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:45.242270 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9e7444-7295-4e51-bbe2-53584c079d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:45.242666 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d4a6b-83ba-445d-b2e0-81f693d7d200 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:45.242992 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e7444-7295-4e51-bbe2-53584c079d67 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:45.243278 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e7444-7295-4e51-bbe2-53584c079d67 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:45.243407 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d4a6b-83ba-445d-b2e0-81f693d7d200 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:45.243605 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e7444-7295-4e51-bbe2-53584c079d67 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:45.243705 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d4a6b-83ba-445d-b2e0-81f693d7d200 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:45.245346 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 434/857] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:42:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:42:45.249901 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2d4a6b-83ba-445d-b2e0-81f693d7d200 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:45.255642 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9e7444-7295-4e51-bbe2-53584c079d67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:42:45.260793 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-ef9e7444-7295-4e51-bbe2-53584c079d67 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:42:45.260793 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:45.260793 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:45.260793 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:45.260793 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:45.260793 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:45.260793 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:45.260793 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:45.260793 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:45.260793 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:45.260793 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:45.260793 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:45.260793 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:42:45.260793 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:42:45.260793 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:42:45.260793 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:42:45.261757 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:42:45.261757 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:42:45.261757 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:42:45.261757 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:42:45.261757 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:45.261757 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:45.261757 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:45.261757 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:45.261757 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:45.261757 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:45.261757 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:45.261757 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:45.261757 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:45.261757 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:45.261757 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:45.261757 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:45.267932 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:45.267932 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:45.267932 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:45.267932 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:45.267932 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:42:45.267932 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:42:45.267932 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:42:45.267932 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:42:45.267932 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:42:45.267932 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:42:45.267932 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:42:45.267932 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:42:45.267932 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 424/858] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Sep 19 14:42:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:42:45.267932 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04880e7-05b6-41e9-8a22-ee16364fb219 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:45.268722 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04880e7-05b6-41e9-8a22-ee16364fb219 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:45.268722 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04880e7-05b6-41e9-8a22-ee16364fb219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:45.284979 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-c04880e7-05b6-41e9-8a22-ee16364fb219 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:42:45.286202 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-c04880e7-05b6-41e9-8a22-ee16364fb219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:42:45.352004 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:45.361144 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2d4a6b-83ba-445d-b2e0-81f693d7d200 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:45.361905 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 425/859] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:42:45 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:42:45.370486 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04880e7-05b6-41e9-8a22-ee16364fb219 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:45.387636 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:45.402114 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00f4b4c-104d-4e3b-971e-f81cf8e33e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:45.402735 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00f4b4c-104d-4e3b-971e-f81cf8e33e60 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:45.403074 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00f4b4c-104d-4e3b-971e-f81cf8e33e60 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:45.403346 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00f4b4c-104d-4e3b-971e-f81cf8e33e60 None admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:45.404121 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00f4b4c-104d-4e3b-971e-f81cf8e33e60 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:45.404400 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00f4b4c-104d-4e3b-971e-f81cf8e33e60 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:45.405880 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00f4b4c-104d-4e3b-971e-f81cf8e33e60 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:45.424461 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 435/860] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 19 14:42:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:45.425387 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00f4b4c-104d-4e3b-971e-f81cf8e33e60 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:45.507203 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04880e7-05b6-41e9-8a22-ee16364fb219 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:45.529984 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00f4b4c-104d-4e3b-971e-f81cf8e33e60 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:45.552024 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2261d182-7ada-4d8f-ac66-dbb52f622ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:45.553256 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2261d182-7ada-4d8f-ac66-dbb52f622ce3 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:45.554131 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2261d182-7ada-4d8f-ac66-dbb52f622ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:45.554857 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2261d182-7ada-4d8f-ac66-dbb52f622ce3 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:45.555958 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2261d182-7ada-4d8f-ac66-dbb52f622ce3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:45.557186 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2261d182-7ada-4d8f-ac66-dbb52f622ce3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:45.559284 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2261d182-7ada-4d8f-ac66-dbb52f622ce3 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:45.565098 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4891a1a2-2235-4f1c-bbf8-f956f79af632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:45.565706 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4891a1a2-2235-4f1c-bbf8-f956f79af632 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:45.565983 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4891a1a2-2235-4f1c-bbf8-f956f79af632 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:45.566259 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4891a1a2-2235-4f1c-bbf8-f956f79af632 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:45.567528 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4891a1a2-2235-4f1c-bbf8-f956f79af632 None admin] RBAC: Adding query filter params (role.id=019bde1756cb40de8ce06cef6b261f79, scope.project.id=9ede5dc59ece4d9282867a99e94c4c41, user.id=76cb60a5e90343e69a38db4356cb3a90) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:45.567848 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4891a1a2-2235-4f1c-bbf8-f956f79af632 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:45.569601 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4891a1a2-2235-4f1c-bbf8-f956f79af632 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:45.571383 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 426/861] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Sep 19 14:42:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:45.577224 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2261d182-7ada-4d8f-ac66-dbb52f622ce3 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:45.581092 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 436/862] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 19 14:42:45 2022] GET /identity/v3/role_assignments?user.id=76cb60a5e90343e69a38db4356cb3a90&scope.project.id=9ede5dc59ece4d9282867a99e94c4c41&role.id=019bde1756cb40de8ce06cef6b261f79 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:45.629793 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4891a1a2-2235-4f1c-bbf8-f956f79af632 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:45.649250 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:45.689840 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:45.717147 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2261d182-7ada-4d8f-ac66-dbb52f622ce3 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:45.762870 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4891a1a2-2235-4f1c-bbf8-f956f79af632 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:45.763922 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb89447f-4f12-4e39-b5cf-22750ae33b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:45.764575 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb89447f-4f12-4e39-b5cf-22750ae33b97 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:45.764852 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb89447f-4f12-4e39-b5cf-22750ae33b97 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:45.765221 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb89447f-4f12-4e39-b5cf-22750ae33b97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:45.777043 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb89447f-4f12-4e39-b5cf-22750ae33b97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:45.778617 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb89447f-4f12-4e39-b5cf-22750ae33b97 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:45.799195 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-eb89447f-4f12-4e39-b5cf-22750ae33b97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:45.799195 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:45.799195 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:45.799195 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:45.799195 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:45.799195 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:45.799195 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:45.799195 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:45.799195 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:45.799195 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:45.799195 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:45.799195 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:45.799195 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:42:45.799195 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:42:45.799195 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:42:45.799195 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:42:45.800182 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:45.800182 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:45.800182 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:45.800182 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:45.800182 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:45.800182 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:45.800182 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:45.800182 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:45.800182 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:45.800182 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:45.800182 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:45.800182 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:45.800182 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:45.800182 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:45.800182 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:45.800182 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:45.800182 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:42:45.801128 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:42:45.801128 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:45.801128 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:42:45.801128 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 427/863] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:42:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:42:45.806345 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb89447f-4f12-4e39-b5cf-22750ae33b97 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:45.810761 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01104085-2571-4680-80e7-bbd5e4b1de58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:45.811512 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01104085-2571-4680-80e7-bbd5e4b1de58 None admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:45.811790 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01104085-2571-4680-80e7-bbd5e4b1de58 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:45.812060 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01104085-2571-4680-80e7-bbd5e4b1de58 None admin] PATH_INFO: `/v3/services` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:45.812716 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01104085-2571-4680-80e7-bbd5e4b1de58 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:45.814179 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01104085-2571-4680-80e7-bbd5e4b1de58 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:45.833953 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 437/864] 10.222.0.26 () {60 vars in 1141 bytes} [Mon Sep 19 14:42:45 2022] POST /identity/v3/services => generated 269 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 14:42:45.939000 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb89447f-4f12-4e39-b5cf-22750ae33b97 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:45.950163 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:45.987772 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d386465-4c2b-4375-a96f-e93f2f0253cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:45.988482 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d386465-4c2b-4375-a96f-e93f2f0253cc None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:45.988764 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d386465-4c2b-4375-a96f-e93f2f0253cc None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:45.989061 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d386465-4c2b-4375-a96f-e93f2f0253cc None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:45.989779 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d386465-4c2b-4375-a96f-e93f2f0253cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:45.990087 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d386465-4c2b-4375-a96f-e93f2f0253cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:45.991534 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d386465-4c2b-4375-a96f-e93f2f0253cc None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:46.006757 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 428/865] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 19 14:42:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:42:46.012950 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01104085-2571-4680-80e7-bbd5e4b1de58 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:46.128516 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01104085-2571-4680-80e7-bbd5e4b1de58 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:46.137174 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:46.168190 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803c5a25-482d-4681-90db-1b8b08dfda53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:46.168834 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803c5a25-482d-4681-90db-1b8b08dfda53 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:46.169140 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803c5a25-482d-4681-90db-1b8b08dfda53 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:46.169410 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803c5a25-482d-4681-90db-1b8b08dfda53 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:46.178597 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803c5a25-482d-4681-90db-1b8b08dfda53 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:46.180046 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803c5a25-482d-4681-90db-1b8b08dfda53 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:46.192622 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-803c5a25-482d-4681-90db-1b8b08dfda53 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 14:42:46.192622 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:46.192622 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:46.192622 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:46.192622 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:46.192622 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:46.192622 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:46.192622 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:46.192622 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:46.192622 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:46.192622 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:46.192622 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:46.192622 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:42:46.192622 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:42:46.192622 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:42:46.192622 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:42:46.193637 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:46.193637 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:46.193637 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:42:46.193637 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:42:46.193637 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:42:46.193637 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:42:46.193637 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:46.193637 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:46.193637 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:46.193637 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:46.193637 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:46.193637 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:46.193637 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:46.193637 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:46.193637 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:46.193637 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:46.193637 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:46.193637 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:46.195169 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:46.195169 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:46.195169 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:42:46.195169 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:42:46.195169 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:42:46.195169 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:42:46.195169 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:42:46.195169 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:42:46.195169 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 14:42:46.195169 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:46.195169 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 438/866] 10.222.0.26 () {56 vars in 1117 bytes} [Mon Sep 19 14:42:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:46.199553 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d386465-4c2b-4375-a96f-e93f2f0253cc None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:46.303112 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d386465-4c2b-4375-a96f-e93f2f0253cc None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:46.338928 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f75b12-0aeb-44d1-8f0f-0c7ab7ced1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:46.339540 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f75b12-0aeb-44d1-8f0f-0c7ab7ced1ff None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:46.339816 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f75b12-0aeb-44d1-8f0f-0c7ab7ced1ff None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:46.340085 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f75b12-0aeb-44d1-8f0f-0c7ab7ced1ff None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:46.340821 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f75b12-0aeb-44d1-8f0f-0c7ab7ced1ff None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:46.341151 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f75b12-0aeb-44d1-8f0f-0c7ab7ced1ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:46.342999 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f75b12-0aeb-44d1-8f0f-0c7ab7ced1ff None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:46.367707 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 429/867] 10.222.0.26 () {56 vars in 1149 bytes} [Mon Sep 19 14:42:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:46.367931 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803c5a25-482d-4681-90db-1b8b08dfda53 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:46.476119 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803c5a25-482d-4681-90db-1b8b08dfda53 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:46.512178 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47fe466-12c5-48ce-9da9-3940db84e08a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:46.512790 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47fe466-12c5-48ce-9da9-3940db84e08a None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:46.513096 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47fe466-12c5-48ce-9da9-3940db84e08a None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:46.513370 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47fe466-12c5-48ce-9da9-3940db84e08a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:46.548256 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:46.582826 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47fe466-12c5-48ce-9da9-3940db84e08a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:46.584213 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47fe466-12c5-48ce-9da9-3940db84e08a None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:46.690113 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 439/868] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 19 14:42:46 2022] GET /identity/v3/auth/tokens => generated 1271 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 14:42:46.695805 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f75b12-0aeb-44d1-8f0f-0c7ab7ced1ff None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:46.749382 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:46.811316 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f75b12-0aeb-44d1-8f0f-0c7ab7ced1ff None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:46.856099 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d377df8-e14e-4af5-b497-99f2bd9a2982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:46.857177 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d377df8-e14e-4af5-b497-99f2bd9a2982 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:46.857657 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d377df8-e14e-4af5-b497-99f2bd9a2982 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:46.858145 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d377df8-e14e-4af5-b497-99f2bd9a2982 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:46.870793 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d377df8-e14e-4af5-b497-99f2bd9a2982 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:46.872679 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d377df8-e14e-4af5-b497-99f2bd9a2982 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:46.890606 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-2d377df8-e14e-4af5-b497-99f2bd9a2982 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:46.890606 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:46.890606 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:46.890606 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:46.890606 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:46.890606 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:46.890606 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:46.890606 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:46.890606 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:46.890606 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:46.890606 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:46.890606 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:46.890606 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:42:46.890606 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:42:46.890606 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:42:46.890606 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:42:46.891606 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:46.891606 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:46.891606 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:46.891606 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:46.891606 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:46.891606 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:46.891606 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:46.891606 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:46.891606 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:46.891606 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:46.891606 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:46.891606 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:46.891606 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:46.891606 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:46.891606 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:46.891606 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:46.891606 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:42:46.892476 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:42:46.892476 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:46.892476 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:42:46.894686 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 430/869] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:42:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:46.902328 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47fe466-12c5-48ce-9da9-3940db84e08a None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:46.973658 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:47.010700 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47fe466-12c5-48ce-9da9-3940db84e08a None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:47.046768 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16f5431-840d-41a3-8287-426784850a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:47.047380 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16f5431-840d-41a3-8287-426784850a4e None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:47.047659 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16f5431-840d-41a3-8287-426784850a4e None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:47.047930 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16f5431-840d-41a3-8287-426784850a4e None admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:47.048573 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16f5431-840d-41a3-8287-426784850a4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:47.048875 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16f5431-840d-41a3-8287-426784850a4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:47.050280 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16f5431-840d-41a3-8287-426784850a4e None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:47.062852 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 440/870] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 19 14:42:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:47.068589 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d377df8-e14e-4af5-b497-99f2bd9a2982 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:47.156442 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:47.189566 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d377df8-e14e-4af5-b497-99f2bd9a2982 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:47.227115 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb45de2-1867-42f0-b36b-2cce89af5727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:47.227758 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb45de2-1867-42f0-b36b-2cce89af5727 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:47.228080 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb45de2-1867-42f0-b36b-2cce89af5727 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:47.228544 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb45de2-1867-42f0-b36b-2cce89af5727 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:47.236592 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb45de2-1867-42f0-b36b-2cce89af5727 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:47.238080 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb45de2-1867-42f0-b36b-2cce89af5727 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:47.250188 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-dfb45de2-1867-42f0-b36b-2cce89af5727 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:42:47.250188 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:47.250188 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:47.250188 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:47.250188 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:47.250188 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:47.250188 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:47.250188 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:47.250188 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:47.250188 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:47.250188 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:47.250188 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:47.250188 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:42:47.250188 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:42:47.250188 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:42:47.251093 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:42:47.251093 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:47.251093 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:47.251093 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:47.251093 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:47.251093 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:47.251093 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:47.251093 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:47.251093 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:47.251093 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:47.251093 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:47.251093 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:47.251093 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:47.251093 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:47.251093 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:47.251093 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:47.251093 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:47.251989 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:42:47.251989 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:42:47.251989 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:42:47.251989 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:42:47.251989 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:42:47.251989 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:42:47.251989 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:42:47.251989 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:42:47.251989 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 431/871] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 19 14:42:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:47.257257 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16f5431-840d-41a3-8287-426784850a4e None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:47.295072 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afccf99-06ba-445b-8423-54bd68f4a39e None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:47.295396 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afccf99-06ba-445b-8423-54bd68f4a39e None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:47.295626 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afccf99-06ba-445b-8423-54bd68f4a39e None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:47.297124 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 432/872] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:42:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 14:42:47.302612 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab01d9fe-a93f-4bf6-a131-6e8e8698d0c9 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:47.303142 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab01d9fe-a93f-4bf6-a131-6e8e8698d0c9 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:47.303615 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab01d9fe-a93f-4bf6-a131-6e8e8698d0c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:47.323772 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-ab01d9fe-a93f-4bf6-a131-6e8e8698d0c9 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:42:47.325370 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ab01d9fe-a93f-4bf6-a131-6e8e8698d0c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:42:47.362761 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16f5431-840d-41a3-8287-426784850a4e None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:47.389058 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:47.398226 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d3c1e0-daab-4be0-aca8-832df381490f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:47.398838 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3c1e0-daab-4be0-aca8-832df381490f None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:47.399115 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3c1e0-daab-4be0-aca8-832df381490f None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:47.399389 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3c1e0-daab-4be0-aca8-832df381490f None admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:47.400298 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d3c1e0-daab-4be0-aca8-832df381490f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:47.400614 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d3c1e0-daab-4be0-aca8-832df381490f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:47.402103 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d3c1e0-daab-4be0-aca8-832df381490f None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:47.410362 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 433/873] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:42:47 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 14:42:47.416590 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 441/874] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 19 14:42:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:47.422609 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab01d9fe-a93f-4bf6-a131-6e8e8698d0c9 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:47.493128 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:47.535741 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab01d9fe-a93f-4bf6-a131-6e8e8698d0c9 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:47.571941 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd8d5d1-6960-4231-8fbb-46ece694c44a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:47.573213 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd8d5d1-6960-4231-8fbb-46ece694c44a None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:47.573490 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd8d5d1-6960-4231-8fbb-46ece694c44a None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:47.573756 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd8d5d1-6960-4231-8fbb-46ece694c44a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:47.574491 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd8d5d1-6960-4231-8fbb-46ece694c44a None admin] RBAC: Adding query filter params (role.id=3d5d4018951045e18e7577ee742c10ca, scope.project.id=9ede5dc59ece4d9282867a99e94c4c41, user.id=2c2b1ac1a17c43d28da8f7e9a199dea4) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:47.574794 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd8d5d1-6960-4231-8fbb-46ece694c44a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:47.576231 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd8d5d1-6960-4231-8fbb-46ece694c44a None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:47.582713 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 434/875] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 19 14:42:47 2022] GET /identity/v3/role_assignments?user.id=2c2b1ac1a17c43d28da8f7e9a199dea4&scope.project.id=9ede5dc59ece4d9282867a99e94c4c41&role.id=3d5d4018951045e18e7577ee742c10ca => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:47.684086 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d3c1e0-daab-4be0-aca8-832df381490f None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:47.794938 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d3c1e0-daab-4be0-aca8-832df381490f None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:47.831801 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9028d704-2282-4e2e-9410-cd3bcedfa395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:47.832664 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9028d704-2282-4e2e-9410-cd3bcedfa395 None admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:47.833147 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9028d704-2282-4e2e-9410-cd3bcedfa395 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:47.833559 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9028d704-2282-4e2e-9410-cd3bcedfa395 None admin] PATH_INFO: `/v3/services` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:47.834356 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9028d704-2282-4e2e-9410-cd3bcedfa395 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:47.835862 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9028d704-2282-4e2e-9410-cd3bcedfa395 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:47.857544 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 442/876] 10.222.0.26 () {60 vars in 1141 bytes} [Mon Sep 19 14:42:47 2022] POST /identity/v3/services => generated 251 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:42:48.029512 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc41dc3b-ae39-46e2-b346-f091c8c9c942 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:48.030056 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc41dc3b-ae39-46e2-b346-f091c8c9c942 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:48.030268 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc41dc3b-ae39-46e2-b346-f091c8c9c942 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:48.032083 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 435/877] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:42:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:42:48.037998 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0338188-a8fd-4a5c-8844-0d46c960f919 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:48.038278 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0338188-a8fd-4a5c-8844-0d46c960f919 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:48.038552 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0338188-a8fd-4a5c-8844-0d46c960f919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:48.060631 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-b0338188-a8fd-4a5c-8844-0d46c960f919 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:42:48.061893 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-b0338188-a8fd-4a5c-8844-0d46c960f919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:42:48.113028 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:48.152189 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 443/878] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:42:48 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 14:42:48.182731 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69785652-b548-4088-8a4b-d17e59b66305 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:48.183020 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69785652-b548-4088-8a4b-d17e59b66305 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:48.183271 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69785652-b548-4088-8a4b-d17e59b66305 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:48.184745 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 436/879] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:42:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:42:48.190312 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a6dd6b-8407-430b-9f45-a179832428ab None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:48.190801 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a6dd6b-8407-430b-9f45-a179832428ab None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:48.191251 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a6dd6b-8407-430b-9f45-a179832428ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:48.210408 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-c9a6dd6b-8407-430b-9f45-a179832428ab None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:42:48.211906 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-c9a6dd6b-8407-430b-9f45-a179832428ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:42:48.286760 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 444/880] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:42:48 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:42:48.418240 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69785652-b548-4088-8a4b-d17e59b66305 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:48.532477 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69785652-b548-4088-8a4b-d17e59b66305 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:48.560026 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:48.568772 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8146d3-fcd2-46eb-b3ab-e327783deae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:48.570010 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8146d3-fcd2-46eb-b3ab-e327783deae2 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:48.570752 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8146d3-fcd2-46eb-b3ab-e327783deae2 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:48.571022 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8146d3-fcd2-46eb-b3ab-e327783deae2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:48.571622 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8146d3-fcd2-46eb-b3ab-e327783deae2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:48.573252 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8146d3-fcd2-46eb-b3ab-e327783deae2 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:48.577728 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a6dd6b-8407-430b-9f45-a179832428ab None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:48.592696 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-bc8146d3-fcd2-46eb-b3ab-e327783deae2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 14:42:48.592696 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:48.592696 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 14:42:48.592696 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 14:42:48.592696 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 14:42:48.592696 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 14:42:48.592696 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 14:42:48.592696 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:42:48.592696 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 14:42:48.592696 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:42:48.592696 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 14:42:48.592696 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:42:48.592696 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:48.592696 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:48.592696 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:48.592696 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:48.592696 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:48.593775 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:48.593775 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:48.593775 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:48.593775 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:48.593775 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:48.593775 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:48.593775 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 14:42:48.593775 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 14:42:48.593775 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 14:42:48.593775 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 14:42:48.593775 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:48.593775 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:48.593775 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:48.593775 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:48.593775 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:48.593775 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:48.594594 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:48.594594 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:48.594594 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:48.594594 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:48.594594 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:48.594594 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:48.594594 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:48.594594 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:48.594594 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:48.594594 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:48.594594 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 14:42:48.594594 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:42:48.594594 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 14:42:48.594594 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:42:48.595307 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 437/881] 10.222.0.26 () {56 vars in 1126 bytes} [Mon Sep 19 14:42:48 2022] GET /identity/v3/services/object-store => generated 93 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:48.600948 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8146d3-fcd2-46eb-b3ab-e327783deae2 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:48.698551 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a6dd6b-8407-430b-9f45-a179832428ab None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:48.700183 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:48.713735 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8146d3-fcd2-46eb-b3ab-e327783deae2 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:48.740320 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cafbd7-30ec-41b5-9490-7e36dcce9ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:48.741073 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cafbd7-30ec-41b5-9490-7e36dcce9ab4 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:48.741354 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cafbd7-30ec-41b5-9490-7e36dcce9ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:48.741625 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cafbd7-30ec-41b5-9490-7e36dcce9ab4 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:48.742307 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cafbd7-30ec-41b5-9490-7e36dcce9ab4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:48.743731 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cafbd7-30ec-41b5-9490-7e36dcce9ab4 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:48.750145 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667595fc-80d6-490d-9556-4f2e61547b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:48.750889 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667595fc-80d6-490d-9556-4f2e61547b19 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:48.751163 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667595fc-80d6-490d-9556-4f2e61547b19 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:48.751434 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667595fc-80d6-490d-9556-4f2e61547b19 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:48.752286 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667595fc-80d6-490d-9556-4f2e61547b19 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:48.752681 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667595fc-80d6-490d-9556-4f2e61547b19 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:48.753621 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-38cafbd7-30ec-41b5-9490-7e36dcce9ab4 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 19 14:42:48.753621 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:48.753621 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 14:42:48.753621 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 14:42:48.753621 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 14:42:48.753621 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 14:42:48.753621 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 14:42:48.753621 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:42:48.753621 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 19 14:42:48.753621 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:48.753621 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 14:42:48.753621 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:48.753621 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:48.753621 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:48.753621 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:48.753621 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:48.754519 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:48.754519 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:48.754519 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:48.754519 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:48.754519 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:48.754519 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:48.754519 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:48.754519 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 14:42:48.754519 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 14:42:48.754519 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 14:42:48.754519 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 14:42:48.754519 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:48.754519 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:48.754519 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:48.754519 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:48.754519 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:48.754519 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:48.755397 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:48.755397 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:48.755397 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:48.755397 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:48.755397 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:48.755397 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:48.755397 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:48.755397 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:48.755397 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:48.755397 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:48.755397 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 14:42:48.755397 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:42:48.755397 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 19 14:42:48.755397 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:48.756119 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667595fc-80d6-490d-9556-4f2e61547b19 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:48.756202 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 445/882] 10.222.0.26 () {56 vars in 1132 bytes} [Mon Sep 19 14:42:48 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:48.760548 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cafbd7-30ec-41b5-9490-7e36dcce9ab4 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:48.764504 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 438/883] 10.222.0.26 () {56 vars in 1122 bytes} [Mon Sep 19 14:42:48 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:48.770556 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667595fc-80d6-490d-9556-4f2e61547b19 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:48.840792 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:48.886607 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cafbd7-30ec-41b5-9490-7e36dcce9ab4 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:48.898422 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667595fc-80d6-490d-9556-4f2e61547b19 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:48.926562 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c603b71a-104f-4b0b-aa64-03f26944a501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:48.927830 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c603b71a-104f-4b0b-aa64-03f26944a501 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:48.928461 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c603b71a-104f-4b0b-aa64-03f26944a501 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:48.929292 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c603b71a-104f-4b0b-aa64-03f26944a501 None admin] PATH_INFO: `/v3/services` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:48.930386 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c603b71a-104f-4b0b-aa64-03f26944a501 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:48.930887 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c603b71a-104f-4b0b-aa64-03f26944a501 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:48.932840 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c603b71a-104f-4b0b-aa64-03f26944a501 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:48.934714 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5df695-5035-40a2-ad00-b7f01c151ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:48.935503 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5df695-5035-40a2-ad00-b7f01c151ecd None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:48.935613 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5df695-5035-40a2-ad00-b7f01c151ecd None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:48.935844 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5df695-5035-40a2-ad00-b7f01c151ecd None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:48.936465 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5df695-5035-40a2-ad00-b7f01c151ecd None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:48.936762 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5df695-5035-40a2-ad00-b7f01c151ecd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:48.938230 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5df695-5035-40a2-ad00-b7f01c151ecd None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:48.940516 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 446/884] 10.222.0.26 () {56 vars in 1126 bytes} [Mon Sep 19 14:42:48 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:42:48.945923 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c603b71a-104f-4b0b-aa64-03f26944a501 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:48.947904 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 439/885] 10.222.0.26 () {56 vars in 1122 bytes} [Mon Sep 19 14:42:48 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:42:49.001656 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:49.082199 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c603b71a-104f-4b0b-aa64-03f26944a501 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:49.122321 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1879f9-8a8c-43ca-93d3-80652e1b64da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:49.122850 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1879f9-8a8c-43ca-93d3-80652e1b64da None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:49.123164 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1879f9-8a8c-43ca-93d3-80652e1b64da None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:49.124888 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1879f9-8a8c-43ca-93d3-80652e1b64da None admin] PATH_INFO: `/v3/services` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:49.124888 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1879f9-8a8c-43ca-93d3-80652e1b64da None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:49.124888 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1879f9-8a8c-43ca-93d3-80652e1b64da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:49.125782 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1879f9-8a8c-43ca-93d3-80652e1b64da None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:49.131664 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 447/886] 10.222.0.26 () {56 vars in 1126 bytes} [Mon Sep 19 14:42:48 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:49.138088 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5df695-5035-40a2-ad00-b7f01c151ecd None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:49.242800 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5df695-5035-40a2-ad00-b7f01c151ecd None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:49.271245 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:49.287585 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b9e35d-8bdc-4653-b250-a4a2ffbb00a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:49.288189 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b9e35d-8bdc-4653-b250-a4a2ffbb00a1 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:49.288474 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b9e35d-8bdc-4653-b250-a4a2ffbb00a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:49.288742 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b9e35d-8bdc-4653-b250-a4a2ffbb00a1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:49.289570 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b9e35d-8bdc-4653-b250-a4a2ffbb00a1 None admin] RBAC: Adding query filter params (interface=public, service_id=4cf687bc52494b99b3d93907c96ff3d8, region_id=RegionOne) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:49.289876 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b9e35d-8bdc-4653-b250-a4a2ffbb00a1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:49.291342 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b9e35d-8bdc-4653-b250-a4a2ffbb00a1 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:49.297081 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 440/887] 10.222.0.26 () {56 vars in 1251 bytes} [Mon Sep 19 14:42:49 2022] GET /identity/v3/endpoints?service_id=4cf687bc52494b99b3d93907c96ff3d8&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:49.302477 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1879f9-8a8c-43ca-93d3-80652e1b64da None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:49.403144 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:49.411706 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1879f9-8a8c-43ca-93d3-80652e1b64da None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:49.449446 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd82af6a-73e0-42ca-b811-7fd90130bd36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:49.450052 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd82af6a-73e0-42ca-b811-7fd90130bd36 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:49.450325 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd82af6a-73e0-42ca-b811-7fd90130bd36 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:49.450587 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd82af6a-73e0-42ca-b811-7fd90130bd36 None admin] PATH_INFO: `/v3/services` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:49.451194 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd82af6a-73e0-42ca-b811-7fd90130bd36 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:49.452558 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd82af6a-73e0-42ca-b811-7fd90130bd36 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:49.458764 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 448/888] 10.222.0.26 () {56 vars in 1087 bytes} [Mon Sep 19 14:42:49 2022] GET /identity/v3/services => generated 1268 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:42:49.857140 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0610ab5e-c38a-448e-8a58-7aa9f97bd6c2 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:49.857344 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0610ab5e-c38a-448e-8a58-7aa9f97bd6c2 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:49.857610 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0610ab5e-c38a-448e-8a58-7aa9f97bd6c2 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:49.859150 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 441/889] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:42:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:42:49.864604 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c468bdde-a59f-4717-8c94-1f9276da31c0 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:49.865103 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c468bdde-a59f-4717-8c94-1f9276da31c0 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:49.865202 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c468bdde-a59f-4717-8c94-1f9276da31c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:49.885200 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-c468bdde-a59f-4717-8c94-1f9276da31c0 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:42:49.886487 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-c468bdde-a59f-4717-8c94-1f9276da31c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:42:49.961084 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 449/890] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:42:49 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 14:42:50.206435 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813457ab-ef5f-4480-b1cd-46a7e37cf032 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:50.207130 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813457ab-ef5f-4480-b1cd-46a7e37cf032 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:50.207130 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813457ab-ef5f-4480-b1cd-46a7e37cf032 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:50.208818 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 442/891] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:42:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:42:50.214242 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b112b884-2f72-4c4d-a804-b13fcfc8dc12 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:50.214520 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b112b884-2f72-4c4d-a804-b13fcfc8dc12 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:50.214787 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b112b884-2f72-4c4d-a804-b13fcfc8dc12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:50.235775 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-b112b884-2f72-4c4d-a804-b13fcfc8dc12 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:42:50.236950 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-b112b884-2f72-4c4d-a804-b13fcfc8dc12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:42:50.252093 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813457ab-ef5f-4480-b1cd-46a7e37cf032 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:50.309329 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 450/892] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:42:50 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:42:50.363152 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813457ab-ef5f-4480-b1cd-46a7e37cf032 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:50.403347 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8bf1db-00d5-4efe-b042-631c3a2aa957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:50.404098 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8bf1db-00d5-4efe-b042-631c3a2aa957 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:50.404427 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8bf1db-00d5-4efe-b042-631c3a2aa957 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:50.404698 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8bf1db-00d5-4efe-b042-631c3a2aa957 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:50.415853 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8bf1db-00d5-4efe-b042-631c3a2aa957 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:42:50.420705 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-af8bf1db-00d5-4efe-b042-631c3a2aa957 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 14:42:50.420705 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:50.420705 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:50.420705 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:50.420705 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:50.420705 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:50.420705 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:50.420705 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:50.420705 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:50.420705 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:50.420705 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:50.420705 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:50.420705 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:42:50.420705 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:42:50.420705 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:42:50.420705 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:42:50.421657 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:42:50.421657 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:42:50.421657 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:42:50.421657 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:42:50.421657 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:50.421657 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:50.421657 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:50.421657 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:50.421657 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:50.421657 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:50.421657 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:50.421657 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:50.421657 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:50.421657 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:50.421657 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:50.421657 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:50.422662 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:50.422662 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:50.422662 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:50.422662 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:50.422662 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:42:50.422662 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:42:50.422662 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:42:50.422662 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:42:50.422662 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:42:50.422662 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:42:50.422662 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 14:42:50.422662 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:42:50.422662 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 443/893] 10.222.0.26 () {56 vars in 1120 bytes} [Mon Sep 19 14:42:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:42:50.427890 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b112b884-2f72-4c4d-a804-b13fcfc8dc12 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:50.447275 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:50.532658 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b112b884-2f72-4c4d-a804-b13fcfc8dc12 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:50.571218 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de264078-af5c-4eba-b95a-cb272a770710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:50.572164 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de264078-af5c-4eba-b95a-cb272a770710 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:50.572522 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de264078-af5c-4eba-b95a-cb272a770710 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:50.572786 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de264078-af5c-4eba-b95a-cb272a770710 None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:50.573485 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de264078-af5c-4eba-b95a-cb272a770710 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:50.573780 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de264078-af5c-4eba-b95a-cb272a770710 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:50.575146 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de264078-af5c-4eba-b95a-cb272a770710 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:50.584168 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 451/894] 10.222.0.26 () {56 vars in 1115 bytes} [Mon Sep 19 14:42:50 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:50.590120 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8bf1db-00d5-4efe-b042-631c3a2aa957 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:50.617600 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de264078-af5c-4eba-b95a-cb272a770710 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:50.644894 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:50.714974 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:50.723440 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8bf1db-00d5-4efe-b042-631c3a2aa957 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:50.736943 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de264078-af5c-4eba-b95a-cb272a770710 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:50.771921 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8b436d-9ce2-4e75-8310-84401120a452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:50.772150 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b94c0e6-493b-4f6e-9516-ff85bbde7495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:50.772608 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8b436d-9ce2-4e75-8310-84401120a452 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:50.772883 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8b436d-9ce2-4e75-8310-84401120a452 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:50.773047 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b94c0e6-493b-4f6e-9516-ff85bbde7495 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:50.773189 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8b436d-9ce2-4e75-8310-84401120a452 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:50.773462 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b94c0e6-493b-4f6e-9516-ff85bbde7495 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:50.773814 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b94c0e6-493b-4f6e-9516-ff85bbde7495 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:50.774457 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b94c0e6-493b-4f6e-9516-ff85bbde7495 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:50.776142 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b94c0e6-493b-4f6e-9516-ff85bbde7495 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:50.785638 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-2b94c0e6-493b-4f6e-9516-ff85bbde7495 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 19 14:42:50.785638 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:50.785638 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 14:42:50.785638 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 14:42:50.785638 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 14:42:50.785638 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 14:42:50.785638 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 14:42:50.785638 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:42:50.785638 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 19 14:42:50.785638 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:50.785638 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 14:42:50.785638 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:50.785638 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:50.785638 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:50.785638 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:50.785638 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:50.785638 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:50.786837 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:50.786837 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:50.786837 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:50.786837 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:50.786837 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:50.786837 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:50.786837 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 14:42:50.786837 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 14:42:50.786837 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 14:42:50.786837 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 14:42:50.786837 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:50.786837 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:50.786837 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:50.786837 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:50.786837 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:50.786837 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:50.787842 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:50.787842 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:50.787842 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:50.787842 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:50.787842 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:50.787842 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:50.787842 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:50.787842 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:50.787842 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:50.787842 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:50.787842 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 14:42:50.787842 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:42:50.787842 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 19 14:42:50.787842 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:50.788735 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8b436d-9ce2-4e75-8310-84401120a452 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:50.788819 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 452/895] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Sep 19 14:42:50 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:42:50.793765 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8b436d-9ce2-4e75-8310-84401120a452 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:50.795781 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b94c0e6-493b-4f6e-9516-ff85bbde7495 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:50.813288 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-da8b436d-9ce2-4e75-8310-84401120a452 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:50.813288 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:50.813288 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:50.813288 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:50.813288 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:50.813288 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:50.813288 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:50.813288 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:50.813288 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:50.813288 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:50.813288 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:50.813288 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:50.813288 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:42:50.813288 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:42:50.813288 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:42:50.813288 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:42:50.814294 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:50.814294 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:50.814294 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:50.814294 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:50.814294 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:50.814294 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:50.814294 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:50.814294 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:50.814294 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:50.814294 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:50.814294 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:50.814294 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:50.814294 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:50.814294 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:50.814294 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:50.814294 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:50.814294 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:42:50.815139 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:42:50.815139 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:50.815139 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:42:50.815139 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 444/896] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:42:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:50.820258 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8b436d-9ce2-4e75-8310-84401120a452 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:50.906826 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b94c0e6-493b-4f6e-9516-ff85bbde7495 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:50.922688 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:50.930021 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8b436d-9ce2-4e75-8310-84401120a452 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:50.944355 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e914ecd7-ac2d-4e98-a561-c61d2f822703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:50.945283 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e914ecd7-ac2d-4e98-a561-c61d2f822703 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:50.945769 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e914ecd7-ac2d-4e98-a561-c61d2f822703 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:50.946227 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e914ecd7-ac2d-4e98-a561-c61d2f822703 None admin] PATH_INFO: `/v3/services` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:50.947276 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e914ecd7-ac2d-4e98-a561-c61d2f822703 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:50.947779 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e914ecd7-ac2d-4e98-a561-c61d2f822703 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:50.949389 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e914ecd7-ac2d-4e98-a561-c61d2f822703 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:50.954805 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 453/897] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Sep 19 14:42:50 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:50.965945 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e914ecd7-ac2d-4e98-a561-c61d2f822703 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:50.969586 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bec4639-5b49-4fcc-b2f4-eff56d9f36c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:50.970227 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bec4639-5b49-4fcc-b2f4-eff56d9f36c3 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:50.970501 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bec4639-5b49-4fcc-b2f4-eff56d9f36c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:50.970769 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bec4639-5b49-4fcc-b2f4-eff56d9f36c3 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:50.971420 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bec4639-5b49-4fcc-b2f4-eff56d9f36c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:50.971719 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bec4639-5b49-4fcc-b2f4-eff56d9f36c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:50.973132 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bec4639-5b49-4fcc-b2f4-eff56d9f36c3 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:50.988028 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:50.996589 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 445/898] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 19 14:42:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:42:50.997888 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bec4639-5b49-4fcc-b2f4-eff56d9f36c3 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:51.097782 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e914ecd7-ac2d-4e98-a561-c61d2f822703 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:51.137678 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bec4639-5b49-4fcc-b2f4-eff56d9f36c3 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:51.138568 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b330eb3-75d6-4d7f-8539-836fb1faee24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:51.139181 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b330eb3-75d6-4d7f-8539-836fb1faee24 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:51.139455 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b330eb3-75d6-4d7f-8539-836fb1faee24 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:51.139718 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b330eb3-75d6-4d7f-8539-836fb1faee24 None admin] PATH_INFO: `/v3/services` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:51.140345 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b330eb3-75d6-4d7f-8539-836fb1faee24 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:51.140755 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b330eb3-75d6-4d7f-8539-836fb1faee24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:51.142564 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b330eb3-75d6-4d7f-8539-836fb1faee24 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:51.152854 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 454/899] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Sep 19 14:42:50 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:51.153817 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b330eb3-75d6-4d7f-8539-836fb1faee24 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:51.182514 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e1c603-ac91-4064-bb3f-4d8d734fa06d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:51.183711 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1c603-ac91-4064-bb3f-4d8d734fa06d None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:51.184204 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1c603-ac91-4064-bb3f-4d8d734fa06d None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:51.185030 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1c603-ac91-4064-bb3f-4d8d734fa06d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:51.195723 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e1c603-ac91-4064-bb3f-4d8d734fa06d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:51.197772 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e1c603-ac91-4064-bb3f-4d8d734fa06d None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:51.210963 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-13e1c603-ac91-4064-bb3f-4d8d734fa06d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 14:42:51.210963 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:51.210963 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:51.210963 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:51.210963 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:51.210963 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:51.210963 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:51.210963 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:51.210963 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:51.210963 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:51.210963 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:51.210963 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:51.210963 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:42:51.210963 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:42:51.210963 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:42:51.210963 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:42:51.212565 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:51.212565 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:51.212565 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:42:51.212565 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:42:51.212565 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:42:51.212565 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:42:51.212565 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:51.212565 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:51.212565 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:51.212565 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:51.212565 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:51.212565 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:51.212565 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:51.212565 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:51.212565 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:51.212565 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:51.212565 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:51.212565 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:51.213688 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:51.213688 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:51.213688 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:42:51.213688 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:42:51.213688 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:42:51.213688 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:42:51.213688 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:42:51.213688 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:42:51.213688 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 14:42:51.213688 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:42:51.217660 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 446/900] 10.222.0.26 () {56 vars in 1117 bytes} [Mon Sep 19 14:42:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:51.218971 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb1603e-eca0-47df-a78d-48f163e13aca None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:51.219390 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb1603e-eca0-47df-a78d-48f163e13aca None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:51.219550 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb1603e-eca0-47df-a78d-48f163e13aca None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:51.220788 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 447/901] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:42:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:42:51.225133 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb1603e-eca0-47df-a78d-48f163e13aca None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:51.240727 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:51.240907 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:51.274367 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b330eb3-75d6-4d7f-8539-836fb1faee24 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:51.312017 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47a06ef-5fce-4581-8dee-61bd56e23088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:51.312626 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a06ef-5fce-4581-8dee-61bd56e23088 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:51.312907 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a06ef-5fce-4581-8dee-61bd56e23088 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:51.313197 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a06ef-5fce-4581-8dee-61bd56e23088 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:51.313905 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47a06ef-5fce-4581-8dee-61bd56e23088 None admin] RBAC: Adding query filter params (interface=public, service_id=c4170ab7055842dd9f3db9b7845ec2b9, region_id=RegionOne) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:51.314209 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47a06ef-5fce-4581-8dee-61bd56e23088 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:51.315578 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47a06ef-5fce-4581-8dee-61bd56e23088 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:51.320634 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 455/902] 10.222.0.26 () {56 vars in 1251 bytes} [Mon Sep 19 14:42:51 2022] GET /identity/v3/endpoints?service_id=c4170ab7055842dd9f3db9b7845ec2b9&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:51.322142 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc0c79d-3a28-4b00-84f4-efe27be8289b None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:51.322486 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc0c79d-3a28-4b00-84f4-efe27be8289b None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:51.322760 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc0c79d-3a28-4b00-84f4-efe27be8289b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:51.339710 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb1603e-eca0-47df-a78d-48f163e13aca None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:51.342762 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-ebc0c79d-3a28-4b00-84f4-efe27be8289b None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:42:51.343970 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-ebc0c79d-3a28-4b00-84f4-efe27be8289b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:42:51.376796 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18fbcc6-214b-4c07-854f-eb87d032068c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:51.377398 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18fbcc6-214b-4c07-854f-eb87d032068c None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:51.377673 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18fbcc6-214b-4c07-854f-eb87d032068c None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:51.377995 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18fbcc6-214b-4c07-854f-eb87d032068c None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:51.378784 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18fbcc6-214b-4c07-854f-eb87d032068c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:51.379150 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18fbcc6-214b-4c07-854f-eb87d032068c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:51.380818 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18fbcc6-214b-4c07-854f-eb87d032068c None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:51.405283 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 448/903] 10.222.0.26 () {56 vars in 1149 bytes} [Mon Sep 19 14:42:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:51.406134 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18fbcc6-214b-4c07-854f-eb87d032068c None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:51.419623 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 456/904] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:42:51 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:42:51.421380 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc0c79d-3a28-4b00-84f4-efe27be8289b None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:51.491585 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:51.512420 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:51.524055 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18fbcc6-214b-4c07-854f-eb87d032068c None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:51.554193 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc0c79d-3a28-4b00-84f4-efe27be8289b None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:51.566139 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e884579-cd5a-4227-9313-585f05e3c8d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:51.567024 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e884579-cd5a-4227-9313-585f05e3c8d4 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:51.567442 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e884579-cd5a-4227-9313-585f05e3c8d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:51.567974 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e884579-cd5a-4227-9313-585f05e3c8d4 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:51.568596 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e884579-cd5a-4227-9313-585f05e3c8d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:51.570201 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e884579-cd5a-4227-9313-585f05e3c8d4 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:51.578630 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 449/905] 10.222.0.26 () {56 vars in 1087 bytes} [Mon Sep 19 14:42:51 2022] GET /identity/v3/services => generated 1268 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:42:51.596889 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb54c74-576f-4272-831e-10620b17126b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:51.597963 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb54c74-576f-4272-831e-10620b17126b None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:51.598394 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb54c74-576f-4272-831e-10620b17126b None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:51.598848 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb54c74-576f-4272-831e-10620b17126b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:51.672536 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3b8f0e-54c8-4d85-93ce-9ecc30aad24c None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:51.672889 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3b8f0e-54c8-4d85-93ce-9ecc30aad24c None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:51.673162 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3b8f0e-54c8-4d85-93ce-9ecc30aad24c None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:51.674979 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 450/906] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:42:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 14:42:51.678127 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb54c74-576f-4272-831e-10620b17126b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:51.679993 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb54c74-576f-4272-831e-10620b17126b None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:51.680563 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1862b60-437c-4434-b1f8-3064540d95c4 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:51.680846 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1862b60-437c-4434-b1f8-3064540d95c4 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:51.681185 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1862b60-437c-4434-b1f8-3064540d95c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:51.700797 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-c1862b60-437c-4434-b1f8-3064540d95c4 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:42:51.702056 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-c1862b60-437c-4434-b1f8-3064540d95c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:42:51.755157 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:51.780040 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 451/907] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:42:51 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 14:42:51.780692 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1862b60-437c-4434-b1f8-3064540d95c4 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:51.800983 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 457/908] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 19 14:42:51 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 14:42:51.806912 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb54c74-576f-4272-831e-10620b17126b None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:51.862394 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:51.910211 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1862b60-437c-4434-b1f8-3064540d95c4 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:51.931782 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb54c74-576f-4272-831e-10620b17126b None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:51.948821 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833f46f8-4be4-4404-8d05-2fc943c8b367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:51.949477 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833f46f8-4be4-4404-8d05-2fc943c8b367 None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:51.949778 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833f46f8-4be4-4404-8d05-2fc943c8b367 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:51.950064 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833f46f8-4be4-4404-8d05-2fc943c8b367 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:51.950689 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833f46f8-4be4-4404-8d05-2fc943c8b367 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:51.952157 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833f46f8-4be4-4404-8d05-2fc943c8b367 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:51.971446 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e57c6e-3bb8-484f-8e0e-91714cf2b401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:51.972386 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 452/909] 10.222.0.26 () {60 vars in 1141 bytes} [Mon Sep 19 14:42:51 2022] POST /identity/v3/services => generated 241 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:42:51.972590 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e57c6e-3bb8-484f-8e0e-91714cf2b401 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:51.972919 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e57c6e-3bb8-484f-8e0e-91714cf2b401 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:51.973345 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e57c6e-3bb8-484f-8e0e-91714cf2b401 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:51.986070 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e57c6e-3bb8-484f-8e0e-91714cf2b401 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:51.987645 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e57c6e-3bb8-484f-8e0e-91714cf2b401 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:52.006714 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-21e57c6e-3bb8-484f-8e0e-91714cf2b401 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:52.006714 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:52.006714 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:52.006714 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:52.006714 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:52.006714 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:52.006714 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:52.006714 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:52.006714 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:52.006714 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:52.006714 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:52.006714 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:52.006714 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:42:52.006714 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:42:52.006714 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:42:52.006714 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:42:52.007658 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:52.007658 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:52.007658 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:52.007658 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:52.007658 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:52.007658 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:52.007658 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:52.007658 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:52.007658 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:52.007658 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:52.007658 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:52.007658 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:52.007658 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:52.007658 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:52.007658 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:52.007658 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:52.007658 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:42:52.008515 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:42:52.008515 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:52.008515 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:52.011759 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 458/910] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:42:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:42:52.014274 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833f46f8-4be4-4404-8d05-2fc943c8b367 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:52.055364 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e57c6e-3bb8-484f-8e0e-91714cf2b401 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:52.081842 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:52.151283 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833f46f8-4be4-4404-8d05-2fc943c8b367 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:52.180048 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:52.192715 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e57c6e-3bb8-484f-8e0e-91714cf2b401 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:52.200063 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516a9e47-820b-486a-83d1-13920a920c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:52.200682 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a9e47-820b-486a-83d1-13920a920c55 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:52.200959 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a9e47-820b-486a-83d1-13920a920c55 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:52.201254 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a9e47-820b-486a-83d1-13920a920c55 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:52.201905 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516a9e47-820b-486a-83d1-13920a920c55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:52.202205 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516a9e47-820b-486a-83d1-13920a920c55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:52.203571 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516a9e47-820b-486a-83d1-13920a920c55 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:52.221078 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 453/911] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 19 14:42:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:52.227868 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516a9e47-820b-486a-83d1-13920a920c55 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:52.236361 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb44752-4db2-45dd-a846-e4550a481024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:52.237773 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb44752-4db2-45dd-a846-e4550a481024 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:52.237773 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb44752-4db2-45dd-a846-e4550a481024 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:52.237773 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb44752-4db2-45dd-a846-e4550a481024 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:52.238224 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb44752-4db2-45dd-a846-e4550a481024 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:52.239594 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb44752-4db2-45dd-a846-e4550a481024 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:52.251637 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-deb44752-4db2-45dd-a846-e4550a481024 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 19 14:42:52.251637 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:52.251637 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 14:42:52.251637 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 14:42:52.251637 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 14:42:52.251637 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 14:42:52.251637 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 14:42:52.251637 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:42:52.251637 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 19 14:42:52.251637 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:52.251637 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 14:42:52.251637 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:52.251637 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:52.251637 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:52.251637 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:52.251637 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:52.252669 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:52.252669 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:52.252669 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:52.252669 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:52.252669 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:52.252669 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:52.252669 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:52.252669 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 14:42:52.252669 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 14:42:52.252669 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 14:42:52.252669 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 14:42:52.252669 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:52.252669 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:52.252669 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:52.252669 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:52.252669 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:52.252669 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:52.253621 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:52.253621 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:52.253621 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:52.253621 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:52.253621 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:52.253621 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:52.253621 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:52.253621 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:52.253621 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:52.253621 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:52.253621 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 14:42:52.253621 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:42:52.253621 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 19 14:42:52.253621 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:52.253621 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 459/912] 10.222.0.26 () {56 vars in 1132 bytes} [Mon Sep 19 14:42:52 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:52.259586 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb44752-4db2-45dd-a846-e4550a481024 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:52.363001 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:52.363434 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516a9e47-820b-486a-83d1-13920a920c55 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:52.385336 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb44752-4db2-45dd-a846-e4550a481024 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:52.413482 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56006600-8c87-42df-b89d-a177e6d44060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:52.414753 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56006600-8c87-42df-b89d-a177e6d44060 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:52.415742 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56006600-8c87-42df-b89d-a177e6d44060 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:52.416388 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56006600-8c87-42df-b89d-a177e6d44060 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:52.424110 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae67e18-c522-4fc9-a03d-7d19e9925615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:52.424763 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae67e18-c522-4fc9-a03d-7d19e9925615 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:52.425074 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae67e18-c522-4fc9-a03d-7d19e9925615 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:52.425343 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae67e18-c522-4fc9-a03d-7d19e9925615 None admin] PATH_INFO: `/v3/services` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:52.426250 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae67e18-c522-4fc9-a03d-7d19e9925615 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:52.426550 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae67e18-c522-4fc9-a03d-7d19e9925615 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:52.427136 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56006600-8c87-42df-b89d-a177e6d44060 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:52.427971 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae67e18-c522-4fc9-a03d-7d19e9925615 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:52.429235 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56006600-8c87-42df-b89d-a177e6d44060 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:52.435507 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 460/913] 10.222.0.26 () {56 vars in 1126 bytes} [Mon Sep 19 14:42:52 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:42:52.440754 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae67e18-c522-4fc9-a03d-7d19e9925615 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:52.451332 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-56006600-8c87-42df-b89d-a177e6d44060 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:42:52.451332 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:52.451332 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:52.451332 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:52.451332 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:52.451332 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:52.451332 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:52.451332 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:52.451332 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:52.451332 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:52.451332 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:52.451332 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:52.451332 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:42:52.451332 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:42:52.451332 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:42:52.452407 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:42:52.452407 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:52.452407 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:52.452407 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:52.452407 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:52.452407 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:52.452407 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:52.452407 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:52.452407 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:52.452407 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:52.452407 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:52.452407 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:52.452407 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:52.452407 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:52.452407 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:52.452407 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:52.452407 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:52.453334 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:42:52.453334 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:42:52.453334 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:42:52.453334 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:42:52.453334 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:42:52.453334 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:42:52.453334 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:42:52.453334 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:42:52.457082 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 454/914] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 19 14:42:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:52.460690 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56006600-8c87-42df-b89d-a177e6d44060 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:52.515421 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:52.552601 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae67e18-c522-4fc9-a03d-7d19e9925615 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:52.579771 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56006600-8c87-42df-b89d-a177e6d44060 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:52.596222 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a659aab-8383-4d18-a6fa-733246314774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:52.597334 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a659aab-8383-4d18-a6fa-733246314774 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:52.597893 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a659aab-8383-4d18-a6fa-733246314774 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:52.598357 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a659aab-8383-4d18-a6fa-733246314774 None admin] PATH_INFO: `/v3/services` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:52.599234 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a659aab-8383-4d18-a6fa-733246314774 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:52.599727 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a659aab-8383-4d18-a6fa-733246314774 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:52.601918 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a659aab-8383-4d18-a6fa-733246314774 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:52.609975 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 461/915] 10.222.0.26 () {56 vars in 1126 bytes} [Mon Sep 19 14:42:52 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:52.615243 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a659aab-8383-4d18-a6fa-733246314774 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:52.626462 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c57719-6e99-4205-853a-aa3ebb81b928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:52.627073 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c57719-6e99-4205-853a-aa3ebb81b928 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:52.627347 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c57719-6e99-4205-853a-aa3ebb81b928 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:52.627618 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c57719-6e99-4205-853a-aa3ebb81b928 None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:52.628771 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c57719-6e99-4205-853a-aa3ebb81b928 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:52.629104 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c57719-6e99-4205-853a-aa3ebb81b928 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:52.630706 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:52.632103 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c57719-6e99-4205-853a-aa3ebb81b928 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:52.654203 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 455/916] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 19 14:42:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:42:52.656131 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c57719-6e99-4205-853a-aa3ebb81b928 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:52.733701 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a659aab-8383-4d18-a6fa-733246314774 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:52.777766 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4151e895-1f12-4634-bf5d-cc184a9cc2e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:52.778381 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4151e895-1f12-4634-bf5d-cc184a9cc2e2 None admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:52.778660 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4151e895-1f12-4634-bf5d-cc184a9cc2e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:52.778928 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4151e895-1f12-4634-bf5d-cc184a9cc2e2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:52.779592 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4151e895-1f12-4634-bf5d-cc184a9cc2e2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:52.781083 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4151e895-1f12-4634-bf5d-cc184a9cc2e2 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:52.790369 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c57719-6e99-4205-853a-aa3ebb81b928 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:52.793313 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:52.815184 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 462/917] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 14:42:52 2022] POST /identity/v3/endpoints => generated 347 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:42:52.842514 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b70305c-1c3b-4a26-a877-38c4628e8c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:52.843186 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b70305c-1c3b-4a26-a877-38c4628e8c5b None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:52.843514 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b70305c-1c3b-4a26-a877-38c4628e8c5b None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:52.843787 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b70305c-1c3b-4a26-a877-38c4628e8c5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:52.844520 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b70305c-1c3b-4a26-a877-38c4628e8c5b None admin] RBAC: Adding query filter params (role.id=0b146dd606ac4c25bd6a33070856e1a2, scope.project.id=9ede5dc59ece4d9282867a99e94c4c41, user.id=2c2b1ac1a17c43d28da8f7e9a199dea4) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:52.844825 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b70305c-1c3b-4a26-a877-38c4628e8c5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:52.846413 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b70305c-1c3b-4a26-a877-38c4628e8c5b None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:52.853498 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 456/918] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 19 14:42:52 2022] GET /identity/v3/role_assignments?user.id=2c2b1ac1a17c43d28da8f7e9a199dea4&scope.project.id=9ede5dc59ece4d9282867a99e94c4c41&role.id=0b146dd606ac4c25bd6a33070856e1a2 => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:53.885948 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04d5c63-e81d-48a1-873b-94b3f4615c2a None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:53.886643 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04d5c63-e81d-48a1-873b-94b3f4615c2a None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:53.886643 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04d5c63-e81d-48a1-873b-94b3f4615c2a None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:53.888161 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 463/919] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:42:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:42:53.893602 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb4f44b-3833-4498-a80f-392058a9bffa None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:53.894185 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb4f44b-3833-4498-a80f-392058a9bffa None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:53.894185 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb4f44b-3833-4498-a80f-392058a9bffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:53.913200 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-1bb4f44b-3833-4498-a80f-392058a9bffa None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:42:53.914397 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-1bb4f44b-3833-4498-a80f-392058a9bffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:42:53.993194 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 457/920] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:42:53 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:42:54.254450 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aac359-54dc-4bf7-b99e-3e260c007159 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:54.254753 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aac359-54dc-4bf7-b99e-3e260c007159 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:54.254917 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aac359-54dc-4bf7-b99e-3e260c007159 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:54.256579 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 464/921] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:42:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:42:54.262107 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428a77ac-2f5e-4189-9796-c4e49f0d345a None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:54.262492 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428a77ac-2f5e-4189-9796-c4e49f0d345a None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:54.262855 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428a77ac-2f5e-4189-9796-c4e49f0d345a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:54.266431 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aac359-54dc-4bf7-b99e-3e260c007159 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:54.281976 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-428a77ac-2f5e-4189-9796-c4e49f0d345a None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:42:54.283299 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-428a77ac-2f5e-4189-9796-c4e49f0d345a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:42:54.339656 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:54.373387 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 458/922] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:42:54 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 14:42:54.386548 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aac359-54dc-4bf7-b99e-3e260c007159 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:54.420876 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631795df-afe0-4d7d-b56c-c8c5b5d213b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:54.421535 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631795df-afe0-4d7d-b56c-c8c5b5d213b2 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:54.421812 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631795df-afe0-4d7d-b56c-c8c5b5d213b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:54.422078 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631795df-afe0-4d7d-b56c-c8c5b5d213b2 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:54.422661 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631795df-afe0-4d7d-b56c-c8c5b5d213b2 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:54.424043 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631795df-afe0-4d7d-b56c-c8c5b5d213b2 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:54.433279 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-631795df-afe0-4d7d-b56c-c8c5b5d213b2 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 19 14:42:54.433279 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:54.433279 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 14:42:54.433279 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 14:42:54.433279 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 14:42:54.433279 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 14:42:54.433279 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 14:42:54.433279 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:42:54.433279 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 19 14:42:54.433279 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:54.433279 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 14:42:54.433279 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:54.433279 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:54.433279 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:54.433279 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:54.433279 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:54.433279 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:54.434218 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:54.434218 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:54.434218 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:54.434218 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:54.434218 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:54.434218 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:54.434218 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 14:42:54.434218 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 14:42:54.434218 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 14:42:54.434218 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 14:42:54.434218 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:54.434218 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:54.434218 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:54.434218 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:54.434218 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:54.434218 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:54.435039 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:54.435039 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:54.435039 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:54.435039 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:54.435039 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:54.435039 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:54.435039 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:54.435039 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:54.435039 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:54.435039 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:54.435039 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 14:42:54.435039 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:42:54.435039 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 19 14:42:54.435039 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:54.435039 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 465/923] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Sep 19 14:42:54 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:42:54.442257 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428a77ac-2f5e-4189-9796-c4e49f0d345a None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:54.468245 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:54.547837 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428a77ac-2f5e-4189-9796-c4e49f0d345a None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:54.587013 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ebf0cc-558c-4ba8-9fe3-6cd670520a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:54.588228 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ebf0cc-558c-4ba8-9fe3-6cd670520a2d None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:54.588514 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ebf0cc-558c-4ba8-9fe3-6cd670520a2d None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:54.588767 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ebf0cc-558c-4ba8-9fe3-6cd670520a2d None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:54.589433 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ebf0cc-558c-4ba8-9fe3-6cd670520a2d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:54.589733 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ebf0cc-558c-4ba8-9fe3-6cd670520a2d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:54.591460 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ebf0cc-558c-4ba8-9fe3-6cd670520a2d None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:54.596942 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 459/924] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Sep 19 14:42:54 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:54.606100 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631795df-afe0-4d7d-b56c-c8c5b5d213b2 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:54.709146 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ebf0cc-558c-4ba8-9fe3-6cd670520a2d None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:54.710248 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631795df-afe0-4d7d-b56c-c8c5b5d213b2 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:54.743735 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:54.752032 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a558bef-34ea-489f-a04c-efca6db6f3ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:54.753054 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a558bef-34ea-489f-a04c-efca6db6f3ba None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:54.753536 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a558bef-34ea-489f-a04c-efca6db6f3ba None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:54.754042 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a558bef-34ea-489f-a04c-efca6db6f3ba None admin] PATH_INFO: `/v3/services` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:54.754919 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a558bef-34ea-489f-a04c-efca6db6f3ba None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:54.755428 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a558bef-34ea-489f-a04c-efca6db6f3ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:54.757185 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a558bef-34ea-489f-a04c-efca6db6f3ba None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:54.763407 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 466/925] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Sep 19 14:42:54 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:54.769529 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a558bef-34ea-489f-a04c-efca6db6f3ba None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:54.815461 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:54.833277 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ebf0cc-558c-4ba8-9fe3-6cd670520a2d None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:54.890623 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b556cdcb-6dc1-4a49-8b23-4f979c3b2fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:54.891258 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b556cdcb-6dc1-4a49-8b23-4f979c3b2fb3 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:54.891533 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b556cdcb-6dc1-4a49-8b23-4f979c3b2fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:54.891797 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b556cdcb-6dc1-4a49-8b23-4f979c3b2fb3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:54.892379 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b556cdcb-6dc1-4a49-8b23-4f979c3b2fb3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:54.893771 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b556cdcb-6dc1-4a49-8b23-4f979c3b2fb3 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:54.901490 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a558bef-34ea-489f-a04c-efca6db6f3ba None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:54.903538 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-b556cdcb-6dc1-4a49-8b23-4f979c3b2fb3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 14:42:54.903538 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:54.903538 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 14:42:54.903538 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 14:42:54.903538 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 14:42:54.903538 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 14:42:54.903538 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 14:42:54.903538 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:42:54.903538 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 14:42:54.903538 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:42:54.903538 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 14:42:54.903538 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:42:54.903538 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:54.903538 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:54.903538 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:54.903538 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:54.903538 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:54.904538 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:54.904538 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:54.904538 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:54.904538 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:54.904538 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:54.904538 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:54.904538 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 14:42:54.904538 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 14:42:54.904538 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 14:42:54.904538 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 14:42:54.904538 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:54.904538 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:54.904538 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:54.904538 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:54.904538 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:54.904538 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:54.905395 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:54.905395 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:54.905395 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:54.905395 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:54.905395 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:54.905395 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:54.905395 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:54.905395 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:54.905395 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:54.905395 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:54.905395 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 14:42:54.905395 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:42:54.905395 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 14:42:54.905395 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:42:54.909365 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 460/926] 10.222.0.26 () {56 vars in 1126 bytes} [Mon Sep 19 14:42:54 2022] GET /identity/v3/services/object-store => generated 93 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:54.911363 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b556cdcb-6dc1-4a49-8b23-4f979c3b2fb3 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:54.944130 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185a997d-2df6-4dd6-ba23-d9096ca8d45c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:54.945239 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a997d-2df6-4dd6-ba23-d9096ca8d45c None admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:54.945715 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a997d-2df6-4dd6-ba23-d9096ca8d45c None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:54.946179 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a997d-2df6-4dd6-ba23-d9096ca8d45c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:54.947196 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185a997d-2df6-4dd6-ba23-d9096ca8d45c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:54.948971 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185a997d-2df6-4dd6-ba23-d9096ca8d45c None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:54.981604 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 467/927] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 14:42:54 2022] POST /identity/v3/endpoints => generated 346 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 14:42:55.037659 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b556cdcb-6dc1-4a49-8b23-4f979c3b2fb3 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:55.093150 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a8b98-6065-4c08-8ef7-7ead1c36b645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:55.093688 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a8b98-6065-4c08-8ef7-7ead1c36b645 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:55.093963 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a8b98-6065-4c08-8ef7-7ead1c36b645 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:55.094296 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a8b98-6065-4c08-8ef7-7ead1c36b645 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:55.094929 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5a8b98-6065-4c08-8ef7-7ead1c36b645 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:55.095277 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5a8b98-6065-4c08-8ef7-7ead1c36b645 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:55.096722 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5a8b98-6065-4c08-8ef7-7ead1c36b645 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:55.106906 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 461/928] 10.222.0.26 () {56 vars in 1122 bytes} [Mon Sep 19 14:42:54 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:55.110054 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185a997d-2df6-4dd6-ba23-d9096ca8d45c None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:55.119421 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e2f82-a5a8-4f29-bcad-6e087c29fc8e None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:55.119737 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e2f82-a5a8-4f29-bcad-6e087c29fc8e None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:55.119976 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e2f82-a5a8-4f29-bcad-6e087c29fc8e None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:55.122344 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 462/929] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:42:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 14:42:55.128060 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf5f22d-f1c5-4508-a2da-462d51c2da0c None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:55.128347 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf5f22d-f1c5-4508-a2da-462d51c2da0c None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:55.128610 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf5f22d-f1c5-4508-a2da-462d51c2da0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:55.148370 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-daf5f22d-f1c5-4508-a2da-462d51c2da0c None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:42:55.149759 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-daf5f22d-f1c5-4508-a2da-462d51c2da0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:42:55.158973 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:55.171124 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:55.232332 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185a997d-2df6-4dd6-ba23-d9096ca8d45c None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:55.234536 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 463/930] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:42:55 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:42:55.235859 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a7b1b-4936-469f-bae3-652016f3cafe None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:55.236143 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a7b1b-4936-469f-bae3-652016f3cafe None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:55.236408 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a7b1b-4936-469f-bae3-652016f3cafe None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:55.237785 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 464/931] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:42:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:42:55.243417 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4083ca83-bd5a-477c-9ee8-bc9ca29de1ab None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:55.243828 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4083ca83-bd5a-477c-9ee8-bc9ca29de1ab None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:55.244104 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4083ca83-bd5a-477c-9ee8-bc9ca29de1ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:55.263860 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-4083ca83-bd5a-477c-9ee8-bc9ca29de1ab None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:42:55.265073 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-4083ca83-bd5a-477c-9ee8-bc9ca29de1ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:42:55.273973 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec52b0f-370b-431e-aa79-34089214bfde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:55.275288 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec52b0f-370b-431e-aa79-34089214bfde None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:55.275811 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec52b0f-370b-431e-aa79-34089214bfde None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:55.276277 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec52b0f-370b-431e-aa79-34089214bfde None admin] PATH_INFO: `/v3/services` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:55.277248 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec52b0f-370b-431e-aa79-34089214bfde None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:55.277795 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec52b0f-370b-431e-aa79-34089214bfde None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:55.279532 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec52b0f-370b-431e-aa79-34089214bfde None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:55.286700 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 468/932] 10.222.0.26 () {56 vars in 1122 bytes} [Mon Sep 19 14:42:55 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:55.294156 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec52b0f-370b-431e-aa79-34089214bfde None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:55.369361 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 465/933] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:42:55 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:42:55.405836 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec52b0f-370b-431e-aa79-34089214bfde None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:55.420556 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:55.441851 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abb8e4c-56ec-4bfb-8f13-2aeccc47b764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:55.442817 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb8e4c-56ec-4bfb-8f13-2aeccc47b764 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:55.443286 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb8e4c-56ec-4bfb-8f13-2aeccc47b764 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:55.443765 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb8e4c-56ec-4bfb-8f13-2aeccc47b764 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:55.444646 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abb8e4c-56ec-4bfb-8f13-2aeccc47b764 None admin] RBAC: Adding query filter params (interface=public, service_id=aea87a4eb3c8450d854866004e4fc85f, region_id=RegionOne) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:55.445189 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abb8e4c-56ec-4bfb-8f13-2aeccc47b764 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:55.446930 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abb8e4c-56ec-4bfb-8f13-2aeccc47b764 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:55.459032 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 469/934] 10.222.0.26 () {56 vars in 1251 bytes} [Mon Sep 19 14:42:55 2022] GET /identity/v3/endpoints?service_id=aea87a4eb3c8450d854866004e4fc85f&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:42:55.460803 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4083ca83-bd5a-477c-9ee8-bc9ca29de1ab None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:55.505564 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abb8e4c-56ec-4bfb-8f13-2aeccc47b764 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:55.535024 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:55.570538 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4083ca83-bd5a-477c-9ee8-bc9ca29de1ab None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:55.608734 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7149e796-36d2-4573-a420-80b800306943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:55.609415 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7149e796-36d2-4573-a420-80b800306943 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:55.609692 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7149e796-36d2-4573-a420-80b800306943 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:55.609953 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7149e796-36d2-4573-a420-80b800306943 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:55.610639 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7149e796-36d2-4573-a420-80b800306943 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:55.612170 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7149e796-36d2-4573-a420-80b800306943 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:55.617326 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abb8e4c-56ec-4bfb-8f13-2aeccc47b764 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:55.625099 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 466/935] 10.222.0.26 () {56 vars in 1087 bytes} [Mon Sep 19 14:42:55 2022] GET /identity/v3/services => generated 1497 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:42:55.662126 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e9a06e-595e-42c1-8164-80ba6ec6ba6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:55.662813 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e9a06e-595e-42c1-8164-80ba6ec6ba6f None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:55.663089 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e9a06e-595e-42c1-8164-80ba6ec6ba6f None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:55.663352 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e9a06e-595e-42c1-8164-80ba6ec6ba6f None admin] PATH_INFO: `/v3/services/compute` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:55.663940 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e9a06e-595e-42c1-8164-80ba6ec6ba6f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:55.665662 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e9a06e-595e-42c1-8164-80ba6ec6ba6f None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:55.671286 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7149e796-36d2-4573-a420-80b800306943 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:55.677428 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-e6e9a06e-595e-42c1-8164-80ba6ec6ba6f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 19 14:42:55.677428 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:55.677428 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 14:42:55.677428 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 14:42:55.677428 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 14:42:55.677428 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 14:42:55.677428 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 14:42:55.677428 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:42:55.677428 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 19 14:42:55.677428 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:55.677428 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 14:42:55.677428 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:55.677428 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:55.677428 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:55.677428 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:55.677428 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:55.677428 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:55.678448 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:55.678448 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:55.678448 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:55.678448 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:55.678448 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:55.678448 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:55.678448 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 14:42:55.678448 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 14:42:55.678448 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 14:42:55.678448 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 14:42:55.678448 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:55.678448 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:55.678448 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:55.678448 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:55.678448 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:55.678448 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:55.679661 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:55.679661 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:55.679661 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:55.679661 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:55.679661 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:55.679661 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:55.679661 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:55.679661 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:55.679661 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:55.679661 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:55.679661 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 14:42:55.679661 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:42:55.679661 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 19 14:42:55.679661 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:55.679661 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 470/936] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 19 14:42:55 2022] GET /identity/v3/services/compute => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:42:55.685110 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e9a06e-595e-42c1-8164-80ba6ec6ba6f None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:55.739054 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:55.795030 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7149e796-36d2-4573-a420-80b800306943 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:55.813758 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e9a06e-595e-42c1-8164-80ba6ec6ba6f None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:55.834837 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c78661-adad-47bb-855f-91af53826536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:55.835637 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c78661-adad-47bb-855f-91af53826536 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:55.836003 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c78661-adad-47bb-855f-91af53826536 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:55.836367 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c78661-adad-47bb-855f-91af53826536 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:55.840124 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:55.852474 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c78661-adad-47bb-855f-91af53826536 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:42:55.858412 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-e7c78661-adad-47bb-855f-91af53826536 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 14:42:55.858412 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:55.858412 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:55.858412 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:55.858412 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:55.858412 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:55.858412 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:55.858412 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:55.858412 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:55.858412 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:55.858412 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:55.858412 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:55.858412 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:42:55.858412 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:42:55.858412 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:42:55.858412 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:42:55.859301 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:42:55.859301 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:42:55.859301 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:42:55.859301 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:42:55.859301 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:55.859301 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:55.859301 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:55.859301 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:55.859301 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:55.859301 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:55.859301 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:55.859301 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:55.859301 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:55.859301 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:55.859301 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:55.859301 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:55.860137 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:55.860137 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:55.860137 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:55.860137 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:55.860137 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:42:55.860137 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:42:55.860137 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:42:55.860137 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:42:55.860137 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:42:55.860137 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:42:55.860137 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 14:42:55.860137 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:42:55.860769 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d2fd00-0826-4646-b79d-fce9739b99ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:55.861500 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d2fd00-0826-4646-b79d-fce9739b99ae None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:55.861500 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d2fd00-0826-4646-b79d-fce9739b99ae None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:55.861848 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d2fd00-0826-4646-b79d-fce9739b99ae None admin] PATH_INFO: `/v3/services` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:55.862798 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d2fd00-0826-4646-b79d-fce9739b99ae None admin] RBAC: Adding query filter params (name=compute) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:55.863251 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d2fd00-0826-4646-b79d-fce9739b99ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:55.864979 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 467/937] 10.222.0.26 () {56 vars in 1120 bytes} [Mon Sep 19 14:42:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:42:55.865430 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d2fd00-0826-4646-b79d-fce9739b99ae None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:55.866577 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c78661-adad-47bb-855f-91af53826536 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:55.875173 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 471/938] 10.222.0.26 () {56 vars in 1112 bytes} [Mon Sep 19 14:42:55 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:55.882077 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d2fd00-0826-4646-b79d-fce9739b99ae None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:56.010857 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d2fd00-0826-4646-b79d-fce9739b99ae None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:56.016228 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c78661-adad-47bb-855f-91af53826536 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:56.020028 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:56.051029 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b61401a-7932-43d2-96c1-a666c76c86e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:56.051648 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b61401a-7932-43d2-96c1-a666c76c86e9 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:56.051927 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b61401a-7932-43d2-96c1-a666c76c86e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:56.052204 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b61401a-7932-43d2-96c1-a666c76c86e9 None admin] PATH_INFO: `/v3/services` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:56.053191 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b61401a-7932-43d2-96c1-a666c76c86e9 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:56.053500 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b61401a-7932-43d2-96c1-a666c76c86e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:56.055122 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b61401a-7932-43d2-96c1-a666c76c86e9 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:56.061460 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25113ca2-529c-45a0-9879-e4c0e21c1348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:56.062153 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 472/939] 10.222.0.26 () {56 vars in 1112 bytes} [Mon Sep 19 14:42:55 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:42:56.065393 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25113ca2-529c-45a0-9879-e4c0e21c1348 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:56.065970 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25113ca2-529c-45a0-9879-e4c0e21c1348 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:56.066506 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25113ca2-529c-45a0-9879-e4c0e21c1348 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:56.067590 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25113ca2-529c-45a0-9879-e4c0e21c1348 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:56.068097 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25113ca2-529c-45a0-9879-e4c0e21c1348 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:56.069822 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25113ca2-529c-45a0-9879-e4c0e21c1348 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:56.080756 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 468/940] 10.222.0.26 () {56 vars in 1115 bytes} [Mon Sep 19 14:42:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:42:56.086961 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b61401a-7932-43d2-96c1-a666c76c86e9 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:56.211574 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b61401a-7932-43d2-96c1-a666c76c86e9 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:56.251351 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e45840-0c21-472e-94af-723f2123446e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:56.252309 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e45840-0c21-472e-94af-723f2123446e None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:56.252763 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e45840-0c21-472e-94af-723f2123446e None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:56.253272 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e45840-0c21-472e-94af-723f2123446e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:56.265638 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e45840-0c21-472e-94af-723f2123446e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:56.267379 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e45840-0c21-472e-94af-723f2123446e None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:56.282835 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-f0e45840-0c21-472e-94af-723f2123446e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:56.282835 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:56.282835 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:56.282835 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:56.282835 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:56.282835 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:56.282835 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:56.282835 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:56.282835 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:56.282835 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:56.282835 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:56.282835 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:56.282835 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:42:56.282835 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:42:56.282835 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:42:56.282835 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:42:56.283806 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:56.283806 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:56.283806 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:56.283806 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:56.283806 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:56.283806 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:56.283806 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:56.283806 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:56.283806 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:56.283806 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:56.283806 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:56.283806 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:56.283806 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:56.283806 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:56.283806 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:56.283806 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:56.283806 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:42:56.284679 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:42:56.284679 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:56.284679 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:56.286580 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 473/941] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:42:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:56.293469 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25113ca2-529c-45a0-9879-e4c0e21c1348 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:56.358126 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:56.402804 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25113ca2-529c-45a0-9879-e4c0e21c1348 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:56.438744 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a9433e-5089-46bc-9add-4ee5d87603ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:56.439362 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a9433e-5089-46bc-9add-4ee5d87603ee None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:56.439638 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a9433e-5089-46bc-9add-4ee5d87603ee None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:56.439906 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a9433e-5089-46bc-9add-4ee5d87603ee None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:56.440546 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a9433e-5089-46bc-9add-4ee5d87603ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:56.440846 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a9433e-5089-46bc-9add-4ee5d87603ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:56.442241 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a9433e-5089-46bc-9add-4ee5d87603ee None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:56.455677 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 469/942] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 19 14:42:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:56.461396 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e45840-0c21-472e-94af-723f2123446e None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:56.491158 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:56.568760 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e45840-0c21-472e-94af-723f2123446e None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:56.604903 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4856c6-5e7f-45cf-948e-aebdaba2ac78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:56.605575 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4856c6-5e7f-45cf-948e-aebdaba2ac78 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:56.606081 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4856c6-5e7f-45cf-948e-aebdaba2ac78 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:56.606352 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4856c6-5e7f-45cf-948e-aebdaba2ac78 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:56.614376 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4856c6-5e7f-45cf-948e-aebdaba2ac78 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:56.615823 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4856c6-5e7f-45cf-948e-aebdaba2ac78 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:56.629148 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-5b4856c6-5e7f-45cf-948e-aebdaba2ac78 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 14:42:56.629148 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:56.629148 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:56.629148 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:56.629148 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:56.629148 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:56.629148 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:56.629148 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:56.629148 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:56.629148 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:56.629148 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:56.629148 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:56.629148 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:42:56.629148 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:42:56.629148 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:42:56.629148 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:42:56.630143 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:56.630143 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:56.630143 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:42:56.630143 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:42:56.630143 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:42:56.630143 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:42:56.630143 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:56.630143 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:56.630143 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:56.630143 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:56.630143 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:56.630143 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:56.630143 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:56.630143 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:56.630143 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:56.630143 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:56.630143 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:56.630143 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:56.631463 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:56.631463 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:56.631463 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:42:56.631463 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:42:56.631463 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:42:56.631463 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:42:56.631463 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:42:56.631463 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:42:56.631463 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 14:42:56.631463 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:56.631463 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 474/943] 10.222.0.26 () {56 vars in 1117 bytes} [Mon Sep 19 14:42:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:56.638527 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a9433e-5089-46bc-9add-4ee5d87603ee None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:56.749067 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a9433e-5089-46bc-9add-4ee5d87603ee None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:56.768241 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:56.786141 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5c9f3a-8503-4724-a669-aee446cbb772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:56.786749 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c9f3a-8503-4724-a669-aee446cbb772 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:56.787024 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c9f3a-8503-4724-a669-aee446cbb772 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:56.787290 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c9f3a-8503-4724-a669-aee446cbb772 None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:56.788018 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5c9f3a-8503-4724-a669-aee446cbb772 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:56.788316 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5c9f3a-8503-4724-a669-aee446cbb772 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:56.789768 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5c9f3a-8503-4724-a669-aee446cbb772 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:56.809734 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 470/944] 10.222.0.26 () {56 vars in 1149 bytes} [Mon Sep 19 14:42:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:42:56.818172 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4856c6-5e7f-45cf-948e-aebdaba2ac78 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:56.903217 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:56.922804 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4856c6-5e7f-45cf-948e-aebdaba2ac78 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:56.956190 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4436e4-aae2-4b68-b862-fc8ed6550740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:56.956869 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4436e4-aae2-4b68-b862-fc8ed6550740 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:56.957174 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4436e4-aae2-4b68-b862-fc8ed6550740 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:56.957441 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4436e4-aae2-4b68-b862-fc8ed6550740 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:56.969441 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4436e4-aae2-4b68-b862-fc8ed6550740 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:56.970949 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4436e4-aae2-4b68-b862-fc8ed6550740 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:56.985354 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-1e4436e4-aae2-4b68-b862-fc8ed6550740 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:56.985354 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:56.985354 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:56.985354 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:56.985354 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:56.985354 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:56.985354 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:56.985354 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:56.985354 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:56.985354 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:56.985354 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:56.985354 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:56.985354 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:42:56.985354 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:42:56.985354 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:42:56.985354 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:42:56.986297 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:56.986297 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:56.986297 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:56.986297 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:56.986297 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:56.986297 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:56.986297 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:56.986297 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:56.986297 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:56.986297 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:56.986297 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:56.986297 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:56.986297 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:56.986297 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:56.986297 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:56.986297 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:56.986297 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:42:56.987565 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:42:56.987565 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:42:56.987565 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:56.987565 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 475/945] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:42:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:56.992499 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5c9f3a-8503-4724-a669-aee446cbb772 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:57.104107 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5c9f3a-8503-4724-a669-aee446cbb772 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:57.138971 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3bb1a5-2076-40db-b501-bed267fc95e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:57.139575 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3bb1a5-2076-40db-b501-bed267fc95e6 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:57.139851 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3bb1a5-2076-40db-b501-bed267fc95e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:57.140120 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3bb1a5-2076-40db-b501-bed267fc95e6 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:57.140758 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3bb1a5-2076-40db-b501-bed267fc95e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:57.141084 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3bb1a5-2076-40db-b501-bed267fc95e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:57.142475 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3bb1a5-2076-40db-b501-bed267fc95e6 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:57.154247 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 471/946] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 19 14:42:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:42:57.159742 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4436e4-aae2-4b68-b862-fc8ed6550740 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:57.269756 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4436e4-aae2-4b68-b862-fc8ed6550740 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:57.296226 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68031377-1b1b-4083-a768-209405aeaf2e None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:57.296553 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68031377-1b1b-4083-a768-209405aeaf2e None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:57.296783 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68031377-1b1b-4083-a768-209405aeaf2e None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:57.298401 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 472/947] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:42:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:42:57.303581 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a45740b-e79b-4976-bd1d-14ef27d34c67 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:57.303935 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a45740b-e79b-4976-bd1d-14ef27d34c67 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:57.304268 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a45740b-e79b-4976-bd1d-14ef27d34c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:57.308562 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c17bb66-4d3a-45eb-8507-c79ddeac4919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:57.309575 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c17bb66-4d3a-45eb-8507-c79ddeac4919 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:57.310048 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c17bb66-4d3a-45eb-8507-c79ddeac4919 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:57.310493 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c17bb66-4d3a-45eb-8507-c79ddeac4919 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:57.317845 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c17bb66-4d3a-45eb-8507-c79ddeac4919 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:57.319296 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c17bb66-4d3a-45eb-8507-c79ddeac4919 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:57.321304 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:57.323779 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-4a45740b-e79b-4976-bd1d-14ef27d34c67 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:42:57.325148 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-4a45740b-e79b-4976-bd1d-14ef27d34c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:42:57.335171 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-5c17bb66-4d3a-45eb-8507-c79ddeac4919 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:42:57.335171 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:57.335171 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:57.335171 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:57.335171 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:57.335171 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:57.335171 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:57.335171 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:57.335171 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:57.335171 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:57.335171 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:57.335171 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:57.335171 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:42:57.335171 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:42:57.335171 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:42:57.336040 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:42:57.336040 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:57.336040 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:57.336040 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:57.336040 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:57.336040 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:57.336040 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:57.336040 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:57.336040 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:57.336040 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:57.336040 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:57.336040 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:57.336040 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:57.336040 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:57.336040 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:57.336040 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:57.336040 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:57.337055 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:42:57.337055 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:42:57.337055 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:42:57.337055 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:42:57.337055 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:42:57.337055 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:42:57.337055 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:42:57.337055 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:57.339706 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 476/948] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 19 14:42:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:57.350896 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c17bb66-4d3a-45eb-8507-c79ddeac4919 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:57.368163 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:57.429032 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 473/949] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:42:57 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:42:57.464868 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c17bb66-4d3a-45eb-8507-c79ddeac4919 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:57.501623 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc46a47-f789-4125-b702-83e170c2a14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:57.502231 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc46a47-f789-4125-b702-83e170c2a14b None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:57.502509 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc46a47-f789-4125-b702-83e170c2a14b None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:57.502777 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc46a47-f789-4125-b702-83e170c2a14b None admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:57.503644 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc46a47-f789-4125-b702-83e170c2a14b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:57.503950 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc46a47-f789-4125-b702-83e170c2a14b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:57.505503 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc46a47-f789-4125-b702-83e170c2a14b None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:57.519131 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 477/950] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 19 14:42:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:57.525020 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a45740b-e79b-4976-bd1d-14ef27d34c67 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:57.631470 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a45740b-e79b-4976-bd1d-14ef27d34c67 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:57.666900 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d0865e-6d27-4a98-9bbb-085fa513d564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:57.667620 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d0865e-6d27-4a98-9bbb-085fa513d564 None admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:57.667903 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d0865e-6d27-4a98-9bbb-085fa513d564 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:57.668177 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d0865e-6d27-4a98-9bbb-085fa513d564 None admin] PATH_INFO: `/v3/projects/9ede5dc59ece4d9282867a99e94c4c41/users/2c2b1ac1a17c43d28da8f7e9a199dea4/roles/0b146dd606ac4c25bd6a33070856e1a2` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:57.670392 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d0865e-6d27-4a98-9bbb-085fa513d564 None admin] RBAC: Authorizing `identity:create_grant(project_id=9ede5dc59ece4d9282867a99e94c4c41, user_id=2c2b1ac1a17c43d28da8f7e9a199dea4, role_id=0b146dd606ac4c25bd6a33070856e1a2)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:57.671919 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d0865e-6d27-4a98-9bbb-085fa513d564 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:57.687502 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 474/951] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Sep 19 14:42:57 2022] PUT /identity/v3/projects/9ede5dc59ece4d9282867a99e94c4c41/users/2c2b1ac1a17c43d28da8f7e9a199dea4/roles/0b146dd606ac4c25bd6a33070856e1a2 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:42:57.717502 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc46a47-f789-4125-b702-83e170c2a14b None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:57.789294 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:57.842325 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc46a47-f789-4125-b702-83e170c2a14b None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:57.883473 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72906ea-370c-42a3-98a8-01a589a8f5b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:57.884135 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72906ea-370c-42a3-98a8-01a589a8f5b4 None admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:57.884416 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72906ea-370c-42a3-98a8-01a589a8f5b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:57.884688 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72906ea-370c-42a3-98a8-01a589a8f5b4 None admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:57.885391 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72906ea-370c-42a3-98a8-01a589a8f5b4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:57.886836 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72906ea-370c-42a3-98a8-01a589a8f5b4 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:57.889519 dv-cinder-756709-7-smb devstack@keystone.service[81471]: WARNING keystone.server.flask.common [None req-f72906ea-370c-42a3-98a8-01a589a8f5b4 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 19 14:42:57.910219 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.sql.core [None req-f72906ea-370c-42a3-98a8-01a589a8f5b4 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 19 14:42:57.910219 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 19 14:42:57.910219 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [parameters: {'id': '697bad3eebd64629a18dcc0e7d3edcf1', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 19 14:42:57.910219 dv-cinder-756709-7-smb devstack@keystone.service[81471]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81471) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 19 14:42:57.928407 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-f72906ea-370c-42a3-98a8-01a589a8f5b4 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 697bad3eebd64629a18dcc0e7d3edcf1.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 697bad3eebd64629a18dcc0e7d3edcf1. Sep 19 14:42:57.928407 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:57.928407 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 19 14:42:57.928407 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 19 14:42:57.928407 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 19 14:42:57.928407 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 19 14:42:57.928407 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 19 14:42:57.928407 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application result = self._query(query) Sep 19 14:42:57.928407 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 19 14:42:57.928407 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application conn.query(q) Sep 19 14:42:57.928407 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 19 14:42:57.928407 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 19 14:42:57.928407 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 19 14:42:57.929405 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application result.read() Sep 19 14:42:57.929405 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 19 14:42:57.929405 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 19 14:42:57.929405 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 19 14:42:57.929405 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 19 14:42:57.929405 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 19 14:42:57.929405 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 19 14:42:57.929405 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 19 14:42:57.929405 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 19 14:42:57.929405 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 19 14:42:57.929405 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:57.929405 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 19 14:42:57.929405 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:57.929405 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:57.929405 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 19 14:42:57.929405 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 19 14:42:57.929405 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 19 14:42:57.929405 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 19 14:42:57.930322 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 19 14:42:57.930322 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application next(self.gen) Sep 19 14:42:57.930322 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 19 14:42:57.930322 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application yield resource Sep 19 14:42:57.930322 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 19 14:42:57.930322 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application next(self.gen) Sep 19 14:42:57.930322 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 19 14:42:57.930322 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application self.session.rollback() Sep 19 14:42:57.930322 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 19 14:42:57.930322 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application self.force_reraise() Sep 19 14:42:57.930322 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 19 14:42:57.930322 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise self.value Sep 19 14:42:57.930322 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 19 14:42:57.930322 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 19 14:42:57.930322 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 19 14:42:57.930322 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application session.commit() Sep 19 14:42:57.930322 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 19 14:42:57.931310 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 19 14:42:57.931310 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 19 14:42:57.931310 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application self._prepare_impl() Sep 19 14:42:57.931310 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 19 14:42:57.931310 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application self.session.flush() Sep 19 14:42:57.931310 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 19 14:42:57.931310 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application self._flush(objects) Sep 19 14:42:57.931310 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 19 14:42:57.931310 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 19 14:42:57.931310 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 19 14:42:57.931310 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application compat.raise_( Sep 19 14:42:57.931310 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 19 14:42:57.931310 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception Sep 19 14:42:57.931310 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 19 14:42:57.931310 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application flush_context.execute() Sep 19 14:42:57.931310 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 19 14:42:57.931310 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rec.execute(self) Sep 19 14:42:57.932458 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 19 14:42:57.932458 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 19 14:42:57.932458 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 19 14:42:57.932458 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 19 14:42:57.932458 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 19 14:42:57.932458 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 19 14:42:57.932458 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 19 14:42:57.932458 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 19 14:42:57.932458 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 19 14:42:57.932458 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 19 14:42:57.932458 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 19 14:42:57.932458 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 19 14:42:57.932458 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 19 14:42:57.932458 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 19 14:42:57.932458 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 19 14:42:57.933261 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 19 14:42:57.933261 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 19 14:42:57.933261 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception Sep 19 14:42:57.933261 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 19 14:42:57.933261 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 19 14:42:57.933261 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 19 14:42:57.933261 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 19 14:42:57.933261 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 19 14:42:57.933261 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application result = self._query(query) Sep 19 14:42:57.933261 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 19 14:42:57.933261 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application conn.query(q) Sep 19 14:42:57.933261 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 19 14:42:57.933261 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 19 14:42:57.933261 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 19 14:42:57.933261 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application result.read() Sep 19 14:42:57.933261 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 19 14:42:57.933261 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 19 14:42:57.934134 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 19 14:42:57.934134 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 19 14:42:57.934134 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 19 14:42:57.934134 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 19 14:42:57.934134 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 19 14:42:57.934134 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 19 14:42:57.934134 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 19 14:42:57.934134 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 19 14:42:57.934134 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [parameters: {'id': '697bad3eebd64629a18dcc0e7d3edcf1', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 19 14:42:57.934134 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 19 14:42:57.934134 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:57.934134 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 14:42:57.934134 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:57.934134 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:57.934134 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 19 14:42:57.934956 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 19 14:42:57.934956 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 19 14:42:57.934956 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 19 14:42:57.934956 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 19 14:42:57.934956 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:57.934956 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 14:42:57.934956 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:57.934956 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:57.934956 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:57.934956 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:57.934956 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:57.934956 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:57.934956 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:57.934956 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:57.934956 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:57.934956 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:57.934956 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:57.935954 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:57.935954 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 19 14:42:57.935954 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 19 14:42:57.935954 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:57.935954 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:57.935954 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 19 14:42:57.935954 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 19 14:42:57.935954 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 697bad3eebd64629a18dcc0e7d3edcf1. Sep 19 14:42:57.935954 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:42:57.940292 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 478/952] 10.222.0.26 () {60 vars in 1140 bytes} [Mon Sep 19 14:42:57 2022] POST /identity/v3/projects => generated 262 bytes in 223 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:57.947177 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d0865e-6d27-4a98-9bbb-085fa513d564 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:57.978266 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:58.066570 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d0865e-6d27-4a98-9bbb-085fa513d564 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:58.098196 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa56d6-6d63-4f3f-9040-3d79d71fb475 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:58.098516 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa56d6-6d63-4f3f-9040-3d79d71fb475 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:58.098748 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa56d6-6d63-4f3f-9040-3d79d71fb475 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:58.105300 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 479/953] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:42:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 14:42:58.110689 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf0fdb-70a0-45fa-9d83-e6f7baa3dcd8 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:58.110976 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf0fdb-70a0-45fa-9d83-e6f7baa3dcd8 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:58.111250 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf0fdb-70a0-45fa-9d83-e6f7baa3dcd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:58.119654 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de830391-8fe4-4c93-893f-03510173774d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:58.120939 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de830391-8fe4-4c93-893f-03510173774d None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:58.121405 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de830391-8fe4-4c93-893f-03510173774d None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:58.121833 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de830391-8fe4-4c93-893f-03510173774d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:58.129726 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de830391-8fe4-4c93-893f-03510173774d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:58.131356 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de830391-8fe4-4c93-893f-03510173774d None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:58.143695 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-de830391-8fe4-4c93-893f-03510173774d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:42:58.143695 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:58.143695 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:58.143695 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:58.143695 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:58.143695 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:58.143695 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:58.143695 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:58.143695 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:58.143695 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:58.143695 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:58.143695 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:58.143695 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:42:58.143695 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:42:58.143695 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:42:58.144951 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:42:58.144951 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:58.144951 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:58.144951 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:58.144951 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:58.144951 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:58.144951 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:58.144951 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:58.144951 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:58.144951 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:58.144951 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:58.144951 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:58.144951 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:58.144951 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:58.144951 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:58.144951 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:58.144951 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:58.146206 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:42:58.146206 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:42:58.146206 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:42:58.146206 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:42:58.146206 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:42:58.146206 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:42:58.146206 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:42:58.146206 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:42:58.148264 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 475/954] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 19 14:42:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:58.159301 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de830391-8fe4-4c93-893f-03510173774d None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:58.172715 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-d3cf0fdb-70a0-45fa-9d83-e6f7baa3dcd8 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:42:58.174921 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-d3cf0fdb-70a0-45fa-9d83-e6f7baa3dcd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:42:58.327036 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 480/955] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:42:58 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 14:42:58.334523 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:58.371317 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de830391-8fe4-4c93-893f-03510173774d None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:58.385902 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34582d70-fcb2-49f1-9c60-5fe7f35fda5f None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:58.386225 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34582d70-fcb2-49f1-9c60-5fe7f35fda5f None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:58.386459 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34582d70-fcb2-49f1-9c60-5fe7f35fda5f None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:58.391800 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 481/956] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:42:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:42:58.392941 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a22ab-2898-407e-8a0d-465f4d96a22b None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:58.393272 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a22ab-2898-407e-8a0d-465f4d96a22b None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:58.393545 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a22ab-2898-407e-8a0d-465f4d96a22b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:58.422753 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-b10a22ab-2898-407e-8a0d-465f4d96a22b None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:42:58.423852 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-b10a22ab-2898-407e-8a0d-465f4d96a22b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:42:58.433649 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d78ae2-6810-490b-a045-1b72efc524a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:58.434270 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d78ae2-6810-490b-a045-1b72efc524a7 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:58.434547 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d78ae2-6810-490b-a045-1b72efc524a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:58.434820 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d78ae2-6810-490b-a045-1b72efc524a7 None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:58.435493 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d78ae2-6810-490b-a045-1b72efc524a7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:58.435796 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d78ae2-6810-490b-a045-1b72efc524a7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:58.437262 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d78ae2-6810-490b-a045-1b72efc524a7 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:58.471910 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 476/957] 10.222.0.26 () {56 vars in 1112 bytes} [Mon Sep 19 14:42:58 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:58.496735 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:58.565197 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 482/958] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:42:58 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:42:58.611315 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d78ae2-6810-490b-a045-1b72efc524a7 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:58.728161 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d78ae2-6810-490b-a045-1b72efc524a7 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:58.765330 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5e84e1-d622-4b10-957d-35ba7c418688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:58.765956 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e84e1-d622-4b10-957d-35ba7c418688 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:58.766228 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e84e1-d622-4b10-957d-35ba7c418688 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:58.766493 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e84e1-d622-4b10-957d-35ba7c418688 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:58.767070 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5e84e1-d622-4b10-957d-35ba7c418688 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:58.768445 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5e84e1-d622-4b10-957d-35ba7c418688 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:58.777687 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-2c5e84e1-d622-4b10-957d-35ba7c418688 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 14:42:58.777687 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:58.777687 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 14:42:58.777687 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 14:42:58.777687 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 14:42:58.777687 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 14:42:58.777687 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 14:42:58.777687 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:42:58.777687 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 14:42:58.777687 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:42:58.777687 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 14:42:58.777687 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:42:58.777687 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:42:58.777687 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:42:58.777687 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:42:58.777687 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:42:58.777687 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:42:58.778707 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:42:58.778707 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:42:58.778707 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:42:58.778707 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:42:58.778707 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:42:58.778707 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:42:58.778707 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 14:42:58.778707 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 14:42:58.778707 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 14:42:58.778707 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 14:42:58.778707 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:42:58.778707 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:42:58.778707 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:42:58.778707 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:42:58.778707 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:42:58.778707 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:42:58.779934 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:42:58.779934 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:42:58.779934 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:42:58.779934 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:42:58.779934 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:42:58.779934 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:42:58.779934 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:42:58.779934 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:42:58.779934 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:42:58.779934 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:42:58.779934 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 14:42:58.779934 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:42:58.779934 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 14:42:58.779934 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:42:58.779934 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 477/959] 10.222.0.26 () {56 vars in 1126 bytes} [Mon Sep 19 14:42:58 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:42:58.785770 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10a22ab-2898-407e-8a0d-465f4d96a22b None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:58.852710 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5e84e1-d622-4b10-957d-35ba7c418688 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:58.869707 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:58.895587 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10a22ab-2898-407e-8a0d-465f4d96a22b None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:58.936588 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68abe29-7af7-456e-adce-31cd11106702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:58.937414 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68abe29-7af7-456e-adce-31cd11106702 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:58.937786 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68abe29-7af7-456e-adce-31cd11106702 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:58.938151 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68abe29-7af7-456e-adce-31cd11106702 None admin] PATH_INFO: `/v3/services` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:58.938936 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68abe29-7af7-456e-adce-31cd11106702 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:58.939331 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68abe29-7af7-456e-adce-31cd11106702 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:58.941465 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68abe29-7af7-456e-adce-31cd11106702 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:58.948514 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 483/960] 10.222.0.26 () {56 vars in 1122 bytes} [Mon Sep 19 14:42:58 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:42:58.954352 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68abe29-7af7-456e-adce-31cd11106702 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:58.981902 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5e84e1-d622-4b10-957d-35ba7c418688 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:58.995403 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:59.024409 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daa9094-0dcd-4aa8-8022-f215fdfba2f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:59.025718 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa9094-0dcd-4aa8-8022-f215fdfba2f5 None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:59.025994 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa9094-0dcd-4aa8-8022-f215fdfba2f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:59.026263 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa9094-0dcd-4aa8-8022-f215fdfba2f5 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:59.027037 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daa9094-0dcd-4aa8-8022-f215fdfba2f5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:59.028501 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daa9094-0dcd-4aa8-8022-f215fdfba2f5 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:59.048868 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 478/961] 10.222.0.26 () {60 vars in 1141 bytes} [Mon Sep 19 14:42:58 2022] POST /identity/v3/services => generated 242 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 14:42:59.086044 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68abe29-7af7-456e-adce-31cd11106702 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:59.141033 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374daf63-6438-4c19-bcb2-34c8236cc2a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:59.141959 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374daf63-6438-4c19-bcb2-34c8236cc2a5 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:59.142399 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374daf63-6438-4c19-bcb2-34c8236cc2a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:59.142815 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374daf63-6438-4c19-bcb2-34c8236cc2a5 None admin] PATH_INFO: `/v3/services` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:59.143598 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374daf63-6438-4c19-bcb2-34c8236cc2a5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:42:59.144093 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374daf63-6438-4c19-bcb2-34c8236cc2a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:59.145754 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374daf63-6438-4c19-bcb2-34c8236cc2a5 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:59.153849 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 484/962] 10.222.0.26 () {56 vars in 1122 bytes} [Mon Sep 19 14:42:58 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:42:59.160509 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daa9094-0dcd-4aa8-8022-f215fdfba2f5 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:42:59.242539 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:42:59.279561 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daa9094-0dcd-4aa8-8022-f215fdfba2f5 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:42:59.314475 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16c32c2-f505-470f-b615-29e995df7774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:42:59.315084 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c32c2-f505-470f-b615-29e995df7774 None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:42:59.315361 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c32c2-f505-470f-b615-29e995df7774 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:42:59.315631 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c32c2-f505-470f-b615-29e995df7774 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:42:59.316350 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16c32c2-f505-470f-b615-29e995df7774 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:42:59.317778 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16c32c2-f505-470f-b615-29e995df7774 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:42:59.342572 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 479/963] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 14:42:59 2022] POST /identity/v3/endpoints => generated 349 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:43:00.011367 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7345b918-b9b5-446a-b560-cea630b94e5c None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:00.011932 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7345b918-b9b5-446a-b560-cea630b94e5c None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:00.011932 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7345b918-b9b5-446a-b560-cea630b94e5c None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:00.013598 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 485/964] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:43:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:43:00.019679 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e035dc-99ca-4e6d-bbe9-0abd5caa0705 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:00.019679 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e035dc-99ca-4e6d-bbe9-0abd5caa0705 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:00.020089 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e035dc-99ca-4e6d-bbe9-0abd5caa0705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:00.041777 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-98e035dc-99ca-4e6d-bbe9-0abd5caa0705 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:43:00.043079 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-98e035dc-99ca-4e6d-bbe9-0abd5caa0705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:43:00.125404 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 480/965] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:43:00 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:43:00.389524 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7345b918-b9b5-446a-b560-cea630b94e5c None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:00.489482 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:00.498530 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7345b918-b9b5-446a-b560-cea630b94e5c None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:00.534841 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad0572a-503e-4e3a-99d6-36eef89f7ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:00.535491 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0572a-503e-4e3a-99d6-36eef89f7ca8 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:00.535769 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0572a-503e-4e3a-99d6-36eef89f7ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:00.536040 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0572a-503e-4e3a-99d6-36eef89f7ca8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:00.546838 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad0572a-503e-4e3a-99d6-36eef89f7ca8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:43:00.551651 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-9ad0572a-503e-4e3a-99d6-36eef89f7ca8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 14:43:00.551651 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:00.551651 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:00.551651 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:00.551651 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:00.551651 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:00.551651 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:00.551651 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:00.551651 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:00.551651 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:00.551651 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:00.551651 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:00.551651 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:43:00.551651 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:43:00.551651 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:43:00.551651 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:43:00.552599 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:43:00.552599 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:43:00.552599 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:43:00.552599 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:43:00.552599 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:00.552599 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:00.552599 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:00.552599 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:00.552599 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:00.552599 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:00.552599 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:00.552599 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:00.552599 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:00.552599 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:00.552599 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:00.552599 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:00.553819 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:00.553819 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:00.553819 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:00.553819 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:00.553819 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:43:00.553819 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:43:00.553819 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:43:00.553819 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:43:00.553819 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:43:00.553819 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:43:00.553819 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 14:43:00.553819 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:43:00.553819 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 486/966] 10.222.0.26 () {56 vars in 1120 bytes} [Mon Sep 19 14:43:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:43:00.559227 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e035dc-99ca-4e6d-bbe9-0abd5caa0705 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:00.613698 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:00.666060 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e035dc-99ca-4e6d-bbe9-0abd5caa0705 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:00.702657 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b18a63-70a2-4934-9f02-f6ff694726db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:00.703273 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b18a63-70a2-4934-9f02-f6ff694726db None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:00.703546 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b18a63-70a2-4934-9f02-f6ff694726db None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:00.703815 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b18a63-70a2-4934-9f02-f6ff694726db None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:00.704483 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b18a63-70a2-4934-9f02-f6ff694726db None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:00.704783 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b18a63-70a2-4934-9f02-f6ff694726db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:00.706209 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b18a63-70a2-4934-9f02-f6ff694726db None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:00.715267 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 481/967] 10.222.0.26 () {56 vars in 1115 bytes} [Mon Sep 19 14:43:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:00.722448 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad0572a-503e-4e3a-99d6-36eef89f7ca8 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:00.834723 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad0572a-503e-4e3a-99d6-36eef89f7ca8 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:00.871071 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23629a87-e832-4322-8d2f-464765ae75d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:00.872084 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23629a87-e832-4322-8d2f-464765ae75d8 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:00.872528 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23629a87-e832-4322-8d2f-464765ae75d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:00.872931 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23629a87-e832-4322-8d2f-464765ae75d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:00.883744 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23629a87-e832-4322-8d2f-464765ae75d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:00.884436 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e968e63a-3188-495c-9727-b71892e0e5b4 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:00.884794 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e968e63a-3188-495c-9727-b71892e0e5b4 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:00.885104 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e968e63a-3188-495c-9727-b71892e0e5b4 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:00.885894 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23629a87-e832-4322-8d2f-464765ae75d8 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:00.886715 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 482/968] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:43:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:43:00.891802 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f40f0-315c-4781-9adb-5dea3b742b84 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:00.892084 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f40f0-315c-4781-9adb-5dea3b742b84 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:00.892357 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f40f0-315c-4781-9adb-5dea3b742b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:00.902848 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-23629a87-e832-4322-8d2f-464765ae75d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:43:00.902848 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:00.902848 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:00.902848 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:00.902848 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:00.902848 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:00.902848 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:00.902848 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:00.902848 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:00.902848 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:00.902848 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:00.902848 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:00.902848 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:43:00.902848 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:43:00.902848 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:43:00.902848 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:43:00.903998 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:00.903998 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:00.903998 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:00.903998 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:00.903998 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:00.903998 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:00.903998 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:00.903998 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:00.903998 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:00.903998 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:00.903998 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:00.903998 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:00.903998 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:00.903998 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:00.903998 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:00.903998 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:00.903998 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:43:00.905096 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:43:00.905096 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:43:00.905096 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:43:00.906877 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 487/969] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:43:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:43:00.912405 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23629a87-e832-4322-8d2f-464765ae75d8 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:00.915680 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-296f40f0-315c-4781-9adb-5dea3b742b84 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:43:00.917238 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-296f40f0-315c-4781-9adb-5dea3b742b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:43:00.925741 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:01.013254 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 483/970] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:43:00 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:43:01.042375 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23629a87-e832-4322-8d2f-464765ae75d8 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:01.078521 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e11365-d597-43f2-85cb-bd287eff7e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:01.079493 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e11365-d597-43f2-85cb-bd287eff7e15 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:01.079963 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e11365-d597-43f2-85cb-bd287eff7e15 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:01.080448 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e11365-d597-43f2-85cb-bd287eff7e15 None admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:01.081310 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e11365-d597-43f2-85cb-bd287eff7e15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:01.081812 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e11365-d597-43f2-85cb-bd287eff7e15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:01.083396 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e11365-d597-43f2-85cb-bd287eff7e15 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:01.097272 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 488/971] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 19 14:43:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:43:01.105278 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296f40f0-315c-4781-9adb-5dea3b742b84 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:01.151705 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:01.207606 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296f40f0-315c-4781-9adb-5dea3b742b84 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:01.243185 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1c2c7b-bf47-4d68-9c73-efd08b35892b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:01.244196 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1c2c7b-bf47-4d68-9c73-efd08b35892b None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:01.244682 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1c2c7b-bf47-4d68-9c73-efd08b35892b None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:01.245171 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1c2c7b-bf47-4d68-9c73-efd08b35892b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:01.252646 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1c2c7b-bf47-4d68-9c73-efd08b35892b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:01.254333 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1c2c7b-bf47-4d68-9c73-efd08b35892b None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:01.266177 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-2d1c2c7b-bf47-4d68-9c73-efd08b35892b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 14:43:01.266177 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:01.266177 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:01.266177 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:01.266177 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:01.266177 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:01.266177 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:01.266177 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:01.266177 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:01.266177 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:01.266177 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:01.266177 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:01.266177 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:43:01.266177 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:43:01.266177 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:43:01.266177 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:43:01.267136 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:01.267136 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:01.267136 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:43:01.267136 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:43:01.267136 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:43:01.267136 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:43:01.267136 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:01.267136 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:01.267136 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:01.267136 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:01.267136 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:01.267136 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:01.267136 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:01.267136 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:01.267136 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:01.267136 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:01.267136 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:01.267136 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:01.268082 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:01.268082 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:01.268082 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:43:01.268082 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:43:01.268082 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:43:01.268082 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:43:01.268082 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:43:01.268082 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:43:01.268082 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 14:43:01.268082 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:43:01.270642 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 484/972] 10.222.0.26 () {56 vars in 1117 bytes} [Mon Sep 19 14:43:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:43:01.278175 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e11365-d597-43f2-85cb-bd287eff7e15 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:01.320125 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1c2c7b-bf47-4d68-9c73-efd08b35892b None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:01.356711 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:01.403970 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e11365-d597-43f2-85cb-bd287eff7e15 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:01.444738 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad56fbfc-185a-4c45-bc0a-7a4786f7a9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:01.445236 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1c2c7b-bf47-4d68-9c73-efd08b35892b None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:01.445468 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad56fbfc-185a-4c45-bc0a-7a4786f7a9a5 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:01.445708 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad56fbfc-185a-4c45-bc0a-7a4786f7a9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:01.446118 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad56fbfc-185a-4c45-bc0a-7a4786f7a9a5 None admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:01.447000 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad56fbfc-185a-4c45-bc0a-7a4786f7a9a5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:01.447295 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad56fbfc-185a-4c45-bc0a-7a4786f7a9a5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:01.448474 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:01.448746 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad56fbfc-185a-4c45-bc0a-7a4786f7a9a5 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:01.469256 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 489/973] 10.222.0.26 () {56 vars in 1149 bytes} [Mon Sep 19 14:43:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:01.471181 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9cbe72-5593-45b8-a04a-aebe259879d3 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:01.471733 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9cbe72-5593-45b8-a04a-aebe259879d3 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:01.472257 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9cbe72-5593-45b8-a04a-aebe259879d3 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:01.474176 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 490/974] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:43:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:43:01.480482 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9cbe72-5593-45b8-a04a-aebe259879d3 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:01.486850 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b262d3b-071d-49a0-9059-a722add93b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:01.487508 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b262d3b-071d-49a0-9059-a722add93b84 None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:01.487738 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b262d3b-071d-49a0-9059-a722add93b84 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:01.488004 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b262d3b-071d-49a0-9059-a722add93b84 None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:01.488689 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b262d3b-071d-49a0-9059-a722add93b84 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:01.490260 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b262d3b-071d-49a0-9059-a722add93b84 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:01.493330 dv-cinder-756709-7-smb devstack@keystone.service[81472]: WARNING keystone.server.flask.common [None req-6b262d3b-071d-49a0-9059-a722add93b84 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 19 14:43:01.507645 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.sql.core [None req-6b262d3b-071d-49a0-9059-a722add93b84 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 19 14:43:01.507645 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 19 14:43:01.507645 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [parameters: {'user_id': '50c3b1ff9e5d4f26830f9262946f809e', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 19 14:43:01.507645 dv-cinder-756709-7-smb devstack@keystone.service[81472]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81472) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 19 14:43:01.516189 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-6b262d3b-071d-49a0-9059-a722add93b84 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 19 14:43:01.516189 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:01.516189 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 19 14:43:01.516189 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 19 14:43:01.516189 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 19 14:43:01.516189 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 19 14:43:01.516189 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 19 14:43:01.516189 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application result = self._query(query) Sep 19 14:43:01.516189 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 19 14:43:01.516189 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application conn.query(q) Sep 19 14:43:01.516189 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 19 14:43:01.516189 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 19 14:43:01.516189 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 19 14:43:01.516189 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application result.read() Sep 19 14:43:01.516189 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 19 14:43:01.517147 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 19 14:43:01.517147 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 19 14:43:01.517147 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 19 14:43:01.517147 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 19 14:43:01.517147 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 19 14:43:01.517147 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 19 14:43:01.517147 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 19 14:43:01.517147 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 19 14:43:01.517147 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:43:01.517147 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 19 14:43:01.517147 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:43:01.517147 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:01.517147 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 19 14:43:01.517147 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 19 14:43:01.517147 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 19 14:43:01.517147 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 19 14:43:01.517147 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 19 14:43:01.517147 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application next(self.gen) Sep 19 14:43:01.518748 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 19 14:43:01.518748 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application yield resource Sep 19 14:43:01.518748 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 19 14:43:01.518748 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application next(self.gen) Sep 19 14:43:01.518748 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 19 14:43:01.518748 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self.session.rollback() Sep 19 14:43:01.518748 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 19 14:43:01.518748 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self.force_reraise() Sep 19 14:43:01.518748 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 19 14:43:01.518748 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise self.value Sep 19 14:43:01.518748 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 19 14:43:01.518748 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 19 14:43:01.518748 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 19 14:43:01.518748 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application session.commit() Sep 19 14:43:01.518748 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 19 14:43:01.518748 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 19 14:43:01.518748 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 19 14:43:01.519653 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._prepare_impl() Sep 19 14:43:01.519653 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 19 14:43:01.519653 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self.session.flush() Sep 19 14:43:01.519653 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 19 14:43:01.519653 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._flush(objects) Sep 19 14:43:01.519653 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 19 14:43:01.519653 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 19 14:43:01.519653 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 19 14:43:01.519653 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application compat.raise_( Sep 19 14:43:01.519653 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 19 14:43:01.519653 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception Sep 19 14:43:01.519653 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 19 14:43:01.519653 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application flush_context.execute() Sep 19 14:43:01.519653 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 19 14:43:01.519653 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rec.execute(self) Sep 19 14:43:01.519653 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 19 14:43:01.519653 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 19 14:43:01.520496 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 19 14:43:01.520496 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 19 14:43:01.520496 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 19 14:43:01.520496 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 19 14:43:01.520496 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 19 14:43:01.520496 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 19 14:43:01.520496 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 19 14:43:01.520496 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 19 14:43:01.520496 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 19 14:43:01.520496 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 19 14:43:01.520496 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 19 14:43:01.520496 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 19 14:43:01.520496 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 19 14:43:01.520496 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 19 14:43:01.520496 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 19 14:43:01.520496 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception Sep 19 14:43:01.521346 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 19 14:43:01.521346 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 19 14:43:01.521346 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 19 14:43:01.521346 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 19 14:43:01.521346 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 19 14:43:01.521346 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application result = self._query(query) Sep 19 14:43:01.521346 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 19 14:43:01.521346 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application conn.query(q) Sep 19 14:43:01.521346 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 19 14:43:01.521346 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 19 14:43:01.521346 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 19 14:43:01.521346 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application result.read() Sep 19 14:43:01.521346 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 19 14:43:01.521346 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 19 14:43:01.521346 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 19 14:43:01.521346 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 19 14:43:01.523043 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 19 14:43:01.523043 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 19 14:43:01.523043 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 19 14:43:01.523043 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 19 14:43:01.523043 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 19 14:43:01.523043 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 19 14:43:01.523043 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [parameters: {'user_id': '50c3b1ff9e5d4f26830f9262946f809e', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 19 14:43:01.523043 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 19 14:43:01.523043 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:43:01.523043 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 14:43:01.523043 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:43:01.523043 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:01.523043 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:01.523043 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:01.523043 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:01.525164 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:01.525164 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:01.525164 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:01.525164 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:01.525164 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:01.525164 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:01.525164 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:01.525164 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 19 14:43:01.525164 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 19 14:43:01.525164 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:01.525164 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:01.525164 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:43:01.525164 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:43:01.525164 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:43:01.525164 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:43:01.525164 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 19 14:43:01.525164 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 19 14:43:01.528288 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 19 14:43:01.528288 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 19 14:43:01.528288 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 19 14:43:01.528288 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 19 14:43:01.528288 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 19 14:43:01.528288 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:43:01.528288 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 485/975] 10.222.0.26 () {60 vars in 1131 bytes} [Mon Sep 19 14:43:01 2022] POST /identity/v3/users => generated 160 bytes in 198 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:43:01.528288 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf83643-64e9-4070-89b0-5342074d667a None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:01.528288 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf83643-64e9-4070-89b0-5342074d667a None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:01.528288 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf83643-64e9-4070-89b0-5342074d667a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:01.539061 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-fbf83643-64e9-4070-89b0-5342074d667a None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:43:01.540827 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-fbf83643-64e9-4070-89b0-5342074d667a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:43:01.609931 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9cbe72-5593-45b8-a04a-aebe259879d3 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:01.610922 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 486/976] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:43:01 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:43:01.611769 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf83643-64e9-4070-89b0-5342074d667a None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:01.637084 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:01.647842 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012696a1-8af4-4842-8480-9f34ec5d793f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:01.648444 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012696a1-8af4-4842-8480-9f34ec5d793f None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:01.648726 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012696a1-8af4-4842-8480-9f34ec5d793f None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:01.649032 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012696a1-8af4-4842-8480-9f34ec5d793f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:01.708904 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:01.717015 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf83643-64e9-4070-89b0-5342074d667a None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:01.724537 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012696a1-8af4-4842-8480-9f34ec5d793f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:01.726006 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012696a1-8af4-4842-8480-9f34ec5d793f None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:01.753285 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4f6346-a4d0-4ce1-bae4-f10c9af5eabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:01.753913 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f6346-a4d0-4ce1-bae4-f10c9af5eabb None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:01.754187 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f6346-a4d0-4ce1-bae4-f10c9af5eabb None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:01.754448 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f6346-a4d0-4ce1-bae4-f10c9af5eabb None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:01.761819 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4f6346-a4d0-4ce1-bae4-f10c9af5eabb None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:01.763516 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4f6346-a4d0-4ce1-bae4-f10c9af5eabb None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:01.776528 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-ed4f6346-a4d0-4ce1-bae4-f10c9af5eabb None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 19 14:43:01.776528 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:01.776528 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:01.776528 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:01.776528 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:01.776528 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:01.776528 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:01.776528 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:01.776528 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:01.776528 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:01.776528 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:01.776528 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:01.776528 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:43:01.776528 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:43:01.776528 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:43:01.776528 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:43:01.778603 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:01.778603 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:01.778603 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:43:01.778603 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:43:01.778603 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:43:01.778603 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:43:01.778603 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:01.778603 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:01.778603 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:01.778603 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:01.778603 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:01.778603 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:01.778603 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:01.778603 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:01.778603 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:01.778603 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:01.778603 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:01.778603 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:01.780438 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:01.780438 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:01.780438 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:43:01.780438 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:43:01.780438 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:43:01.780438 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:43:01.780438 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:43:01.780438 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:43:01.780438 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 19 14:43:01.780438 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:43:01.780438 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 487/977] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 19 14:43:01 2022] GET /identity/v3/users/cinder => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:43:01.780438 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c991ed5-f5ff-4670-aba5-73a29f80bf92 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:01.780438 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c991ed5-f5ff-4670-aba5-73a29f80bf92 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:01.783670 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c991ed5-f5ff-4670-aba5-73a29f80bf92 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:01.783670 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 488/978] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:43:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:43:01.787643 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c991ed5-f5ff-4670-aba5-73a29f80bf92 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:01.852435 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 491/979] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 19 14:43:01 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 14:43:01.853885 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be7db39-13cb-43ca-abfe-3b66e04e3f84 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:01.854144 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be7db39-13cb-43ca-abfe-3b66e04e3f84 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:01.854436 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be7db39-13cb-43ca-abfe-3b66e04e3f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:01.877647 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-1be7db39-13cb-43ca-abfe-3b66e04e3f84 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:43:01.879443 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-1be7db39-13cb-43ca-abfe-3b66e04e3f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:43:01.903965 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:01.907674 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c991ed5-f5ff-4670-aba5-73a29f80bf92 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:01.941279 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88e93e9-c1e1-41ac-8d6a-69dbef1beed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:01.941888 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88e93e9-c1e1-41ac-8d6a-69dbef1beed8 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:01.942161 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88e93e9-c1e1-41ac-8d6a-69dbef1beed8 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:01.942427 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88e93e9-c1e1-41ac-8d6a-69dbef1beed8 None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:01.943114 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88e93e9-c1e1-41ac-8d6a-69dbef1beed8 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:01.943408 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88e93e9-c1e1-41ac-8d6a-69dbef1beed8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:01.944835 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88e93e9-c1e1-41ac-8d6a-69dbef1beed8 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:01.957058 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 492/980] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:43:01 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:43:01.957906 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be7db39-13cb-43ca-abfe-3b66e04e3f84 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:01.981098 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 489/981] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Sep 19 14:43:01 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:01.981098 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88e93e9-c1e1-41ac-8d6a-69dbef1beed8 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:02.021412 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:02.103721 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88e93e9-c1e1-41ac-8d6a-69dbef1beed8 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:02.125384 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be7db39-13cb-43ca-abfe-3b66e04e3f84 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:02.141224 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe0dfe8-acd4-4e76-82ac-670013db7f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:02.142011 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe0dfe8-acd4-4e76-82ac-670013db7f54 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:02.142558 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe0dfe8-acd4-4e76-82ac-670013db7f54 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:02.142714 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe0dfe8-acd4-4e76-82ac-670013db7f54 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:02.143396 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe0dfe8-acd4-4e76-82ac-670013db7f54 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:02.144880 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe0dfe8-acd4-4e76-82ac-670013db7f54 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:02.157159 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-dbe0dfe8-acd4-4e76-82ac-670013db7f54 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 19 14:43:02.157159 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:02.157159 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 14:43:02.157159 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 14:43:02.157159 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 14:43:02.157159 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 14:43:02.157159 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 14:43:02.157159 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:43:02.157159 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 19 14:43:02.157159 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:43:02.157159 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 14:43:02.157159 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:43:02.157159 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:02.157159 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:02.157159 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:02.157159 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:02.157159 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:02.158440 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:02.158440 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:02.158440 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:02.158440 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:02.158440 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:02.158440 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:02.158440 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 14:43:02.158440 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 14:43:02.158440 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 14:43:02.158440 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 14:43:02.158440 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:02.158440 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:02.158440 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:02.158440 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:02.158440 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:02.158440 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:02.159465 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:02.159465 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:02.159465 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:02.159465 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:02.159465 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:02.159465 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:02.159465 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:02.159465 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:02.159465 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:02.159465 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:02.159465 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 14:43:02.159465 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:43:02.159465 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 19 14:43:02.159465 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:43:02.167521 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 490/982] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 19 14:43:01 2022] GET /identity/v3/services/compute => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:43:02.169719 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe0dfe8-acd4-4e76-82ac-670013db7f54 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:02.178089 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d665f446-d936-4461-b2e4-d807e159cc95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:02.178734 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d665f446-d936-4461-b2e4-d807e159cc95 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:02.179005 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d665f446-d936-4461-b2e4-d807e159cc95 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:02.179272 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d665f446-d936-4461-b2e4-d807e159cc95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:02.197498 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d665f446-d936-4461-b2e4-d807e159cc95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:02.199653 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d665f446-d936-4461-b2e4-d807e159cc95 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:02.226411 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-d665f446-d936-4461-b2e4-d807e159cc95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:43:02.226411 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:02.226411 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:02.226411 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:02.226411 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:02.226411 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:02.226411 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:02.226411 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:02.226411 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:02.226411 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:02.226411 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:02.226411 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:02.226411 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:43:02.226411 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:43:02.226411 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:43:02.226411 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:43:02.227736 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:02.227736 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:02.227736 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:02.227736 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:02.227736 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:02.227736 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:02.227736 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:02.227736 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:02.227736 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:02.227736 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:02.227736 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:02.227736 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:02.227736 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:02.227736 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:02.227736 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:02.227736 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:02.227736 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:43:02.229997 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:43:02.229997 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:43:02.229997 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:43:02.229997 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 493/983] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:43:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:43:02.229997 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d665f446-d936-4461-b2e4-d807e159cc95 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:02.242306 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:02.281950 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:02.304460 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe0dfe8-acd4-4e76-82ac-670013db7f54 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:02.340595 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f797bd3d-4c44-4127-b317-1c818eb1d5a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:02.341587 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797bd3d-4c44-4127-b317-1c818eb1d5a2 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:02.341862 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797bd3d-4c44-4127-b317-1c818eb1d5a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:02.342155 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797bd3d-4c44-4127-b317-1c818eb1d5a2 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:02.342777 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f797bd3d-4c44-4127-b317-1c818eb1d5a2 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:02.343076 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f797bd3d-4c44-4127-b317-1c818eb1d5a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:02.344459 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f797bd3d-4c44-4127-b317-1c818eb1d5a2 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:02.346527 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d665f446-d936-4461-b2e4-d807e159cc95 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:02.349724 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 491/984] 10.222.0.26 () {56 vars in 1112 bytes} [Mon Sep 19 14:43:02 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:02.350345 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f797bd3d-4c44-4127-b317-1c818eb1d5a2 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:02.381010 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7556730-9e53-4b78-9786-ddf39f6371eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:02.381666 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7556730-9e53-4b78-9786-ddf39f6371eb None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:02.381943 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7556730-9e53-4b78-9786-ddf39f6371eb None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:02.382361 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7556730-9e53-4b78-9786-ddf39f6371eb None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:02.382950 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7556730-9e53-4b78-9786-ddf39f6371eb None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:02.384670 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7556730-9e53-4b78-9786-ddf39f6371eb None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:02.393401 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-d7556730-9e53-4b78-9786-ddf39f6371eb None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 14:43:02.393401 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:02.393401 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 14:43:02.393401 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 14:43:02.393401 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 14:43:02.393401 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 14:43:02.393401 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 14:43:02.393401 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:43:02.393401 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 14:43:02.393401 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:43:02.393401 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 14:43:02.393401 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:43:02.393401 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:02.393401 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:02.393401 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:02.393401 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:02.393401 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:02.394432 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:02.394432 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:02.394432 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:02.394432 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:02.394432 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:02.394432 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:02.394432 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 14:43:02.394432 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 14:43:02.394432 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 14:43:02.394432 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 14:43:02.394432 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:02.394432 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:02.394432 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:02.394432 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:02.394432 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:02.394432 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:02.395254 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:02.395254 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:02.395254 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:02.395254 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:02.395254 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:02.395254 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:02.395254 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:02.395254 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:02.395254 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:02.395254 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:02.395254 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 14:43:02.395254 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:43:02.395254 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 14:43:02.395254 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:43:02.395254 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 494/985] 10.222.0.26 () {56 vars in 1126 bytes} [Mon Sep 19 14:43:02 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:43:02.396066 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7556730-9e53-4b78-9786-ddf39f6371eb None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:02.452424 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f797bd3d-4c44-4127-b317-1c818eb1d5a2 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:02.466221 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:02.486333 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681ab1b5-ecfe-436c-bf51-b81e91431744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:02.486939 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ab1b5-ecfe-436c-bf51-b81e91431744 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:02.487216 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ab1b5-ecfe-436c-bf51-b81e91431744 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:02.487532 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ab1b5-ecfe-436c-bf51-b81e91431744 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:02.488222 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681ab1b5-ecfe-436c-bf51-b81e91431744 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:02.488714 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681ab1b5-ecfe-436c-bf51-b81e91431744 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:02.490468 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681ab1b5-ecfe-436c-bf51-b81e91431744 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:02.498232 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7556730-9e53-4b78-9786-ddf39f6371eb None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:02.502912 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 492/986] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 19 14:43:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:02.503713 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681ab1b5-ecfe-436c-bf51-b81e91431744 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:02.506248 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:02.535369 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc2b118-2948-4c37-b569-7121f1a1904e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:02.535974 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc2b118-2948-4c37-b569-7121f1a1904e None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:02.536250 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc2b118-2948-4c37-b569-7121f1a1904e None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:02.536539 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc2b118-2948-4c37-b569-7121f1a1904e None admin] PATH_INFO: `/v3/services` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:02.537186 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc2b118-2948-4c37-b569-7121f1a1904e None admin] RBAC: Adding query filter params (type=compute) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:02.537485 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc2b118-2948-4c37-b569-7121f1a1904e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:02.538850 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc2b118-2948-4c37-b569-7121f1a1904e None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:02.543705 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 495/987] 10.222.0.26 () {56 vars in 1112 bytes} [Mon Sep 19 14:43:02 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:02.544493 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc2b118-2948-4c37-b569-7121f1a1904e None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:02.613359 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681ab1b5-ecfe-436c-bf51-b81e91431744 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:02.647043 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c909007-f3e9-4990-9af1-6d51c3b2b2fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:02.647276 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc2b118-2948-4c37-b569-7121f1a1904e None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:02.647635 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c909007-f3e9-4990-9af1-6d51c3b2b2fd None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:02.647910 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c909007-f3e9-4990-9af1-6d51c3b2b2fd None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:02.648202 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c909007-f3e9-4990-9af1-6d51c3b2b2fd None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:02.648817 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c909007-f3e9-4990-9af1-6d51c3b2b2fd None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:02.649203 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c909007-f3e9-4990-9af1-6d51c3b2b2fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:02.650587 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c909007-f3e9-4990-9af1-6d51c3b2b2fd None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:02.655522 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 493/988] 10.222.0.26 () {56 vars in 1122 bytes} [Mon Sep 19 14:43:02 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:02.656129 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c909007-f3e9-4990-9af1-6d51c3b2b2fd None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:02.682803 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc78bf26-47d0-42e5-b8af-ef1dd6e2f096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:02.683440 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc78bf26-47d0-42e5-b8af-ef1dd6e2f096 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:02.683716 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc78bf26-47d0-42e5-b8af-ef1dd6e2f096 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:02.683986 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc78bf26-47d0-42e5-b8af-ef1dd6e2f096 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:02.685930 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:02.692128 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc78bf26-47d0-42e5-b8af-ef1dd6e2f096 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:02.693761 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc78bf26-47d0-42e5-b8af-ef1dd6e2f096 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:02.705373 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-dc78bf26-47d0-42e5-b8af-ef1dd6e2f096 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:43:02.705373 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:02.705373 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:02.705373 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:02.705373 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:02.705373 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:02.705373 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:02.705373 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:02.705373 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:02.705373 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:02.705373 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:02.705373 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:02.705373 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:43:02.705373 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:43:02.705373 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:43:02.706348 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:43:02.706348 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:02.706348 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:02.706348 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:02.706348 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:02.706348 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:02.706348 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:02.706348 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:02.706348 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:02.706348 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:02.706348 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:02.706348 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:02.706348 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:02.706348 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:02.706348 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:02.706348 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:02.706348 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:02.707236 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:43:02.707236 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:43:02.707236 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:43:02.707236 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:43:02.707236 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:43:02.707236 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:43:02.707236 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:43:02.707236 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:43:02.707236 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 496/989] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 19 14:43:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:43:02.707718 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc78bf26-47d0-42e5-b8af-ef1dd6e2f096 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:02.724926 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:02.760553 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c909007-f3e9-4990-9af1-6d51c3b2b2fd None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:02.794512 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09554f5b-83b8-44df-8cfa-b681273b1f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:02.795114 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09554f5b-83b8-44df-8cfa-b681273b1f72 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:02.795388 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09554f5b-83b8-44df-8cfa-b681273b1f72 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:02.795677 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09554f5b-83b8-44df-8cfa-b681273b1f72 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:02.796381 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09554f5b-83b8-44df-8cfa-b681273b1f72 None admin] RBAC: Adding query filter params (interface=public, service_id=c753114c95c14789b6c80902d78ab639, region_id=RegionOne) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:02.796695 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09554f5b-83b8-44df-8cfa-b681273b1f72 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:02.798129 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09554f5b-83b8-44df-8cfa-b681273b1f72 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:02.803110 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 494/990] 10.222.0.26 () {56 vars in 1251 bytes} [Mon Sep 19 14:43:02 2022] GET /identity/v3/endpoints?service_id=c753114c95c14789b6c80902d78ab639&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:02.803902 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09554f5b-83b8-44df-8cfa-b681273b1f72 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:02.809319 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc78bf26-47d0-42e5-b8af-ef1dd6e2f096 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:02.844668 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e529bd-f03e-412b-bb18-b278afa9aa80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:02.845300 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e529bd-f03e-412b-bb18-b278afa9aa80 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:02.845578 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e529bd-f03e-412b-bb18-b278afa9aa80 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:02.845841 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e529bd-f03e-412b-bb18-b278afa9aa80 None admin] PATH_INFO: `/v3/services` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:02.846465 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e529bd-f03e-412b-bb18-b278afa9aa80 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:02.846761 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e529bd-f03e-412b-bb18-b278afa9aa80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:02.848115 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e529bd-f03e-412b-bb18-b278afa9aa80 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:02.853395 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 497/991] 10.222.0.26 () {56 vars in 1122 bytes} [Mon Sep 19 14:43:02 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:02.854224 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e529bd-f03e-412b-bb18-b278afa9aa80 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:02.904592 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09554f5b-83b8-44df-8cfa-b681273b1f72 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:02.914186 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:02.935483 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:02.942446 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a7a00b-421b-47b0-9c70-c617e970068e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:02.943054 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a7a00b-421b-47b0-9c70-c617e970068e None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:02.943331 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a7a00b-421b-47b0-9c70-c617e970068e None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:02.943596 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a7a00b-421b-47b0-9c70-c617e970068e None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:02.944288 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a7a00b-421b-47b0-9c70-c617e970068e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:02.944589 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a7a00b-421b-47b0-9c70-c617e970068e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:02.946319 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a7a00b-421b-47b0-9c70-c617e970068e None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:02.956641 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e529bd-f03e-412b-bb18-b278afa9aa80 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:02.958551 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 495/992] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 19 14:43:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:02.959332 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a7a00b-421b-47b0-9c70-c617e970068e None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:02.992235 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282b0415-a559-4faa-b4a7-eed9240e630d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:02.992910 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b0415-a559-4faa-b4a7-eed9240e630d None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:02.993806 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b0415-a559-4faa-b4a7-eed9240e630d None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:02.994086 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b0415-a559-4faa-b4a7-eed9240e630d None admin] PATH_INFO: `/v3/services` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:02.994701 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282b0415-a559-4faa-b4a7-eed9240e630d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:02.996076 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282b0415-a559-4faa-b4a7-eed9240e630d None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:03.002960 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 498/993] 10.222.0.26 () {56 vars in 1087 bytes} [Mon Sep 19 14:43:02 2022] GET /identity/v3/services => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:43:03.003687 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282b0415-a559-4faa-b4a7-eed9240e630d None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:03.081248 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a7a00b-421b-47b0-9c70-c617e970068e None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:03.121669 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8142a73-3900-4d01-8a7c-9322b9871162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:03.122274 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8142a73-3900-4d01-8a7c-9322b9871162 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:03.122545 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8142a73-3900-4d01-8a7c-9322b9871162 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:03.122814 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8142a73-3900-4d01-8a7c-9322b9871162 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:03.123598 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8142a73-3900-4d01-8a7c-9322b9871162 None admin] RBAC: Adding query filter params (interface=admin, service_id=aea87a4eb3c8450d854866004e4fc85f, region_id=RegionOne) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:03.123837 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8142a73-3900-4d01-8a7c-9322b9871162 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:03.125273 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8142a73-3900-4d01-8a7c-9322b9871162 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:03.135960 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 496/994] 10.222.0.26 () {56 vars in 1249 bytes} [Mon Sep 19 14:43:02 2022] GET /identity/v3/endpoints?service_id=aea87a4eb3c8450d854866004e4fc85f&interface=admin®ion_id=RegionOne => generated 193 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:03.136173 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282b0415-a559-4faa-b4a7-eed9240e630d None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:03.137508 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8142a73-3900-4d01-8a7c-9322b9871162 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:03.161897 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:03.176516 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa6921d-5a24-4c99-95c6-45d0d7ec873a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:03.177160 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa6921d-5a24-4c99-95c6-45d0d7ec873a None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:03.177430 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa6921d-5a24-4c99-95c6-45d0d7ec873a None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:03.177774 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa6921d-5a24-4c99-95c6-45d0d7ec873a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:03.178511 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa6921d-5a24-4c99-95c6-45d0d7ec873a None admin] RBAC: Adding query filter params (role.id=0b146dd606ac4c25bd6a33070856e1a2, scope.project.id=9ede5dc59ece4d9282867a99e94c4c41, user.id=2c2b1ac1a17c43d28da8f7e9a199dea4) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:03.178808 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa6921d-5a24-4c99-95c6-45d0d7ec873a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:03.181203 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa6921d-5a24-4c99-95c6-45d0d7ec873a None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:03.188165 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 499/995] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 19 14:43:03 2022] GET /identity/v3/role_assignments?user.id=2c2b1ac1a17c43d28da8f7e9a199dea4&scope.project.id=9ede5dc59ece4d9282867a99e94c4c41&role.id=0b146dd606ac4c25bd6a33070856e1a2 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:03.201552 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:03.254899 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8142a73-3900-4d01-8a7c-9322b9871162 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:03.294412 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad65515-43b4-4502-9151-24b31034ff6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:03.295033 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad65515-43b4-4502-9151-24b31034ff6e None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:03.295304 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad65515-43b4-4502-9151-24b31034ff6e None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:03.295567 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad65515-43b4-4502-9151-24b31034ff6e None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:03.296169 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad65515-43b4-4502-9151-24b31034ff6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:03.297610 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad65515-43b4-4502-9151-24b31034ff6e None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:03.304596 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 497/996] 10.222.0.26 () {56 vars in 1087 bytes} [Mon Sep 19 14:43:03 2022] GET /identity/v3/services => generated 1727 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:43:05.251202 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df8a9e5-2241-460f-9040-7c0771736038 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:05.251708 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df8a9e5-2241-460f-9040-7c0771736038 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:05.251708 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df8a9e5-2241-460f-9040-7c0771736038 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:05.253142 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 500/997] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:43:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:43:05.258863 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad0013-1b06-48fb-b649-ef1e7bd2ffad None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:05.259568 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad0013-1b06-48fb-b649-ef1e7bd2ffad None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:05.259848 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad0013-1b06-48fb-b649-ef1e7bd2ffad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:05.280205 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-fbad0013-1b06-48fb-b649-ef1e7bd2ffad None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:43:05.281474 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-fbad0013-1b06-48fb-b649-ef1e7bd2ffad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:43:05.363232 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 498/998] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:43:05 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:43:05.407607 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b575c145-ff89-4f56-b79f-7c2c3e482484 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:05.407968 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b575c145-ff89-4f56-b79f-7c2c3e482484 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:05.408128 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b575c145-ff89-4f56-b79f-7c2c3e482484 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:05.409772 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 501/999] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:43:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:43:05.415163 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba3afe-eedf-4e1b-a92b-2a7c2269533f None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:05.415408 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba3afe-eedf-4e1b-a92b-2a7c2269533f None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:05.415703 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba3afe-eedf-4e1b-a92b-2a7c2269533f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:05.435928 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4579336-2815-4549-af21-efe7378a8116 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:05.436127 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-79ba3afe-eedf-4e1b-a92b-2a7c2269533f None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:43:05.436207 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4579336-2815-4549-af21-efe7378a8116 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:05.436422 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4579336-2815-4549-af21-efe7378a8116 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:05.437412 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-79ba3afe-eedf-4e1b-a92b-2a7c2269533f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:43:05.437977 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 502/1000] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:43:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 14:43:05.442909 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d183c0-f703-40ab-af72-ac1745812cf4 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:05.443189 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d183c0-f703-40ab-af72-ac1745812cf4 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:05.443457 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d183c0-f703-40ab-af72-ac1745812cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:05.462328 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-19d183c0-f703-40ab-af72-ac1745812cf4 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:43:05.463524 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-19d183c0-f703-40ab-af72-ac1745812cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:43:05.489867 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:05.516089 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 499/1001] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:43:05 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:43:05.535550 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 503/1002] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:43:05 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 14:43:05.634227 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ba3afe-eedf-4e1b-a92b-2a7c2269533f None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:05.741779 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ba3afe-eedf-4e1b-a92b-2a7c2269533f None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:05.777092 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b00379-dad1-426e-ad35-4e4206e901aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:05.777658 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b00379-dad1-426e-ad35-4e4206e901aa None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:05.777946 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b00379-dad1-426e-ad35-4e4206e901aa None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:05.778213 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b00379-dad1-426e-ad35-4e4206e901aa None admin] PATH_INFO: `/v3/services/compute` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:05.778790 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b00379-dad1-426e-ad35-4e4206e901aa None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:05.780160 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b00379-dad1-426e-ad35-4e4206e901aa None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:05.784001 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d183c0-f703-40ab-af72-ac1745812cf4 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:05.790899 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-d5b00379-dad1-426e-ad35-4e4206e901aa None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 19 14:43:05.790899 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:05.790899 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 14:43:05.790899 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 14:43:05.790899 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 14:43:05.790899 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 14:43:05.790899 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 14:43:05.790899 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:43:05.790899 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 19 14:43:05.790899 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:43:05.790899 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 14:43:05.790899 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:43:05.790899 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:05.790899 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:05.790899 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:05.790899 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:05.790899 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:05.791921 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:05.791921 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:05.791921 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:05.791921 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:05.791921 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:05.791921 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:05.791921 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 14:43:05.791921 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 14:43:05.791921 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 14:43:05.791921 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 14:43:05.791921 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:05.791921 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:05.791921 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:05.791921 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:05.791921 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:05.791921 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:05.798057 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:05.798057 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:05.798057 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:05.798057 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:05.798057 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:05.798057 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:05.798057 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:05.798057 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:05.798057 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:05.798057 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:05.798057 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 14:43:05.798057 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:43:05.798057 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 19 14:43:05.798057 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:43:05.798057 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 500/1003] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 19 14:43:05 2022] GET /identity/v3/services/compute => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:43:05.799064 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b00379-dad1-426e-ad35-4e4206e901aa None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:05.841809 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:05.885078 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d183c0-f703-40ab-af72-ac1745812cf4 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:05.898854 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b00379-dad1-426e-ad35-4e4206e901aa None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:05.901131 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:05.918841 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06d05f5-bf76-42ab-b547-55a198bf337d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:05.919485 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d05f5-bf76-42ab-b547-55a198bf337d None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:05.919762 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d05f5-bf76-42ab-b547-55a198bf337d None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:05.920033 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d05f5-bf76-42ab-b547-55a198bf337d None admin] PATH_INFO: `/v3/services/image` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:05.920616 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06d05f5-bf76-42ab-b547-55a198bf337d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:05.922033 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06d05f5-bf76-42ab-b547-55a198bf337d None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:05.931178 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-b06d05f5-bf76-42ab-b547-55a198bf337d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 19 14:43:05.931178 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:05.931178 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 14:43:05.931178 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 14:43:05.931178 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 14:43:05.931178 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 14:43:05.931178 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 14:43:05.931178 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:43:05.931178 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 19 14:43:05.931178 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:43:05.931178 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 14:43:05.931178 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:43:05.931178 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:05.931178 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:05.931178 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:05.931178 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:05.931178 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:05.932360 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:05.932360 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:05.932360 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:05.932360 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:05.932360 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:05.932360 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:05.932360 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 14:43:05.932360 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 14:43:05.932360 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 14:43:05.932360 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 14:43:05.932360 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:05.932360 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:05.932360 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:05.932360 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:05.932360 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:05.932360 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:05.933385 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:05.933385 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:05.933385 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:05.933385 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:05.933385 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:05.933385 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:05.933385 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:05.933385 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:05.933385 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:05.933385 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:05.933385 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 14:43:05.933385 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:43:05.933385 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 19 14:43:05.933385 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:43:05.934173 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416cdf59-28ba-46a5-8319-3ba7d399efb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:05.934173 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416cdf59-28ba-46a5-8319-3ba7d399efb8 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:05.934335 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 504/1004] 10.222.0.26 () {56 vars in 1105 bytes} [Mon Sep 19 14:43:05 2022] GET /identity/v3/services/image => generated 86 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:43:05.934335 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06d05f5-bf76-42ab-b547-55a198bf337d None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:05.935592 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416cdf59-28ba-46a5-8319-3ba7d399efb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:05.936102 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416cdf59-28ba-46a5-8319-3ba7d399efb8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:05.936699 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416cdf59-28ba-46a5-8319-3ba7d399efb8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:05.938117 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416cdf59-28ba-46a5-8319-3ba7d399efb8 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:05.947186 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-416cdf59-28ba-46a5-8319-3ba7d399efb8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 14:43:05.947186 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:05.947186 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 14:43:05.947186 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 14:43:05.947186 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 14:43:05.947186 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 14:43:05.947186 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 14:43:05.947186 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:43:05.947186 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 14:43:05.947186 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:43:05.947186 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 14:43:05.947186 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:43:05.947186 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:05.947186 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:05.947186 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:05.947186 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:05.947186 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:05.948216 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:05.948216 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:05.948216 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:05.948216 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:05.948216 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:05.948216 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:05.948216 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 14:43:05.948216 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 14:43:05.948216 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 14:43:05.948216 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 14:43:05.948216 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:05.948216 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:05.948216 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:05.948216 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:05.948216 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:05.948216 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:05.949239 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:05.949239 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:05.949239 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:05.949239 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:05.949239 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:05.949239 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:05.949239 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:05.949239 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:05.949239 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:05.949239 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:05.949239 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 14:43:05.949239 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:43:05.949239 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 14:43:05.949239 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:43:05.949239 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 501/1005] 10.222.0.26 () {56 vars in 1126 bytes} [Mon Sep 19 14:43:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:43:05.950291 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416cdf59-28ba-46a5-8319-3ba7d399efb8 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:06.037800 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06d05f5-bf76-42ab-b547-55a198bf337d None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:06.056136 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416cdf59-28ba-46a5-8319-3ba7d399efb8 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:06.063007 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:06.074101 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c569beca-d524-4878-b226-4a1354342bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:06.074708 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c569beca-d524-4878-b226-4a1354342bcc None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:06.075004 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c569beca-d524-4878-b226-4a1354342bcc None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:06.075244 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c569beca-d524-4878-b226-4a1354342bcc None admin] PATH_INFO: `/v3/services` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:06.075870 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c569beca-d524-4878-b226-4a1354342bcc None admin] RBAC: Adding query filter params (name=compute) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:06.076165 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c569beca-d524-4878-b226-4a1354342bcc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:06.077581 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c569beca-d524-4878-b226-4a1354342bcc None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:06.082596 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 505/1006] 10.222.0.26 () {56 vars in 1112 bytes} [Mon Sep 19 14:43:05 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:06.083379 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c569beca-d524-4878-b226-4a1354342bcc None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:06.092635 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc33cc5-b07b-4f56-b614-d2633f9f7011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:06.093270 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc33cc5-b07b-4f56-b614-d2633f9f7011 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:06.093551 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc33cc5-b07b-4f56-b614-d2633f9f7011 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:06.093821 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc33cc5-b07b-4f56-b614-d2633f9f7011 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:06.094448 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc33cc5-b07b-4f56-b614-d2633f9f7011 None admin] RBAC: Adding query filter params (name=image) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:06.094750 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc33cc5-b07b-4f56-b614-d2633f9f7011 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:06.096123 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc33cc5-b07b-4f56-b614-d2633f9f7011 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:06.100846 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 502/1007] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:43:05 2022] GET /identity/v3/services?name=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:06.101640 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc33cc5-b07b-4f56-b614-d2633f9f7011 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:06.139041 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:06.195069 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c569beca-d524-4878-b226-4a1354342bcc None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:06.204288 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc33cc5-b07b-4f56-b614-d2633f9f7011 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:06.229325 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4e4bdd-7369-4c44-be63-03a29f23712e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:06.229935 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e4bdd-7369-4c44-be63-03a29f23712e None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:06.230208 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e4bdd-7369-4c44-be63-03a29f23712e None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:06.230475 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e4bdd-7369-4c44-be63-03a29f23712e None admin] PATH_INFO: `/v3/services` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:06.231128 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4e4bdd-7369-4c44-be63-03a29f23712e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:06.231442 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4e4bdd-7369-4c44-be63-03a29f23712e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:06.232844 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4e4bdd-7369-4c44-be63-03a29f23712e None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:06.237766 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 506/1008] 10.222.0.26 () {56 vars in 1122 bytes} [Mon Sep 19 14:43:06 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:06.238385 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5111ad-bbef-4b3f-ab77-998368160950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:06.238522 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4e4bdd-7369-4c44-be63-03a29f23712e None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:06.239069 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5111ad-bbef-4b3f-ab77-998368160950 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:06.239354 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5111ad-bbef-4b3f-ab77-998368160950 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:06.239626 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5111ad-bbef-4b3f-ab77-998368160950 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:06.240251 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5111ad-bbef-4b3f-ab77-998368160950 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:06.240555 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5111ad-bbef-4b3f-ab77-998368160950 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:06.241962 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5111ad-bbef-4b3f-ab77-998368160950 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:06.247680 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 503/1009] 10.222.0.26 () {56 vars in 1112 bytes} [Mon Sep 19 14:43:06 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:06.248358 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5111ad-bbef-4b3f-ab77-998368160950 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:06.282734 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:06.343361 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4e4bdd-7369-4c44-be63-03a29f23712e None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:06.349875 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5111ad-bbef-4b3f-ab77-998368160950 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:06.352560 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:06.379189 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bd747f-cf49-45b8-bb69-aa5c1e2b4b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:06.379791 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd747f-cf49-45b8-bb69-aa5c1e2b4b41 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:06.380070 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd747f-cf49-45b8-bb69-aa5c1e2b4b41 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:06.380322 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd747f-cf49-45b8-bb69-aa5c1e2b4b41 None admin] PATH_INFO: `/v3/services` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:06.380951 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bd747f-cf49-45b8-bb69-aa5c1e2b4b41 None admin] RBAC: Adding query filter params (type=image) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:06.381284 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bd747f-cf49-45b8-bb69-aa5c1e2b4b41 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:06.382648 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bd747f-cf49-45b8-bb69-aa5c1e2b4b41 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:06.384666 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d908c8-2d17-4c46-900f-e6f0e42c2dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:06.385301 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d908c8-2d17-4c46-900f-e6f0e42c2dca None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:06.385573 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d908c8-2d17-4c46-900f-e6f0e42c2dca None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:06.385834 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d908c8-2d17-4c46-900f-e6f0e42c2dca None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:06.386444 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d908c8-2d17-4c46-900f-e6f0e42c2dca None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:06.386735 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d908c8-2d17-4c46-900f-e6f0e42c2dca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:06.387233 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 507/1010] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:43:06 2022] GET /identity/v3/services?type=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:06.387991 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bd747f-cf49-45b8-bb69-aa5c1e2b4b41 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:06.388089 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d908c8-2d17-4c46-900f-e6f0e42c2dca None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:06.406102 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 504/1011] 10.222.0.26 () {56 vars in 1122 bytes} [Mon Sep 19 14:43:06 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:06.412236 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d908c8-2d17-4c46-900f-e6f0e42c2dca None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:06.514748 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bd747f-cf49-45b8-bb69-aa5c1e2b4b41 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:06.519412 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:06.523407 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d908c8-2d17-4c46-900f-e6f0e42c2dca None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:06.555418 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08afcf1b-b9b2-4fd3-8f0c-3399c8d2fc9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:06.556273 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08afcf1b-b9b2-4fd3-8f0c-3399c8d2fc9d None admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:06.556606 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08afcf1b-b9b2-4fd3-8f0c-3399c8d2fc9d None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:06.556934 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08afcf1b-b9b2-4fd3-8f0c-3399c8d2fc9d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:06.557705 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08afcf1b-b9b2-4fd3-8f0c-3399c8d2fc9d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:06.559101 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08afcf1b-b9b2-4fd3-8f0c-3399c8d2fc9d None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:06.564429 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c76ac3c-905e-4d42-b0fa-99e2179078f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:06.565079 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c76ac3c-905e-4d42-b0fa-99e2179078f2 None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:06.565353 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c76ac3c-905e-4d42-b0fa-99e2179078f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:06.566162 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c76ac3c-905e-4d42-b0fa-99e2179078f2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:06.566291 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c76ac3c-905e-4d42-b0fa-99e2179078f2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:06.567612 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c76ac3c-905e-4d42-b0fa-99e2179078f2 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:06.584424 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 508/1012] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 14:43:06 2022] POST /identity/v3/endpoints => generated 334 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:43:06.593024 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 505/1013] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 14:43:06 2022] POST /identity/v3/endpoints => generated 325 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 14:43:08.576339 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14569b5-256f-4cf6-847c-45a1d472707a None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:08.576898 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14569b5-256f-4cf6-847c-45a1d472707a None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:08.576898 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14569b5-256f-4cf6-847c-45a1d472707a None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:08.578487 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 509/1014] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:43:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:43:08.583899 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95b827b-b849-4043-a226-52d529527ba1 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:08.584388 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95b827b-b849-4043-a226-52d529527ba1 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:08.584486 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95b827b-b849-4043-a226-52d529527ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:08.603786 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-c95b827b-b849-4043-a226-52d529527ba1 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:43:08.604976 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-c95b827b-b849-4043-a226-52d529527ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:43:08.692494 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 506/1015] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:43:08 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:43:08.806591 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563003ff-f406-43fa-9886-4de779ab658b None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:08.807068 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563003ff-f406-43fa-9886-4de779ab658b None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:08.807487 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563003ff-f406-43fa-9886-4de779ab658b None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:08.809832 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 510/1016] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:43:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:43:08.815351 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b014c-f317-43f1-9a95-b08138786b33 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:08.815596 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b014c-f317-43f1-9a95-b08138786b33 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:08.815872 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b014c-f317-43f1-9a95-b08138786b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:08.837124 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-873b014c-f317-43f1-9a95-b08138786b33 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:43:08.838363 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-873b014c-f317-43f1-9a95-b08138786b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:43:08.890964 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac1bd55-86af-435f-92f0-90346aca10c8 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:08.891341 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac1bd55-86af-435f-92f0-90346aca10c8 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:08.891502 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac1bd55-86af-435f-92f0-90346aca10c8 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:08.892813 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 511/1017] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:43:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:43:08.898725 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2be77d2-8da2-46e1-a2a6-4ba4bd83fac8 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:08.899082 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2be77d2-8da2-46e1-a2a6-4ba4bd83fac8 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:08.899360 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2be77d2-8da2-46e1-a2a6-4ba4bd83fac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:08.920691 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 507/1018] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:43:08 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:43:08.921682 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-e2be77d2-8da2-46e1-a2a6-4ba4bd83fac8 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:43:08.923366 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-e2be77d2-8da2-46e1-a2a6-4ba4bd83fac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:43:08.955778 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:08.969977 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873b014c-f317-43f1-9a95-b08138786b33 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:08.989906 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:09.015756 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 512/1019] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:43:08 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:43:09.095560 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873b014c-f317-43f1-9a95-b08138786b33 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:09.132562 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fac7635-80db-41ad-bc1f-afabd0c63e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:09.133358 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fac7635-80db-41ad-bc1f-afabd0c63e57 None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:09.133795 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fac7635-80db-41ad-bc1f-afabd0c63e57 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:09.134092 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fac7635-80db-41ad-bc1f-afabd0c63e57 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:09.134753 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fac7635-80db-41ad-bc1f-afabd0c63e57 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:09.136099 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fac7635-80db-41ad-bc1f-afabd0c63e57 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:09.154302 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 508/1020] 10.222.0.26 () {60 vars in 1141 bytes} [Mon Sep 19 14:43:08 2022] POST /identity/v3/services => generated 242 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 14:43:09.210385 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2be77d2-8da2-46e1-a2a6-4ba4bd83fac8 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:09.310899 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fac7635-80db-41ad-bc1f-afabd0c63e57 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:09.337938 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2be77d2-8da2-46e1-a2a6-4ba4bd83fac8 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:09.390488 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb315f3-9450-43b7-a81f-304368ddacad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:09.391140 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb315f3-9450-43b7-a81f-304368ddacad None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:09.391413 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb315f3-9450-43b7-a81f-304368ddacad None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:09.391802 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb315f3-9450-43b7-a81f-304368ddacad None admin] PATH_INFO: `/v3/domains/default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:09.392924 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb315f3-9450-43b7-a81f-304368ddacad None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:09.394373 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb315f3-9450-43b7-a81f-304368ddacad None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:09.396096 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 513/1021] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:43:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:09.402169 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb315f3-9450-43b7-a81f-304368ddacad None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:09.408302 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:09.433866 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:09.437376 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fac7635-80db-41ad-bc1f-afabd0c63e57 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:09.475623 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f96b12a-9c6b-40b4-aa69-e16cf1653cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:09.476281 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f96b12a-9c6b-40b4-aa69-e16cf1653cf2 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:09.476543 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f96b12a-9c6b-40b4-aa69-e16cf1653cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:09.476873 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f96b12a-9c6b-40b4-aa69-e16cf1653cf2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:09.489987 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f96b12a-9c6b-40b4-aa69-e16cf1653cf2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:43:09.496602 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-6f96b12a-9c6b-40b4-aa69-e16cf1653cf2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 14:43:09.496602 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:09.496602 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:09.496602 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:09.496602 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:09.496602 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:09.496602 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:09.496602 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:09.496602 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:09.496602 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:09.496602 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:09.496602 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:09.496602 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:43:09.496602 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:43:09.496602 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:43:09.496602 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:43:09.497709 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:43:09.497709 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:43:09.497709 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:43:09.497709 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:43:09.497709 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:09.497709 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:09.497709 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:09.497709 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:09.497709 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:09.497709 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:09.497709 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:09.497709 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:09.497709 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:09.497709 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:09.497709 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:09.497709 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:09.499797 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:09.499797 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:09.499797 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:09.499797 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:09.499797 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:43:09.499797 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:43:09.499797 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:43:09.499797 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:43:09.499797 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:43:09.499797 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:43:09.499797 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 14:43:09.499797 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:43:09.499797 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 509/1022] 10.222.0.26 () {56 vars in 1120 bytes} [Mon Sep 19 14:43:09 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:43:09.506379 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f96b12a-9c6b-40b4-aa69-e16cf1653cf2 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:09.530906 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb315f3-9450-43b7-a81f-304368ddacad None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:09.570224 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706a3869-9646-4422-92c6-11898b7efd47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:09.571710 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a3869-9646-4422-92c6-11898b7efd47 None admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:09.571861 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a3869-9646-4422-92c6-11898b7efd47 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:09.572195 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a3869-9646-4422-92c6-11898b7efd47 None admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:09.573539 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706a3869-9646-4422-92c6-11898b7efd47 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:09.575199 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706a3869-9646-4422-92c6-11898b7efd47 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:09.609782 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 514/1023] 10.222.0.26 () {60 vars in 1141 bytes} [Mon Sep 19 14:43:09 2022] POST /identity/v3/projects => generated 311 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 14:43:09.647365 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f96b12a-9c6b-40b4-aa69-e16cf1653cf2 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:09.696740 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf5c80f-abef-45af-9600-b2698267c02e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:09.697689 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf5c80f-abef-45af-9600-b2698267c02e None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:09.698153 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf5c80f-abef-45af-9600-b2698267c02e None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:09.698566 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf5c80f-abef-45af-9600-b2698267c02e None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:09.699453 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf5c80f-abef-45af-9600-b2698267c02e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:09.699956 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf5c80f-abef-45af-9600-b2698267c02e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:09.701636 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf5c80f-abef-45af-9600-b2698267c02e None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:09.703581 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:09.719035 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 510/1024] 10.222.0.26 () {56 vars in 1115 bytes} [Mon Sep 19 14:43:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:43:09.720565 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706a3869-9646-4422-92c6-11898b7efd47 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:09.806196 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:09.834409 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706a3869-9646-4422-92c6-11898b7efd47 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:09.872079 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da6f5d0-ae04-401f-8b71-0a26d8ce8b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:09.873054 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da6f5d0-ae04-401f-8b71-0a26d8ce8b9f None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:09.873509 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da6f5d0-ae04-401f-8b71-0a26d8ce8b9f None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:09.873949 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da6f5d0-ae04-401f-8b71-0a26d8ce8b9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:09.885292 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da6f5d0-ae04-401f-8b71-0a26d8ce8b9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:09.886999 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da6f5d0-ae04-401f-8b71-0a26d8ce8b9f None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:09.902192 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-7da6f5d0-ae04-401f-8b71-0a26d8ce8b9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:43:09.902192 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:09.902192 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:09.902192 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:09.902192 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:09.902192 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:09.902192 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:09.902192 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:09.902192 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:09.902192 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:09.902192 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:09.902192 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:09.902192 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:43:09.902192 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:43:09.902192 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:43:09.902192 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:43:09.903144 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:09.903144 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:09.903144 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:09.903144 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:09.903144 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:09.903144 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:09.903144 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:09.903144 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:09.903144 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:09.903144 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:09.903144 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:09.903144 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:09.903144 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:09.903144 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:09.903144 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:09.903144 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:09.903144 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:43:09.904061 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:43:09.904061 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:43:09.904061 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:43:09.905075 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 515/1025] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:43:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:43:09.910571 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf5c80f-abef-45af-9600-b2698267c02e None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:10.019578 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf5c80f-abef-45af-9600-b2698267c02e None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:10.055405 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b501f9e7-2b89-4657-a883-3d2fc915e17d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:10.056007 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b501f9e7-2b89-4657-a883-3d2fc915e17d None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:10.056278 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b501f9e7-2b89-4657-a883-3d2fc915e17d None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:10.056540 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b501f9e7-2b89-4657-a883-3d2fc915e17d None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:10.057207 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b501f9e7-2b89-4657-a883-3d2fc915e17d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:10.057503 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b501f9e7-2b89-4657-a883-3d2fc915e17d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:10.058858 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b501f9e7-2b89-4657-a883-3d2fc915e17d None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:10.071025 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 511/1026] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 19 14:43:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:10.076604 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da6f5d0-ae04-401f-8b71-0a26d8ce8b9f None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:10.180564 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da6f5d0-ae04-401f-8b71-0a26d8ce8b9f None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:10.205404 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:10.215898 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecd11cb-4672-4059-8f08-8a2d64e88718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:10.216502 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecd11cb-4672-4059-8f08-8a2d64e88718 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:10.216774 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecd11cb-4672-4059-8f08-8a2d64e88718 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:10.217061 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecd11cb-4672-4059-8f08-8a2d64e88718 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:10.224564 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecd11cb-4672-4059-8f08-8a2d64e88718 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:10.226014 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecd11cb-4672-4059-8f08-8a2d64e88718 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:10.237131 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-cecd11cb-4672-4059-8f08-8a2d64e88718 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 19 14:43:10.237131 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:10.237131 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:10.237131 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:10.237131 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:10.237131 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:10.237131 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:10.237131 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:10.237131 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:10.237131 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:10.237131 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:10.237131 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:10.237131 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:43:10.237131 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:43:10.237131 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:43:10.237131 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:43:10.238084 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:10.238084 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:10.238084 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:43:10.238084 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:43:10.238084 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:43:10.238084 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:43:10.238084 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:10.238084 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:10.238084 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:10.238084 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:10.238084 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:10.238084 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:10.238084 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:10.238084 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:10.238084 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:10.238084 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:10.238084 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:10.238084 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:10.239008 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:10.239008 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:10.239008 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:43:10.239008 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:43:10.239008 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:43:10.239008 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:43:10.239008 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:43:10.239008 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:43:10.239008 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 19 14:43:10.239008 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:43:10.240286 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 516/1027] 10.222.0.26 () {56 vars in 1093 bytes} [Mon Sep 19 14:43:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:43:10.244069 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b501f9e7-2b89-4657-a883-3d2fc915e17d None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:10.306810 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:10.357524 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b501f9e7-2b89-4657-a883-3d2fc915e17d None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:10.392385 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c06d314-b49a-4237-a218-df8738954609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:10.392982 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c06d314-b49a-4237-a218-df8738954609 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:10.393294 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c06d314-b49a-4237-a218-df8738954609 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:10.393560 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c06d314-b49a-4237-a218-df8738954609 None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:10.394287 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c06d314-b49a-4237-a218-df8738954609 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:10.394586 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c06d314-b49a-4237-a218-df8738954609 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:10.396017 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c06d314-b49a-4237-a218-df8738954609 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:10.419357 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 512/1028] 10.222.0.26 () {56 vars in 1133 bytes} [Mon Sep 19 14:43:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:10.420826 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecd11cb-4672-4059-8f08-8a2d64e88718 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:10.523670 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecd11cb-4672-4059-8f08-8a2d64e88718 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:10.558451 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5924a722-13d0-4910-bac5-a9aaeb0d13a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:10.559065 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5924a722-13d0-4910-bac5-a9aaeb0d13a0 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:10.559341 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5924a722-13d0-4910-bac5-a9aaeb0d13a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:10.559668 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5924a722-13d0-4910-bac5-a9aaeb0d13a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:10.619029 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:10.634129 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5924a722-13d0-4910-bac5-a9aaeb0d13a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:10.635568 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5924a722-13d0-4910-bac5-a9aaeb0d13a0 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:10.730968 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 517/1029] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 19 14:43:10 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 19 14:43:10.736911 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c06d314-b49a-4237-a218-df8738954609 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:10.842225 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c06d314-b49a-4237-a218-df8738954609 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:10.856009 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:10.882555 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f488142-9271-4b3a-8988-a646e33ac07b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:10.883234 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f488142-9271-4b3a-8988-a646e33ac07b None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:10.883509 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f488142-9271-4b3a-8988-a646e33ac07b None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:10.883924 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f488142-9271-4b3a-8988-a646e33ac07b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:10.894620 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f488142-9271-4b3a-8988-a646e33ac07b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:10.896081 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f488142-9271-4b3a-8988-a646e33ac07b None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:10.911376 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-9f488142-9271-4b3a-8988-a646e33ac07b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:43:10.911376 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:10.911376 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:10.911376 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:10.911376 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:10.911376 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:10.911376 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:10.911376 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:10.911376 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:10.911376 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:10.911376 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:10.911376 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:10.911376 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:43:10.911376 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:43:10.911376 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:43:10.911376 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:43:10.912415 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:10.912415 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:10.912415 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:10.912415 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:10.912415 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:10.912415 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:10.912415 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:10.912415 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:10.912415 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:10.912415 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:10.912415 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:10.912415 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:10.912415 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:10.912415 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:10.912415 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:10.912415 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:10.912415 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:43:10.913413 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:43:10.913413 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:43:10.913413 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:43:10.913413 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 513/1030] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:43:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:43:10.918198 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5924a722-13d0-4910-bac5-a9aaeb0d13a0 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:11.013646 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:11.030182 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5924a722-13d0-4910-bac5-a9aaeb0d13a0 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:11.065351 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe651ef-42d9-4926-8b16-5c85eb9484e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:11.065934 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe651ef-42d9-4926-8b16-5c85eb9484e1 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:11.066210 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe651ef-42d9-4926-8b16-5c85eb9484e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:11.066477 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe651ef-42d9-4926-8b16-5c85eb9484e1 None admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:11.067264 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe651ef-42d9-4926-8b16-5c85eb9484e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:11.067564 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe651ef-42d9-4926-8b16-5c85eb9484e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:11.068924 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe651ef-42d9-4926-8b16-5c85eb9484e1 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:11.080695 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 518/1031] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 19 14:43:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:11.086279 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f488142-9271-4b3a-8988-a646e33ac07b None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:11.186766 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f488142-9271-4b3a-8988-a646e33ac07b None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:11.221909 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9d1b22-616c-43c6-83da-7208759faab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:11.222510 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9d1b22-616c-43c6-83da-7208759faab8 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:11.222788 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9d1b22-616c-43c6-83da-7208759faab8 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:11.223071 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9d1b22-616c-43c6-83da-7208759faab8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:11.230301 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9d1b22-616c-43c6-83da-7208759faab8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:11.231761 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9d1b22-616c-43c6-83da-7208759faab8 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:11.244214 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-ed9d1b22-616c-43c6-83da-7208759faab8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:43:11.244214 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:11.244214 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:11.244214 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:11.244214 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:11.244214 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:11.244214 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:11.244214 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:11.244214 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:11.244214 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:11.244214 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:11.244214 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:11.244214 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:43:11.244214 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:43:11.244214 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:43:11.245189 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:43:11.245189 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:11.245189 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:11.245189 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:11.245189 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:11.245189 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:11.245189 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:11.245189 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:11.245189 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:11.245189 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:11.245189 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:11.245189 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:11.245189 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:11.245189 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:11.245189 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:11.245189 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:11.245189 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:11.246205 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:43:11.246205 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:43:11.246205 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:43:11.246205 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:43:11.246205 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:43:11.246205 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:43:11.246205 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:43:11.246205 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:43:11.246205 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 514/1032] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 19 14:43:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:43:11.253034 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe651ef-42d9-4926-8b16-5c85eb9484e1 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:11.363509 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe651ef-42d9-4926-8b16-5c85eb9484e1 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:11.393109 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bd9ac5-4cdf-4b7f-81da-933822d5219d None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:11.393382 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bd9ac5-4cdf-4b7f-81da-933822d5219d None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:11.393651 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bd9ac5-4cdf-4b7f-81da-933822d5219d None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:11.395002 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 515/1033] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:43:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 14:43:11.398034 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ff57d9-e435-4bad-9e2e-9b2aee128273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:11.398946 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ff57d9-e435-4bad-9e2e-9b2aee128273 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:11.399404 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ff57d9-e435-4bad-9e2e-9b2aee128273 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:11.399855 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ff57d9-e435-4bad-9e2e-9b2aee128273 None admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:11.400051 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a382a61-d0ab-46a4-9f0a-3d4302bc625b None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:11.400315 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a382a61-d0ab-46a4-9f0a-3d4302bc625b None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:11.400586 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a382a61-d0ab-46a4-9f0a-3d4302bc625b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:11.401294 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ff57d9-e435-4bad-9e2e-9b2aee128273 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:11.401781 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ff57d9-e435-4bad-9e2e-9b2aee128273 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:11.403467 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ff57d9-e435-4bad-9e2e-9b2aee128273 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:11.421573 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-0a382a61-d0ab-46a4-9f0a-3d4302bc625b None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:43:11.421573 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-0a382a61-d0ab-46a4-9f0a-3d4302bc625b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:43:11.421852 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 519/1034] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 19 14:43:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:11.422787 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ff57d9-e435-4bad-9e2e-9b2aee128273 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:11.431387 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:11.442444 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:11.491154 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 516/1035] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:43:11 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 14:43:11.530822 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ff57d9-e435-4bad-9e2e-9b2aee128273 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:11.566224 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64deb75d-7ea0-40e2-b625-674330a614b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:11.566814 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64deb75d-7ea0-40e2-b625-674330a614b1 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:11.567082 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64deb75d-7ea0-40e2-b625-674330a614b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:11.567346 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64deb75d-7ea0-40e2-b625-674330a614b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:11.568056 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64deb75d-7ea0-40e2-b625-674330a614b1 None admin] RBAC: Adding query filter params (role.id=0b146dd606ac4c25bd6a33070856e1a2, scope.project.id=9ede5dc59ece4d9282867a99e94c4c41, user.id=3017e5d92bef4cc2aeae4f28c78ba233) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:11.568353 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64deb75d-7ea0-40e2-b625-674330a614b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:11.569800 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64deb75d-7ea0-40e2-b625-674330a614b1 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:11.575539 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 520/1036] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 19 14:43:11 2022] GET /identity/v3/role_assignments?user.id=3017e5d92bef4cc2aeae4f28c78ba233&scope.project.id=9ede5dc59ece4d9282867a99e94c4c41&role.id=0b146dd606ac4c25bd6a33070856e1a2 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:11.764026 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a382a61-d0ab-46a4-9f0a-3d4302bc625b None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:11.866232 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a382a61-d0ab-46a4-9f0a-3d4302bc625b None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:11.867672 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa33902-e598-4a15-abf8-d1ceb43f96f1 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:11.868323 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa33902-e598-4a15-abf8-d1ceb43f96f1 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:11.868323 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa33902-e598-4a15-abf8-d1ceb43f96f1 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:11.869763 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 521/1037] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:43:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 14:43:11.874828 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa8c64-bc55-4cf0-a848-c5fdc80cc8dd None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:11.875080 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa8c64-bc55-4cf0-a848-c5fdc80cc8dd None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:11.875372 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa8c64-bc55-4cf0-a848-c5fdc80cc8dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:11.895016 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-3eaa8c64-bc55-4cf0-a848-c5fdc80cc8dd None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:43:11.896360 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-3eaa8c64-bc55-4cf0-a848-c5fdc80cc8dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:43:11.902367 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff90be34-d997-4d91-bd76-f9ae71da6888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:11.903001 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff90be34-d997-4d91-bd76-f9ae71da6888 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:11.903273 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff90be34-d997-4d91-bd76-f9ae71da6888 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:11.903539 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff90be34-d997-4d91-bd76-f9ae71da6888 None admin] PATH_INFO: `/v3/services/image` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:11.904109 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff90be34-d997-4d91-bd76-f9ae71da6888 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:11.905520 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff90be34-d997-4d91-bd76-f9ae71da6888 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:11.914501 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-ff90be34-d997-4d91-bd76-f9ae71da6888 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 19 14:43:11.914501 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:11.914501 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 14:43:11.914501 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 14:43:11.914501 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 14:43:11.914501 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 14:43:11.914501 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 14:43:11.914501 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:43:11.914501 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 19 14:43:11.914501 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:43:11.914501 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 14:43:11.914501 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:43:11.914501 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:11.914501 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:11.914501 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:11.914501 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:11.914501 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:11.915773 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:11.915773 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:11.915773 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:11.915773 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:11.915773 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:11.915773 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:11.915773 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 14:43:11.915773 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 14:43:11.915773 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 14:43:11.915773 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 14:43:11.915773 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:11.915773 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:11.915773 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:11.915773 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:11.915773 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:11.915773 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:11.916923 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:11.916923 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:11.916923 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:11.916923 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:11.916923 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:11.916923 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:11.916923 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:11.916923 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:11.916923 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:11.916923 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:11.916923 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 14:43:11.916923 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:43:11.916923 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 19 14:43:11.916923 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:43:11.920615 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 517/1038] 10.222.0.26 () {56 vars in 1105 bytes} [Mon Sep 19 14:43:11 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:43:11.921796 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff90be34-d997-4d91-bd76-f9ae71da6888 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:11.944284 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:11.966479 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:11.973216 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 522/1039] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:43:11 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 14:43:12.051603 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff90be34-d997-4d91-bd76-f9ae71da6888 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:12.087316 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45446f5c-0c5d-43db-b576-25ca24d6f965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:12.087924 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45446f5c-0c5d-43db-b576-25ca24d6f965 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:12.088191 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45446f5c-0c5d-43db-b576-25ca24d6f965 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:12.088473 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45446f5c-0c5d-43db-b576-25ca24d6f965 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:12.089144 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45446f5c-0c5d-43db-b576-25ca24d6f965 None admin] RBAC: Adding query filter params (name=image) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:12.089447 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45446f5c-0c5d-43db-b576-25ca24d6f965 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:12.091155 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45446f5c-0c5d-43db-b576-25ca24d6f965 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:12.103116 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 518/1040] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:43:11 2022] GET /identity/v3/services?name=image => generated 122 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:43:12.104468 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaa8c64-bc55-4cf0-a848-c5fdc80cc8dd None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:12.204817 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaa8c64-bc55-4cf0-a848-c5fdc80cc8dd None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:12.239470 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f42ada9-6cc0-44a7-8146-25b342d8de24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:12.240071 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f42ada9-6cc0-44a7-8146-25b342d8de24 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:12.240348 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f42ada9-6cc0-44a7-8146-25b342d8de24 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:12.240615 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f42ada9-6cc0-44a7-8146-25b342d8de24 None admin] PATH_INFO: `/v3/services` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:12.241267 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f42ada9-6cc0-44a7-8146-25b342d8de24 None admin] RBAC: Adding query filter params (type=image) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:12.241568 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f42ada9-6cc0-44a7-8146-25b342d8de24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:12.242980 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f42ada9-6cc0-44a7-8146-25b342d8de24 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:12.248232 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 523/1041] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:43:12 2022] GET /identity/v3/services?type=image => generated 350 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:12.254189 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45446f5c-0c5d-43db-b576-25ca24d6f965 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:12.265048 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f42ada9-6cc0-44a7-8146-25b342d8de24 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:12.337364 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:12.349990 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:12.371994 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45446f5c-0c5d-43db-b576-25ca24d6f965 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:12.385913 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f42ada9-6cc0-44a7-8146-25b342d8de24 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:12.407906 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dd27a6-c4a0-4f54-9465-75a0ffd4dfae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:12.408507 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd27a6-c4a0-4f54-9465-75a0ffd4dfae None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:12.408783 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd27a6-c4a0-4f54-9465-75a0ffd4dfae None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:12.409075 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd27a6-c4a0-4f54-9465-75a0ffd4dfae None admin] PATH_INFO: `/v3/endpoints` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:12.409769 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dd27a6-c4a0-4f54-9465-75a0ffd4dfae None admin] RBAC: Adding query filter params (interface=public, service_id=06649fbf7119449699e5ec949cbd848f, region_id=RegionOne) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:12.410079 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dd27a6-c4a0-4f54-9465-75a0ffd4dfae None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:12.411444 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dd27a6-c4a0-4f54-9465-75a0ffd4dfae None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:12.421552 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 519/1042] 10.222.0.26 () {56 vars in 1251 bytes} [Mon Sep 19 14:43:12 2022] GET /identity/v3/endpoints?service_id=06649fbf7119449699e5ec949cbd848f&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:12.422549 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dd27a6-c4a0-4f54-9465-75a0ffd4dfae None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:12.427302 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df35f02-d0a0-4d2c-94aa-089dab093fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:12.427954 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df35f02-d0a0-4d2c-94aa-089dab093fd7 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:12.428229 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df35f02-d0a0-4d2c-94aa-089dab093fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:12.428495 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df35f02-d0a0-4d2c-94aa-089dab093fd7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:12.429598 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df35f02-d0a0-4d2c-94aa-089dab093fd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:12.431110 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df35f02-d0a0-4d2c-94aa-089dab093fd7 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:12.432837 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 524/1043] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:43:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:12.438366 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df35f02-d0a0-4d2c-94aa-089dab093fd7 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:12.542703 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dd27a6-c4a0-4f54-9465-75a0ffd4dfae None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:12.547630 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df35f02-d0a0-4d2c-94aa-089dab093fd7 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:12.580356 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:12.580544 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfe14e8-8d5a-481c-b98c-f5af1ef4437d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:12.581040 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe14e8-8d5a-481c-b98c-f5af1ef4437d None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:12.581683 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe14e8-8d5a-481c-b98c-f5af1ef4437d None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:12.582006 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe14e8-8d5a-481c-b98c-f5af1ef4437d None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:12.582701 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfe14e8-8d5a-481c-b98c-f5af1ef4437d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:12.584246 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfe14e8-8d5a-481c-b98c-f5af1ef4437d None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:12.586111 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73953b1-e859-4931-8933-9f62cfeff0d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:12.587161 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73953b1-e859-4931-8933-9f62cfeff0d3 None admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:12.587754 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73953b1-e859-4931-8933-9f62cfeff0d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:12.588146 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73953b1-e859-4931-8933-9f62cfeff0d3 None admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:12.588808 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73953b1-e859-4931-8933-9f62cfeff0d3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:12.590257 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73953b1-e859-4931-8933-9f62cfeff0d3 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:12.599570 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 520/1044] 10.222.0.26 () {56 vars in 1087 bytes} [Mon Sep 19 14:43:12 2022] GET /identity/v3/services => generated 1957 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 14:43:12.625510 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 525/1045] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Sep 19 14:43:12 2022] POST /identity/v3/users => generated 285 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 14:43:13.711226 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a979cd5e-8dfe-4bd9-ad31-2819a6d97d03 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:13.711814 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a979cd5e-8dfe-4bd9-ad31-2819a6d97d03 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:13.711814 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a979cd5e-8dfe-4bd9-ad31-2819a6d97d03 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:13.713192 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 521/1046] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:43:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:43:13.718969 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205fafbf-f4ab-45c4-800e-8075a9d9248c None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:13.719425 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205fafbf-f4ab-45c4-800e-8075a9d9248c None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:13.719512 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205fafbf-f4ab-45c4-800e-8075a9d9248c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:13.737938 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-205fafbf-f4ab-45c4-800e-8075a9d9248c None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:43:13.739096 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-205fafbf-f4ab-45c4-800e-8075a9d9248c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:43:13.808153 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 526/1047] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:43:13 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 14:43:14.072087 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a979cd5e-8dfe-4bd9-ad31-2819a6d97d03 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:14.088139 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:14.180821 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a979cd5e-8dfe-4bd9-ad31-2819a6d97d03 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:14.214557 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd69fb3-326f-41d1-905e-a27c453b6085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:14.215177 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd69fb3-326f-41d1-905e-a27c453b6085 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:14.215770 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd69fb3-326f-41d1-905e-a27c453b6085 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:14.216031 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd69fb3-326f-41d1-905e-a27c453b6085 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:14.226501 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd69fb3-326f-41d1-905e-a27c453b6085 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:43:14.231284 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-dcd69fb3-326f-41d1-905e-a27c453b6085 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 14:43:14.231284 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:14.231284 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:14.231284 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:14.231284 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:14.231284 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:14.231284 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:14.231284 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:14.231284 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:14.231284 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:14.231284 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:14.231284 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:14.231284 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:43:14.231284 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:43:14.231284 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:43:14.231284 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:43:14.232225 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:43:14.232225 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:43:14.232225 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:43:14.232225 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:43:14.232225 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:14.232225 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:14.232225 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:14.232225 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:14.232225 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:14.232225 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:14.232225 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:14.232225 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:14.232225 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:14.232225 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:14.232225 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:14.232225 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:14.233111 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:14.233111 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:14.233111 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:14.233111 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:14.233111 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:43:14.233111 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:43:14.233111 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:43:14.233111 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:43:14.233111 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:43:14.233111 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:43:14.233111 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 14:43:14.233111 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:43:14.237381 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 522/1048] 10.222.0.26 () {56 vars in 1120 bytes} [Mon Sep 19 14:43:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:43:14.238608 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205fafbf-f4ab-45c4-800e-8075a9d9248c None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:14.341197 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205fafbf-f4ab-45c4-800e-8075a9d9248c None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:14.359018 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:14.377720 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e88c886-c910-4346-b851-c02a34c5723c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:14.378324 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e88c886-c910-4346-b851-c02a34c5723c None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:14.378596 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e88c886-c910-4346-b851-c02a34c5723c None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:14.378860 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e88c886-c910-4346-b851-c02a34c5723c None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:14.379513 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e88c886-c910-4346-b851-c02a34c5723c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:14.379813 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e88c886-c910-4346-b851-c02a34c5723c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:14.381192 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e88c886-c910-4346-b851-c02a34c5723c None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:14.393177 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 527/1049] 10.222.0.26 () {56 vars in 1115 bytes} [Mon Sep 19 14:43:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:43:14.395226 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd69fb3-326f-41d1-905e-a27c453b6085 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:14.472195 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:14.505593 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd69fb3-326f-41d1-905e-a27c453b6085 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:14.541352 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f1764a-d202-4994-9b88-daf34985da15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:14.541979 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f1764a-d202-4994-9b88-daf34985da15 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:14.542253 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f1764a-d202-4994-9b88-daf34985da15 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:14.542523 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f1764a-d202-4994-9b88-daf34985da15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:14.553355 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f1764a-d202-4994-9b88-daf34985da15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:14.554960 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f1764a-d202-4994-9b88-daf34985da15 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:14.569486 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-a9f1764a-d202-4994-9b88-daf34985da15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:43:14.569486 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:14.569486 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:14.569486 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:14.569486 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:14.569486 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:14.569486 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:14.569486 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:14.569486 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:14.569486 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:14.569486 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:14.569486 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:14.569486 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:43:14.569486 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:43:14.569486 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:43:14.569486 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:43:14.570452 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:14.570452 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:14.570452 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:14.570452 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:14.570452 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:14.570452 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:14.570452 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:14.570452 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:14.570452 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:14.570452 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:14.570452 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:14.570452 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:14.570452 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:14.570452 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:14.570452 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:14.570452 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:14.570452 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:43:14.576777 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:43:14.576777 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:43:14.576777 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:43:14.576777 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 523/1050] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:43:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:43:14.578541 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e88c886-c910-4346-b851-c02a34c5723c None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:14.690040 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e88c886-c910-4346-b851-c02a34c5723c None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:14.730445 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ddec19-e22a-40ec-9cb4-8d39c7be9dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:14.731107 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ddec19-e22a-40ec-9cb4-8d39c7be9dd7 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:14.731348 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ddec19-e22a-40ec-9cb4-8d39c7be9dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:14.731564 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ddec19-e22a-40ec-9cb4-8d39c7be9dd7 None admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:14.732221 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ddec19-e22a-40ec-9cb4-8d39c7be9dd7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:14.732514 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ddec19-e22a-40ec-9cb4-8d39c7be9dd7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:14.733901 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ddec19-e22a-40ec-9cb4-8d39c7be9dd7 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:14.751327 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 528/1051] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 19 14:43:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:14.752742 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f1764a-d202-4994-9b88-daf34985da15 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:14.777355 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5d7751-f953-4f5c-bf79-dc93e345706b None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:14.777669 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5d7751-f953-4f5c-bf79-dc93e345706b None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:14.777907 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5d7751-f953-4f5c-bf79-dc93e345706b None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:14.779391 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 529/1052] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:43:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 14:43:14.784267 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e1395-c156-44bf-914f-f6b0fb26931a None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:14.784553 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e1395-c156-44bf-914f-f6b0fb26931a None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:14.784829 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e1395-c156-44bf-914f-f6b0fb26931a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:14.803253 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-055e1395-c156-44bf-914f-f6b0fb26931a None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:43:14.804427 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-055e1395-c156-44bf-914f-f6b0fb26931a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:43:14.839994 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:14.864978 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f1764a-d202-4994-9b88-daf34985da15 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:14.874057 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 530/1053] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:43:14 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 14:43:14.875376 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae819f-f7d5-4b8d-a8b4-f61926fc61e3 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:14.875714 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae819f-f7d5-4b8d-a8b4-f61926fc61e3 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:14.875990 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae819f-f7d5-4b8d-a8b4-f61926fc61e3 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:14.877862 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 531/1054] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:43:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:43:14.882554 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7dbc28-7c59-4705-8104-46da43addd7f None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:14.882963 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7dbc28-7c59-4705-8104-46da43addd7f None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:14.883231 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7dbc28-7c59-4705-8104-46da43addd7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:14.891605 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:14.903740 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72b14f0-db12-4d1f-ab9a-dd3c45615797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:14.904364 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72b14f0-db12-4d1f-ab9a-dd3c45615797 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:14.904640 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72b14f0-db12-4d1f-ab9a-dd3c45615797 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:14.904907 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72b14f0-db12-4d1f-ab9a-dd3c45615797 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:14.906207 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-bd7dbc28-7c59-4705-8104-46da43addd7f None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:43:14.908244 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-bd7dbc28-7c59-4705-8104-46da43addd7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:43:14.912794 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72b14f0-db12-4d1f-ab9a-dd3c45615797 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:14.914614 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72b14f0-db12-4d1f-ab9a-dd3c45615797 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:14.926538 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-e72b14f0-db12-4d1f-ab9a-dd3c45615797 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 19 14:43:14.926538 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:14.926538 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:14.926538 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:14.926538 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:14.926538 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:14.926538 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:14.926538 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:14.926538 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:14.926538 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:14.926538 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:14.926538 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:14.926538 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:43:14.926538 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:43:14.926538 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:43:14.926538 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:43:14.927491 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:14.927491 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:14.927491 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:43:14.927491 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:43:14.927491 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:43:14.927491 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:43:14.927491 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:14.927491 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:14.927491 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:14.927491 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:14.927491 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:14.927491 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:14.927491 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:14.927491 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:14.927491 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:14.927491 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:14.927491 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:14.927491 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:14.928429 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:14.928429 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:14.928429 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:43:14.928429 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:43:14.928429 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:43:14.928429 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:43:14.928429 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:43:14.928429 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:43:14.928429 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 19 14:43:14.928429 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:43:14.928429 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 524/1055] 10.222.0.26 () {56 vars in 1093 bytes} [Mon Sep 19 14:43:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:43:14.933721 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72b14f0-db12-4d1f-ab9a-dd3c45615797 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:14.989082 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 532/1056] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:43:14 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 14:43:15.044648 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72b14f0-db12-4d1f-ab9a-dd3c45615797 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:15.079539 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b69401f-d4f5-4e98-ac1b-fb3a23380e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:15.080130 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b69401f-d4f5-4e98-ac1b-fb3a23380e9d None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:15.080404 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b69401f-d4f5-4e98-ac1b-fb3a23380e9d None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:15.080670 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b69401f-d4f5-4e98-ac1b-fb3a23380e9d None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:15.081418 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b69401f-d4f5-4e98-ac1b-fb3a23380e9d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:15.081719 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b69401f-d4f5-4e98-ac1b-fb3a23380e9d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:15.083165 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b69401f-d4f5-4e98-ac1b-fb3a23380e9d None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:15.100971 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 525/1057] 10.222.0.26 () {56 vars in 1133 bytes} [Mon Sep 19 14:43:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:43:15.107126 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7dbc28-7c59-4705-8104-46da43addd7f None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:15.140428 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b69401f-d4f5-4e98-ac1b-fb3a23380e9d None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:15.188407 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:15.208032 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:15.211234 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7dbc28-7c59-4705-8104-46da43addd7f None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:15.249472 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b69401f-d4f5-4e98-ac1b-fb3a23380e9d None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:15.250309 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf5bb0e-8918-43eb-b4e0-693f00fc998a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:15.251110 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf5bb0e-8918-43eb-b4e0-693f00fc998a None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:15.251391 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf5bb0e-8918-43eb-b4e0-693f00fc998a None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:15.252463 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf5bb0e-8918-43eb-b4e0-693f00fc998a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:15.262771 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf5bb0e-8918-43eb-b4e0-693f00fc998a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:15.264228 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf5bb0e-8918-43eb-b4e0-693f00fc998a None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:15.278891 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-faf5bb0e-8918-43eb-b4e0-693f00fc998a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:43:15.278891 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:15.278891 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:15.278891 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:15.278891 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:15.278891 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:15.278891 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:15.278891 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:15.278891 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:15.278891 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:15.278891 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:15.278891 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:15.278891 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:43:15.278891 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:43:15.278891 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:43:15.278891 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:43:15.279887 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:15.279887 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:15.279887 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:15.279887 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:15.279887 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:15.279887 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:15.279887 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:15.279887 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:15.279887 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:15.279887 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:15.279887 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:15.279887 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:15.279887 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:15.279887 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:15.279887 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:15.279887 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:15.279887 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:43:15.281201 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:43:15.281201 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:43:15.281201 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:43:15.281201 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 533/1058] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:43:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:43:15.281201 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf5bb0e-8918-43eb-b4e0-693f00fc998a None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:15.288438 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697f1b68-75b1-477d-b1be-858e10b51ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:15.289664 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697f1b68-75b1-477d-b1be-858e10b51ac7 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:15.290154 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697f1b68-75b1-477d-b1be-858e10b51ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:15.290621 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697f1b68-75b1-477d-b1be-858e10b51ac7 None admin] PATH_INFO: `/v3/services/image` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:15.291182 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697f1b68-75b1-477d-b1be-858e10b51ac7 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:15.293243 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697f1b68-75b1-477d-b1be-858e10b51ac7 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:15.302064 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-697f1b68-75b1-477d-b1be-858e10b51ac7 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 19 14:43:15.302064 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:15.302064 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 14:43:15.302064 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 14:43:15.302064 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 14:43:15.302064 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 14:43:15.302064 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 14:43:15.302064 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:43:15.302064 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 19 14:43:15.302064 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:43:15.302064 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 14:43:15.302064 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:43:15.302064 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:15.302064 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:15.302064 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:15.302064 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:15.302064 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:15.303054 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:15.303054 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:15.303054 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:15.303054 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:15.303054 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:15.303054 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:15.303054 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 14:43:15.303054 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 14:43:15.303054 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 14:43:15.303054 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 14:43:15.303054 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:15.303054 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:15.303054 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:15.303054 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:15.303054 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:15.303054 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:15.303872 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:15.303872 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:15.303872 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:15.303872 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:15.303872 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:15.303872 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:15.303872 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:15.303872 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:15.303872 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:15.303872 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:15.303872 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 14:43:15.303872 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:43:15.303872 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 19 14:43:15.303872 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:43:15.303872 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 526/1059] 10.222.0.26 () {56 vars in 1105 bytes} [Mon Sep 19 14:43:15 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:43:15.304704 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697f1b68-75b1-477d-b1be-858e10b51ac7 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:15.382892 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf5bb0e-8918-43eb-b4e0-693f00fc998a None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:15.401212 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697f1b68-75b1-477d-b1be-858e10b51ac7 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:15.408065 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:15.415370 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4816731d-4c8d-437b-9053-89f4109337d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:15.415989 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4816731d-4c8d-437b-9053-89f4109337d6 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:15.416267 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4816731d-4c8d-437b-9053-89f4109337d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:15.416528 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4816731d-4c8d-437b-9053-89f4109337d6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:15.427588 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4816731d-4c8d-437b-9053-89f4109337d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:43:15.432344 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-4816731d-4c8d-437b-9053-89f4109337d6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:43:15.432344 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:15.432344 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:15.432344 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:15.432344 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:15.432344 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:15.432344 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:15.432344 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:15.432344 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:15.432344 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:15.432344 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:15.432344 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:15.432344 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:43:15.432344 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:43:15.432344 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:43:15.432344 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:43:15.433345 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:43:15.433345 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:43:15.433345 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:43:15.433345 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:43:15.433345 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:15.433345 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:15.433345 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:15.433345 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:15.433345 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:15.433345 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:15.433345 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:15.433345 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:15.433345 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:15.433345 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:15.433345 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:15.433345 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:15.434332 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:15.434332 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:15.434332 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:15.434332 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:15.434332 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:43:15.434332 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:43:15.434332 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:43:15.434332 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:43:15.434332 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:43:15.434332 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:43:15.434332 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:43:15.434332 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:43:15.434332 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 534/1060] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 19 14:43:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:43:15.435403 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eced7efa-fcb2-4550-81de-0d74f55a8127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:15.436004 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eced7efa-fcb2-4550-81de-0d74f55a8127 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:15.436281 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eced7efa-fcb2-4550-81de-0d74f55a8127 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:15.436548 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eced7efa-fcb2-4550-81de-0d74f55a8127 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:15.437218 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eced7efa-fcb2-4550-81de-0d74f55a8127 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:15.437532 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eced7efa-fcb2-4550-81de-0d74f55a8127 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:15.437802 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4816731d-4c8d-437b-9053-89f4109337d6 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:15.438885 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eced7efa-fcb2-4550-81de-0d74f55a8127 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:15.451363 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 527/1061] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 19 14:43:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:15.452331 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eced7efa-fcb2-4550-81de-0d74f55a8127 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:15.456824 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:15.552131 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4816731d-4c8d-437b-9053-89f4109337d6 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:15.559560 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eced7efa-fcb2-4550-81de-0d74f55a8127 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:15.586698 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e150f626-05e4-4b2f-b1c7-effd4d6c10c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:15.587307 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e150f626-05e4-4b2f-b1c7-effd4d6c10c0 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:15.587583 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e150f626-05e4-4b2f-b1c7-effd4d6c10c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:15.587856 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e150f626-05e4-4b2f-b1c7-effd4d6c10c0 None admin] PATH_INFO: `/v3/services` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:15.588486 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e150f626-05e4-4b2f-b1c7-effd4d6c10c0 None admin] RBAC: Adding query filter params (name=image) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:15.588790 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e150f626-05e4-4b2f-b1c7-effd4d6c10c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:15.590240 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e150f626-05e4-4b2f-b1c7-effd4d6c10c0 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:15.596074 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 535/1062] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:43:15 2022] GET /identity/v3/services?name=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:15.596713 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e150f626-05e4-4b2f-b1c7-effd4d6c10c0 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:15.606115 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2f12ed-0683-466a-8015-0246ea00a1e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:15.606730 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2f12ed-0683-466a-8015-0246ea00a1e3 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:15.607003 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2f12ed-0683-466a-8015-0246ea00a1e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:15.607382 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2f12ed-0683-466a-8015-0246ea00a1e3 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:15.608048 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2f12ed-0683-466a-8015-0246ea00a1e3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:15.608367 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2f12ed-0683-466a-8015-0246ea00a1e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:15.609770 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2f12ed-0683-466a-8015-0246ea00a1e3 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:15.618853 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 528/1063] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 19 14:43:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:15.619647 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2f12ed-0683-466a-8015-0246ea00a1e3 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:15.647557 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:15.677403 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:15.701385 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e150f626-05e4-4b2f-b1c7-effd4d6c10c0 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:15.719980 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2f12ed-0683-466a-8015-0246ea00a1e3 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:15.736474 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2640d150-4c93-4d62-ae56-fd4ba72e915b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:15.737133 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2640d150-4c93-4d62-ae56-fd4ba72e915b None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:15.737390 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2640d150-4c93-4d62-ae56-fd4ba72e915b None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:15.737694 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2640d150-4c93-4d62-ae56-fd4ba72e915b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:15.744579 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2640d150-4c93-4d62-ae56-fd4ba72e915b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:15.746049 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2640d150-4c93-4d62-ae56-fd4ba72e915b None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:15.756423 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c5e969-e3eb-42d6-8f84-0d41e3415c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:15.757051 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c5e969-e3eb-42d6-8f84-0d41e3415c1c None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:15.757329 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c5e969-e3eb-42d6-8f84-0d41e3415c1c None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:15.757423 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-2640d150-4c93-4d62-ae56-fd4ba72e915b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:43:15.757423 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:15.757423 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:15.757423 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:15.757423 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:15.757423 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:15.757423 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:15.757423 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:15.757423 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:15.757423 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:15.757423 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:15.757423 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:15.757423 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:43:15.757423 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:43:15.757423 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:43:15.758521 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:43:15.758521 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:15.758521 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:15.758521 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:15.758521 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:15.758521 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:15.758521 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:15.758521 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:15.758521 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:15.758521 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:15.758521 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:15.758521 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:15.758521 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:15.758521 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:15.758521 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:15.758521 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:15.758521 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:15.759658 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:43:15.759658 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:43:15.759658 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:43:15.759658 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:43:15.759658 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:43:15.759658 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:43:15.759658 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:43:15.759658 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:43:15.760276 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c5e969-e3eb-42d6-8f84-0d41e3415c1c None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:15.760276 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c5e969-e3eb-42d6-8f84-0d41e3415c1c None admin] RBAC: Adding query filter params (type=image) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:15.760276 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c5e969-e3eb-42d6-8f84-0d41e3415c1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:15.760472 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 536/1064] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 19 14:43:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:43:15.760472 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2640d150-4c93-4d62-ae56-fd4ba72e915b None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:15.760602 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c5e969-e3eb-42d6-8f84-0d41e3415c1c None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:15.764812 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 529/1065] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:43:15 2022] GET /identity/v3/services?type=image => generated 350 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:15.765618 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c5e969-e3eb-42d6-8f84-0d41e3415c1c None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:15.872214 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2640d150-4c93-4d62-ae56-fd4ba72e915b None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:15.872975 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:15.882515 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c5e969-e3eb-42d6-8f84-0d41e3415c1c None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:15.907443 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d00e1-59d1-45f9-894c-f0950293f3fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:15.908108 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d00e1-59d1-45f9-894c-f0950293f3fa None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:15.908353 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d00e1-59d1-45f9-894c-f0950293f3fa None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:15.908638 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d00e1-59d1-45f9-894c-f0950293f3fa None admin] PATH_INFO: `/v3/users/a3885a4f36b141c8b6f47990be35fc8c` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:15.911369 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:15.918498 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbf4f04-5bd3-43a0-b665-6d1987bf4df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:15.919107 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf4f04-5bd3-43a0-b665-6d1987bf4df3 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:15.919381 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf4f04-5bd3-43a0-b665-6d1987bf4df3 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:15.919651 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf4f04-5bd3-43a0-b665-6d1987bf4df3 None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:15.920331 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbf4f04-5bd3-43a0-b665-6d1987bf4df3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:15.920627 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbf4f04-5bd3-43a0-b665-6d1987bf4df3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:15.922101 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbf4f04-5bd3-43a0-b665-6d1987bf4df3 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:15.922709 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800d00e1-59d1-45f9-894c-f0950293f3fa None admin] RBAC: Authorizing `identity:get_user(user_id=a3885a4f36b141c8b6f47990be35fc8c)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:15.924130 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800d00e1-59d1-45f9-894c-f0950293f3fa None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:15.925840 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 537/1066] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 19 14:43:15 2022] GET /identity/v3/users/a3885a4f36b141c8b6f47990be35fc8c => generated 285 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:15.926575 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d00e1-59d1-45f9-894c-f0950293f3fa None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:15.934894 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 530/1067] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 19 14:43:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:15.935781 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbf4f04-5bd3-43a0-b665-6d1987bf4df3 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:16.034621 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d00e1-59d1-45f9-894c-f0950293f3fa None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:16.034813 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbf4f04-5bd3-43a0-b665-6d1987bf4df3 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:16.069783 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2013840f-b092-4350-9ba5-6ad8129cfe00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:16.070403 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013840f-b092-4350-9ba5-6ad8129cfe00 None admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:16.070696 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013840f-b092-4350-9ba5-6ad8129cfe00 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:16.070965 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013840f-b092-4350-9ba5-6ad8129cfe00 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:16.071160 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc339152-6cc9-482c-88fc-7d2ead78311a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:16.071629 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2013840f-b092-4350-9ba5-6ad8129cfe00 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:16.071755 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc339152-6cc9-482c-88fc-7d2ead78311a None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:16.072031 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc339152-6cc9-482c-88fc-7d2ead78311a None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:16.072300 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc339152-6cc9-482c-88fc-7d2ead78311a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:16.072982 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2013840f-b092-4350-9ba5-6ad8129cfe00 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:16.092730 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 538/1068] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 14:43:15 2022] POST /identity/v3/endpoints => generated 327 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:43:16.093550 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2013840f-b092-4350-9ba5-6ad8129cfe00 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:16.094171 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:16.151771 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc339152-6cc9-482c-88fc-7d2ead78311a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:16.153317 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc339152-6cc9-482c-88fc-7d2ead78311a None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:16.167745 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:16.235987 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2013840f-b092-4350-9ba5-6ad8129cfe00 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:16.276766 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 531/1069] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 19 14:43:15 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 14:43:16.276962 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abceae20-8faa-42de-ae3f-79f2829911c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:16.277591 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abceae20-8faa-42de-ae3f-79f2829911c7 None admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:16.277873 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abceae20-8faa-42de-ae3f-79f2829911c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:16.278147 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abceae20-8faa-42de-ae3f-79f2829911c7 None admin] PATH_INFO: `/v3/projects/9ede5dc59ece4d9282867a99e94c4c41/users/3017e5d92bef4cc2aeae4f28c78ba233/roles/0b146dd606ac4c25bd6a33070856e1a2` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:16.280323 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abceae20-8faa-42de-ae3f-79f2829911c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=9ede5dc59ece4d9282867a99e94c4c41, user_id=3017e5d92bef4cc2aeae4f28c78ba233, role_id=0b146dd606ac4c25bd6a33070856e1a2)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:16.281842 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abceae20-8faa-42de-ae3f-79f2829911c7 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:16.282825 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc339152-6cc9-482c-88fc-7d2ead78311a None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:16.300557 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 539/1070] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Sep 19 14:43:16 2022] PUT /identity/v3/projects/9ede5dc59ece4d9282867a99e94c4c41/users/3017e5d92bef4cc2aeae4f28c78ba233/roles/0b146dd606ac4c25bd6a33070856e1a2 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:43:16.351669 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:16.409679 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc339152-6cc9-482c-88fc-7d2ead78311a None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:16.448750 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bfb23f-7b66-4099-8c61-e65da070ecdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:16.449432 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bfb23f-7b66-4099-8c61-e65da070ecdd None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:16.449707 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bfb23f-7b66-4099-8c61-e65da070ecdd None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:16.449974 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bfb23f-7b66-4099-8c61-e65da070ecdd None admin] PATH_INFO: `/v3/projects/1839405f904b485aa1a493c9fe69c5c3` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:16.451226 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bfb23f-7b66-4099-8c61-e65da070ecdd None admin] RBAC: Authorizing `identity:get_project(project_id=1839405f904b485aa1a493c9fe69c5c3)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:16.452724 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bfb23f-7b66-4099-8c61-e65da070ecdd None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:16.459560 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 532/1071] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 19 14:43:16 2022] GET /identity/v3/projects/1839405f904b485aa1a493c9fe69c5c3 => generated 311 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:16.460935 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abceae20-8faa-42de-ae3f-79f2829911c7 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:16.570834 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abceae20-8faa-42de-ae3f-79f2829911c7 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:16.578257 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:16.608558 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d30f819-6922-4f96-a0c7-2727d942ec27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:16.609182 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d30f819-6922-4f96-a0c7-2727d942ec27 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:16.609458 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d30f819-6922-4f96-a0c7-2727d942ec27 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:16.609721 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d30f819-6922-4f96-a0c7-2727d942ec27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:16.610439 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d30f819-6922-4f96-a0c7-2727d942ec27 None admin] RBAC: Adding query filter params (role.id=019bde1756cb40de8ce06cef6b261f79, scope.project.id=1839405f904b485aa1a493c9fe69c5c3, user.id=a3885a4f36b141c8b6f47990be35fc8c) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:16.610739 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d30f819-6922-4f96-a0c7-2727d942ec27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:16.612143 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d30f819-6922-4f96-a0c7-2727d942ec27 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:16.618217 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 540/1072] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 19 14:43:16 2022] GET /identity/v3/role_assignments?user.id=a3885a4f36b141c8b6f47990be35fc8c&scope.project.id=1839405f904b485aa1a493c9fe69c5c3&role.id=019bde1756cb40de8ce06cef6b261f79 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:18.303413 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a4d6a-b9a4-4391-a5c7-2b8b9076af77 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:18.303922 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a4d6a-b9a4-4391-a5c7-2b8b9076af77 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:18.303922 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a4d6a-b9a4-4391-a5c7-2b8b9076af77 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:18.305646 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 533/1073] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:43:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:43:18.311143 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44cc1f5-357f-4587-976a-d134da8e610e None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:18.311592 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44cc1f5-357f-4587-976a-d134da8e610e None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:18.311688 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44cc1f5-357f-4587-976a-d134da8e610e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:18.330496 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-f44cc1f5-357f-4587-976a-d134da8e610e None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:43:18.331662 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-f44cc1f5-357f-4587-976a-d134da8e610e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:43:18.407403 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 541/1074] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:43:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:43:18.495985 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a334261e-964c-4090-9312-dfab40ee1ace None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:18.496337 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a334261e-964c-4090-9312-dfab40ee1ace None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:18.496561 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a334261e-964c-4090-9312-dfab40ee1ace None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:18.498157 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 534/1075] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:43:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:43:18.503341 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb13c88-c096-496b-99d9-e736d8524fb8 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:18.503633 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb13c88-c096-496b-99d9-e736d8524fb8 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:18.503903 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb13c88-c096-496b-99d9-e736d8524fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:18.523379 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-3eb13c88-c096-496b-99d9-e736d8524fb8 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:43:18.524572 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-3eb13c88-c096-496b-99d9-e736d8524fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:43:18.595166 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 542/1076] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:43:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:43:18.675796 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a334261e-964c-4090-9312-dfab40ee1ace None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:18.781603 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a334261e-964c-4090-9312-dfab40ee1ace None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:18.792345 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b940783-e092-4838-a564-055e092a5ed5 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:18.792624 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b940783-e092-4838-a564-055e092a5ed5 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:18.792887 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b940783-e092-4838-a564-055e092a5ed5 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:18.794267 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 543/1077] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:43:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 14:43:18.799152 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3085834-305e-4afb-8c6a-68c4111e3bb3 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:18.799500 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3085834-305e-4afb-8c6a-68c4111e3bb3 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:18.799838 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3085834-305e-4afb-8c6a-68c4111e3bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:18.808011 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:18.818957 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-d3085834-305e-4afb-8c6a-68c4111e3bb3 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:43:18.820191 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-d3085834-305e-4afb-8c6a-68c4111e3bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:43:18.823357 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91b8ba1-0579-4827-9ec2-d27e43096051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:18.823956 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91b8ba1-0579-4827-9ec2-d27e43096051 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:18.824224 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91b8ba1-0579-4827-9ec2-d27e43096051 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:18.824483 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91b8ba1-0579-4827-9ec2-d27e43096051 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:18.845568 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:18.890267 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 544/1078] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:43:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:43:18.891508 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3085834-305e-4afb-8c6a-68c4111e3bb3 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:18.896755 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91b8ba1-0579-4827-9ec2-d27e43096051 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:18.898362 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91b8ba1-0579-4827-9ec2-d27e43096051 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:19.004804 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3085834-305e-4afb-8c6a-68c4111e3bb3 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:19.013496 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 535/1079] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 19 14:43:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 14:43:19.016031 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91b8ba1-0579-4827-9ec2-d27e43096051 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:19.041839 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54c1ad5-72f6-46d4-85e3-b6842dd68bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:19.042505 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c1ad5-72f6-46d4-85e3-b6842dd68bba None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:19.042777 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c1ad5-72f6-46d4-85e3-b6842dd68bba None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:19.043047 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c1ad5-72f6-46d4-85e3-b6842dd68bba None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:19.043419 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:19.053725 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54c1ad5-72f6-46d4-85e3-b6842dd68bba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:43:19.058696 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-d54c1ad5-72f6-46d4-85e3-b6842dd68bba None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 14:43:19.058696 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:19.058696 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:19.058696 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:19.058696 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:19.058696 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:19.058696 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:19.058696 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:19.058696 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:19.058696 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:19.058696 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:19.058696 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:19.058696 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:43:19.058696 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:43:19.058696 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:43:19.058696 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:43:19.059622 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:43:19.059622 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:43:19.059622 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:43:19.059622 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:43:19.059622 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:19.059622 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:19.059622 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:19.059622 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:19.059622 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:19.059622 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:19.059622 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:19.059622 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:19.059622 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:19.059622 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:19.059622 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:19.059622 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:19.060447 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:19.060447 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:19.060447 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:19.060447 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:19.060447 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:43:19.060447 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:43:19.060447 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:43:19.060447 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:43:19.060447 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:43:19.060447 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:43:19.060447 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 14:43:19.060447 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:43:19.060447 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 545/1080] 10.222.0.26 () {56 vars in 1120 bytes} [Mon Sep 19 14:43:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:43:19.066448 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54c1ad5-72f6-46d4-85e3-b6842dd68bba None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:19.089368 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:19.128163 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91b8ba1-0579-4827-9ec2-d27e43096051 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:19.164752 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01b7099-2762-4d4b-90cd-656cb9674b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:19.165466 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b7099-2762-4d4b-90cd-656cb9674b14 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:19.165776 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b7099-2762-4d4b-90cd-656cb9674b14 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:19.166012 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b7099-2762-4d4b-90cd-656cb9674b14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:19.175582 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54c1ad5-72f6-46d4-85e3-b6842dd68bba None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:19.176089 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01b7099-2762-4d4b-90cd-656cb9674b14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:19.177571 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01b7099-2762-4d4b-90cd-656cb9674b14 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:19.192241 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-f01b7099-2762-4d4b-90cd-656cb9674b14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:43:19.192241 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:19.192241 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:19.192241 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:19.192241 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:19.192241 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:19.192241 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:19.192241 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:19.192241 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:19.192241 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:19.192241 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:19.192241 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:19.192241 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:43:19.192241 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:43:19.192241 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:43:19.192241 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:43:19.193256 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:19.193256 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:19.193256 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:19.193256 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:19.193256 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:19.193256 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:19.193256 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:19.193256 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:19.193256 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:19.193256 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:19.193256 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:19.193256 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:19.193256 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:19.193256 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:19.193256 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:19.193256 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:19.193256 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:43:19.194179 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:43:19.194179 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:43:19.194179 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:43:19.194179 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 536/1081] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:43:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:43:19.194801 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01b7099-2762-4d4b-90cd-656cb9674b14 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:19.213713 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d710d0-15e2-4456-a5f9-93b3bd822f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:19.214296 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d710d0-15e2-4456-a5f9-93b3bd822f1a None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:19.214600 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d710d0-15e2-4456-a5f9-93b3bd822f1a None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:19.214872 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d710d0-15e2-4456-a5f9-93b3bd822f1a None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:19.215853 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d710d0-15e2-4456-a5f9-93b3bd822f1a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:19.216153 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d710d0-15e2-4456-a5f9-93b3bd822f1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:19.217534 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d710d0-15e2-4456-a5f9-93b3bd822f1a None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:19.226017 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 546/1082] 10.222.0.26 () {56 vars in 1115 bytes} [Mon Sep 19 14:43:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:19.227122 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d710d0-15e2-4456-a5f9-93b3bd822f1a None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:19.275305 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:19.305602 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01b7099-2762-4d4b-90cd-656cb9674b14 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:19.318228 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:19.338251 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d710d0-15e2-4456-a5f9-93b3bd822f1a None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:19.339797 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1134d863-0b8f-4cc9-9188-4f184cd8da18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:19.340782 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1134d863-0b8f-4cc9-9188-4f184cd8da18 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:19.341081 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1134d863-0b8f-4cc9-9188-4f184cd8da18 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:19.341351 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1134d863-0b8f-4cc9-9188-4f184cd8da18 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:19.352554 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1134d863-0b8f-4cc9-9188-4f184cd8da18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:43:19.357414 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-1134d863-0b8f-4cc9-9188-4f184cd8da18 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:43:19.357414 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:19.357414 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:19.357414 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:19.357414 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:19.357414 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:19.357414 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:19.357414 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:19.357414 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:19.357414 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:19.357414 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:19.357414 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:19.357414 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:43:19.357414 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:43:19.357414 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:43:19.357414 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:43:19.358371 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:43:19.358371 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:43:19.358371 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:43:19.358371 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:43:19.358371 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:19.358371 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:19.358371 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:19.358371 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:19.358371 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:19.358371 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:19.358371 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:19.358371 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:19.358371 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:19.358371 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:19.358371 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:19.358371 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:19.359198 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:19.359198 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:19.359198 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:19.359198 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:19.359198 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:43:19.359198 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:43:19.359198 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:43:19.359198 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:43:19.359198 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:43:19.359198 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:43:19.359198 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:43:19.359198 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:43:19.359198 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 537/1083] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 19 14:43:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:43:19.359870 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1134d863-0b8f-4cc9-9188-4f184cd8da18 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:19.374738 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff6b14-7bd4-4218-849e-48b11fe15412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:19.375345 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff6b14-7bd4-4218-849e-48b11fe15412 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:19.375620 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff6b14-7bd4-4218-849e-48b11fe15412 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:19.375906 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff6b14-7bd4-4218-849e-48b11fe15412 None admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:19.376534 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ff6b14-7bd4-4218-849e-48b11fe15412 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:19.376854 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ff6b14-7bd4-4218-849e-48b11fe15412 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:19.378303 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ff6b14-7bd4-4218-849e-48b11fe15412 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:19.390251 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 547/1084] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 19 14:43:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:19.391039 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff6b14-7bd4-4218-849e-48b11fe15412 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:19.494058 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1134d863-0b8f-4cc9-9188-4f184cd8da18 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:19.536341 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff6b14-7bd4-4218-849e-48b11fe15412 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:19.541823 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:19.552635 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2475109e-4d3e-415e-a491-501203b96cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:19.553354 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2475109e-4d3e-415e-a491-501203b96cad None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:19.553635 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2475109e-4d3e-415e-a491-501203b96cad None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:19.553894 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2475109e-4d3e-415e-a491-501203b96cad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:19.566347 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2475109e-4d3e-415e-a491-501203b96cad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:19.567824 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2475109e-4d3e-415e-a491-501203b96cad None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:19.581041 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc28fd35-8f19-4fa1-8fec-7240d84d1263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:19.581641 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc28fd35-8f19-4fa1-8fec-7240d84d1263 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:19.581916 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc28fd35-8f19-4fa1-8fec-7240d84d1263 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:19.582806 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc28fd35-8f19-4fa1-8fec-7240d84d1263 None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:19.582923 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc28fd35-8f19-4fa1-8fec-7240d84d1263 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:19.583129 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc28fd35-8f19-4fa1-8fec-7240d84d1263 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:19.583764 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-2475109e-4d3e-415e-a491-501203b96cad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:43:19.583764 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:19.583764 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:19.583764 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:19.583764 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:19.583764 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:19.583764 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:19.583764 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:19.583764 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:19.583764 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:19.583764 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:19.583764 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:19.583764 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:43:19.583764 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:43:19.583764 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:43:19.583764 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:43:19.584647 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:19.584647 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:19.584647 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:19.584647 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:19.584647 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:19.584647 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:19.584647 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:19.584647 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:19.584647 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:19.584647 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:19.584647 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:19.584647 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:19.584647 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:19.584647 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:19.584647 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:19.584647 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:19.584647 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:43:19.585564 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:43:19.585564 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:43:19.585564 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:43:19.585804 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc28fd35-8f19-4fa1-8fec-7240d84d1263 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:19.585877 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 538/1085] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:43:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:43:19.592173 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2475109e-4d3e-415e-a491-501203b96cad None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:19.596545 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 548/1086] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 19 14:43:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:19.603165 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc28fd35-8f19-4fa1-8fec-7240d84d1263 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:19.613160 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:19.717798 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2475109e-4d3e-415e-a491-501203b96cad None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:19.733611 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc28fd35-8f19-4fa1-8fec-7240d84d1263 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:19.750853 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4dd13a-1f2b-430c-9c48-8b2d19d2eb57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:19.751450 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4dd13a-1f2b-430c-9c48-8b2d19d2eb57 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:19.751721 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4dd13a-1f2b-430c-9c48-8b2d19d2eb57 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:19.751983 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4dd13a-1f2b-430c-9c48-8b2d19d2eb57 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:19.752635 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4dd13a-1f2b-430c-9c48-8b2d19d2eb57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:19.752931 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4dd13a-1f2b-430c-9c48-8b2d19d2eb57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:19.754435 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4dd13a-1f2b-430c-9c48-8b2d19d2eb57 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:19.766721 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 539/1087] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 19 14:43:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:43:19.771499 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f0649-6c48-4cab-9493-f7a288cb896a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:19.771499 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f0649-6c48-4cab-9493-f7a288cb896a None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:19.771499 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f0649-6c48-4cab-9493-f7a288cb896a None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:19.771499 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f0649-6c48-4cab-9493-f7a288cb896a None admin] PATH_INFO: `/v3/users/a3885a4f36b141c8b6f47990be35fc8c` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:19.771810 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9f0649-6c48-4cab-9493-f7a288cb896a None admin] RBAC: Authorizing `identity:get_user(user_id=a3885a4f36b141c8b6f47990be35fc8c)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:19.771810 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9f0649-6c48-4cab-9493-f7a288cb896a None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:19.772309 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4dd13a-1f2b-430c-9c48-8b2d19d2eb57 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:19.773120 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 549/1088] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 19 14:43:19 2022] GET /identity/v3/users/a3885a4f36b141c8b6f47990be35fc8c => generated 285 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:19.778829 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f0649-6c48-4cab-9493-f7a288cb896a None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:19.817310 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:19.852192 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:19.873081 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4dd13a-1f2b-430c-9c48-8b2d19d2eb57 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:19.884133 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f0649-6c48-4cab-9493-f7a288cb896a None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:19.909981 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fabbee4-a0f5-44bc-bc33-28929065048a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:19.910593 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fabbee4-a0f5-44bc-bc33-28929065048a None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:19.910849 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fabbee4-a0f5-44bc-bc33-28929065048a None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:19.911123 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fabbee4-a0f5-44bc-bc33-28929065048a None admin] PATH_INFO: `/v3/users/nova` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:19.918397 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fabbee4-a0f5-44bc-bc33-28929065048a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:19.918834 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b287ca-fc7c-4b3e-a689-d366bbc86360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:19.919449 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b287ca-fc7c-4b3e-a689-d366bbc86360 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:19.919718 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b287ca-fc7c-4b3e-a689-d366bbc86360 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:19.919835 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fabbee4-a0f5-44bc-bc33-28929065048a None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:19.919982 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b287ca-fc7c-4b3e-a689-d366bbc86360 None admin] PATH_INFO: `/v3/projects/1839405f904b485aa1a493c9fe69c5c3` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:19.921080 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b287ca-fc7c-4b3e-a689-d366bbc86360 None admin] RBAC: Authorizing `identity:get_project(project_id=1839405f904b485aa1a493c9fe69c5c3)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:19.922487 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b287ca-fc7c-4b3e-a689-d366bbc86360 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:19.924101 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 550/1089] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 19 14:43:19 2022] GET /identity/v3/projects/1839405f904b485aa1a493c9fe69c5c3 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:43:19.930065 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b287ca-fc7c-4b3e-a689-d366bbc86360 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:19.931232 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-8fabbee4-a0f5-44bc-bc33-28929065048a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 19 14:43:19.931232 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:19.931232 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:19.931232 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:19.931232 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:19.931232 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:19.931232 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:19.931232 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:19.931232 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:19.931232 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:19.931232 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:19.931232 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:19.931232 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:43:19.931232 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:43:19.931232 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:43:19.931232 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:43:19.932175 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:19.932175 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:19.932175 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:43:19.932175 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:43:19.932175 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:43:19.932175 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:43:19.932175 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:19.932175 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:19.932175 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:19.932175 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:19.932175 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:19.932175 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:19.932175 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:19.932175 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:19.932175 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:19.932175 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:19.932175 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:19.932175 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:19.933110 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:19.933110 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:19.933110 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:43:19.933110 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:43:19.933110 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:43:19.933110 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:43:19.933110 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:43:19.933110 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:43:19.933110 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 19 14:43:19.933110 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:43:19.933110 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 540/1090] 10.222.0.26 () {56 vars in 1093 bytes} [Mon Sep 19 14:43:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:43:19.937931 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fabbee4-a0f5-44bc-bc33-28929065048a None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:20.034760 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b287ca-fc7c-4b3e-a689-d366bbc86360 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:20.039732 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fabbee4-a0f5-44bc-bc33-28929065048a None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:20.042711 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:20.069353 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807f218d-dc68-48ef-a47a-3bb5ead09e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:20.070083 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f218d-dc68-48ef-a47a-3bb5ead09e48 None admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:20.070415 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f218d-dc68-48ef-a47a-3bb5ead09e48 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:20.070682 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f218d-dc68-48ef-a47a-3bb5ead09e48 None admin] PATH_INFO: `/v3/projects/1839405f904b485aa1a493c9fe69c5c3/users/a3885a4f36b141c8b6f47990be35fc8c/roles/019bde1756cb40de8ce06cef6b261f79` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:20.072577 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807f218d-dc68-48ef-a47a-3bb5ead09e48 None admin] RBAC: Authorizing `identity:create_grant(project_id=1839405f904b485aa1a493c9fe69c5c3, user_id=a3885a4f36b141c8b6f47990be35fc8c, role_id=019bde1756cb40de8ce06cef6b261f79)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:20.074037 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807f218d-dc68-48ef-a47a-3bb5ead09e48 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:20.074244 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceaf45d-24c6-472a-9598-d9e9f8f7a943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:20.074845 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceaf45d-24c6-472a-9598-d9e9f8f7a943 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:20.075121 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceaf45d-24c6-472a-9598-d9e9f8f7a943 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:20.075390 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceaf45d-24c6-472a-9598-d9e9f8f7a943 None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:20.076114 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceaf45d-24c6-472a-9598-d9e9f8f7a943 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:20.076417 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceaf45d-24c6-472a-9598-d9e9f8f7a943 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:20.077853 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceaf45d-24c6-472a-9598-d9e9f8f7a943 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:20.083312 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:20.088569 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 551/1091] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Sep 19 14:43:19 2022] PUT /identity/v3/projects/1839405f904b485aa1a493c9fe69c5c3/users/a3885a4f36b141c8b6f47990be35fc8c/roles/019bde1756cb40de8ce06cef6b261f79 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:43:20.097433 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 541/1092] 10.222.0.26 () {56 vars in 1133 bytes} [Mon Sep 19 14:43:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:20.103687 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807f218d-dc68-48ef-a47a-3bb5ead09e48 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:20.219182 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807f218d-dc68-48ef-a47a-3bb5ead09e48 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:20.258485 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e2b83a-90af-4006-8ef4-d0c3d2240902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:20.259127 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e2b83a-90af-4006-8ef4-d0c3d2240902 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:20.259410 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e2b83a-90af-4006-8ef4-d0c3d2240902 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:20.259681 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e2b83a-90af-4006-8ef4-d0c3d2240902 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:20.329146 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:20.331828 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e2b83a-90af-4006-8ef4-d0c3d2240902 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:20.334172 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e2b83a-90af-4006-8ef4-d0c3d2240902 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:20.435122 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 552/1093] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 19 14:43:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 14:43:20.441631 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceaf45d-24c6-472a-9598-d9e9f8f7a943 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:20.548586 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceaf45d-24c6-472a-9598-d9e9f8f7a943 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:20.584514 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af750839-94b6-4ca5-ae29-f0660ee7da19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:20.585174 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af750839-94b6-4ca5-ae29-f0660ee7da19 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:20.585449 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af750839-94b6-4ca5-ae29-f0660ee7da19 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:20.585913 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af750839-94b6-4ca5-ae29-f0660ee7da19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:20.596732 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af750839-94b6-4ca5-ae29-f0660ee7da19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:20.598214 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af750839-94b6-4ca5-ae29-f0660ee7da19 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:20.613727 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-af750839-94b6-4ca5-ae29-f0660ee7da19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:43:20.613727 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:20.613727 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:20.613727 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:20.613727 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:20.613727 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:20.613727 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:20.613727 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:20.613727 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:20.613727 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:20.613727 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:20.613727 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:20.613727 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:43:20.613727 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:43:20.613727 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:43:20.613727 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:43:20.614886 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:20.614886 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:20.614886 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:20.614886 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:20.614886 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:20.614886 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:20.614886 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:20.614886 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:20.614886 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:20.614886 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:20.614886 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:20.614886 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:20.614886 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:20.614886 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:20.614886 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:20.614886 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:20.614886 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:43:20.615778 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:43:20.615778 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:43:20.615778 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:43:20.615778 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 542/1094] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:43:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:43:20.620646 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e2b83a-90af-4006-8ef4-d0c3d2240902 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:20.720350 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:20.723374 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e2b83a-90af-4006-8ef4-d0c3d2240902 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:20.759797 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4e723c-8f6d-4f2f-88e5-ec55abf733a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:20.760386 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e723c-8f6d-4f2f-88e5-ec55abf733a0 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:20.760659 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e723c-8f6d-4f2f-88e5-ec55abf733a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:20.760924 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e723c-8f6d-4f2f-88e5-ec55abf733a0 None admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:20.761595 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4e723c-8f6d-4f2f-88e5-ec55abf733a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:20.761893 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4e723c-8f6d-4f2f-88e5-ec55abf733a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:20.763255 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4e723c-8f6d-4f2f-88e5-ec55abf733a0 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:20.774978 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 553/1095] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 19 14:43:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:20.780862 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af750839-94b6-4ca5-ae29-f0660ee7da19 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:20.798168 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:20.886240 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af750839-94b6-4ca5-ae29-f0660ee7da19 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:20.921007 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebceda4b-9972-40c0-93e5-2408c63845e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:20.921641 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebceda4b-9972-40c0-93e5-2408c63845e9 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:20.921919 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebceda4b-9972-40c0-93e5-2408c63845e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:20.922186 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebceda4b-9972-40c0-93e5-2408c63845e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:20.928934 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebceda4b-9972-40c0-93e5-2408c63845e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:20.930838 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebceda4b-9972-40c0-93e5-2408c63845e9 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:20.942140 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-ebceda4b-9972-40c0-93e5-2408c63845e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:43:20.942140 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:20.942140 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:20.942140 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:20.942140 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:20.942140 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:20.942140 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:20.942140 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:20.942140 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:20.942140 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:20.942140 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:20.942140 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:20.942140 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:43:20.942140 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:43:20.942140 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:43:20.943049 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:43:20.943049 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:20.943049 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:20.943049 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:20.943049 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:20.943049 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:20.943049 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:20.943049 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:20.943049 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:20.943049 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:20.943049 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:20.943049 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:20.943049 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:20.943049 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:20.943049 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:20.943049 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:20.943049 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:20.943970 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:43:20.943970 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:43:20.943970 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:43:20.943970 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:43:20.943970 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:43:20.943970 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:43:20.943970 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:43:20.943970 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:43:20.943970 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 543/1096] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 19 14:43:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:43:20.949843 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4e723c-8f6d-4f2f-88e5-ec55abf733a0 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:21.060083 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4e723c-8f6d-4f2f-88e5-ec55abf733a0 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:21.095370 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77041e76-b89b-490c-bd04-d6f2df1320e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:21.096073 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77041e76-b89b-490c-bd04-d6f2df1320e9 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:21.096414 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77041e76-b89b-490c-bd04-d6f2df1320e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:21.096691 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77041e76-b89b-490c-bd04-d6f2df1320e9 None admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:21.097384 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77041e76-b89b-490c-bd04-d6f2df1320e9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:21.097699 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77041e76-b89b-490c-bd04-d6f2df1320e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:21.099127 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77041e76-b89b-490c-bd04-d6f2df1320e9 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:21.111545 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 554/1097] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 19 14:43:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:21.117957 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebceda4b-9972-40c0-93e5-2408c63845e9 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:21.196156 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:21.222805 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebceda4b-9972-40c0-93e5-2408c63845e9 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:21.256058 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b499bec-1578-49a6-a92d-e52110fb2502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:21.256650 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b499bec-1578-49a6-a92d-e52110fb2502 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:21.256922 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b499bec-1578-49a6-a92d-e52110fb2502 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:21.257216 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b499bec-1578-49a6-a92d-e52110fb2502 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:21.258373 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b499bec-1578-49a6-a92d-e52110fb2502 None admin] RBAC: Adding query filter params (role.id=0b146dd606ac4c25bd6a33070856e1a2, scope.project.id=9ede5dc59ece4d9282867a99e94c4c41, user.id=3017e5d92bef4cc2aeae4f28c78ba233) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:21.258678 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b499bec-1578-49a6-a92d-e52110fb2502 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:21.260101 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b499bec-1578-49a6-a92d-e52110fb2502 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:21.266027 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 544/1098] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 19 14:43:21 2022] GET /identity/v3/role_assignments?user.id=3017e5d92bef4cc2aeae4f28c78ba233&scope.project.id=9ede5dc59ece4d9282867a99e94c4c41&role.id=0b146dd606ac4c25bd6a33070856e1a2 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:22.264305 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a8521-cf27-4bbd-929e-27a37908feef None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:22.265321 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a8521-cf27-4bbd-929e-27a37908feef None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:22.265321 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a8521-cf27-4bbd-929e-27a37908feef None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:22.267367 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 555/1099] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:43:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:43:22.276660 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d0ad5e-4fd3-46db-a8bc-6ed656f74b87 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:22.277153 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d0ad5e-4fd3-46db-a8bc-6ed656f74b87 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:22.277266 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d0ad5e-4fd3-46db-a8bc-6ed656f74b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:22.300947 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-27d0ad5e-4fd3-46db-a8bc-6ed656f74b87 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:43:22.302148 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-27d0ad5e-4fd3-46db-a8bc-6ed656f74b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:43:22.371535 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 545/1100] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:43:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:43:22.648054 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6a8521-cf27-4bbd-929e-27a37908feef None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:22.673844 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:22.757784 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6a8521-cf27-4bbd-929e-27a37908feef None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:22.794847 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81f86af-3498-4087-94ec-5305e342b83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:22.795453 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f86af-3498-4087-94ec-5305e342b83e None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:22.795722 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f86af-3498-4087-94ec-5305e342b83e None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:22.795981 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f86af-3498-4087-94ec-5305e342b83e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:22.806897 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81f86af-3498-4087-94ec-5305e342b83e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:43:22.811805 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-c81f86af-3498-4087-94ec-5305e342b83e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:43:22.811805 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:22.811805 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:22.811805 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:22.811805 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:22.811805 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:22.811805 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:22.811805 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:22.811805 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:22.811805 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:22.811805 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:22.811805 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:22.811805 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:43:22.811805 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:43:22.811805 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:43:22.811805 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:43:22.812891 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:43:22.812891 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:43:22.812891 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:43:22.812891 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:43:22.812891 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:22.812891 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:22.812891 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:22.812891 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:22.812891 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:22.812891 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:22.812891 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:22.812891 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:22.812891 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:22.812891 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:22.812891 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:22.812891 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:22.813793 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:22.813793 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:22.813793 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:22.813793 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:22.813793 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:43:22.813793 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:43:22.813793 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:43:22.813793 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:43:22.813793 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:43:22.813793 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:43:22.813793 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:43:22.813793 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:43:22.813793 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 556/1101] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 19 14:43:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:43:22.820290 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d0ad5e-4fd3-46db-a8bc-6ed656f74b87 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:22.892133 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:22.928538 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d0ad5e-4fd3-46db-a8bc-6ed656f74b87 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:22.963537 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12d2715-9e9c-42e1-a4f6-a188933f0f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:22.964127 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d2715-9e9c-42e1-a4f6-a188933f0f06 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:22.964398 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d2715-9e9c-42e1-a4f6-a188933f0f06 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:22.964666 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d2715-9e9c-42e1-a4f6-a188933f0f06 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:22.965664 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12d2715-9e9c-42e1-a4f6-a188933f0f06 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:22.965963 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12d2715-9e9c-42e1-a4f6-a188933f0f06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:22.967333 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12d2715-9e9c-42e1-a4f6-a188933f0f06 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:22.975436 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 546/1102] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 19 14:43:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:22.982732 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81f86af-3498-4087-94ec-5305e342b83e None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:23.081455 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:23.102210 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81f86af-3498-4087-94ec-5305e342b83e None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:23.136038 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0681c9c-1210-4b63-83f2-1e2b91b211c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:23.136653 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0681c9c-1210-4b63-83f2-1e2b91b211c8 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:23.136930 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0681c9c-1210-4b63-83f2-1e2b91b211c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:23.137263 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0681c9c-1210-4b63-83f2-1e2b91b211c8 None admin] PATH_INFO: `/v3/users/a3885a4f36b141c8b6f47990be35fc8c` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:23.138501 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0681c9c-1210-4b63-83f2-1e2b91b211c8 None admin] RBAC: Authorizing `identity:get_user(user_id=a3885a4f36b141c8b6f47990be35fc8c)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:23.139934 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0681c9c-1210-4b63-83f2-1e2b91b211c8 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:23.141535 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 557/1103] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 19 14:43:22 2022] GET /identity/v3/users/a3885a4f36b141c8b6f47990be35fc8c => generated 285 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:23.148446 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12d2715-9e9c-42e1-a4f6-a188933f0f06 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:23.267658 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12d2715-9e9c-42e1-a4f6-a188933f0f06 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:23.306295 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:23.317620 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b059fb86-50d7-480f-b36c-9771eef3a762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:23.318576 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b059fb86-50d7-480f-b36c-9771eef3a762 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:23.319038 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b059fb86-50d7-480f-b36c-9771eef3a762 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:23.319454 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b059fb86-50d7-480f-b36c-9771eef3a762 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:23.412418 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b059fb86-50d7-480f-b36c-9771eef3a762 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:23.414431 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b059fb86-50d7-480f-b36c-9771eef3a762 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:23.515379 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 547/1104] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 19 14:43:23 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 14:43:23.522411 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0681c9c-1210-4b63-83f2-1e2b91b211c8 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:23.624546 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0681c9c-1210-4b63-83f2-1e2b91b211c8 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:23.659103 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ad8517-b714-47df-9b4f-b4a5eb66d67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:23.659712 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad8517-b714-47df-9b4f-b4a5eb66d67e None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:23.659982 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad8517-b714-47df-9b4f-b4a5eb66d67e None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:23.660249 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad8517-b714-47df-9b4f-b4a5eb66d67e None admin] PATH_INFO: `/v3/projects/1839405f904b485aa1a493c9fe69c5c3` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:23.661480 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ad8517-b714-47df-9b4f-b4a5eb66d67e None admin] RBAC: Authorizing `identity:get_project(project_id=1839405f904b485aa1a493c9fe69c5c3)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:23.662896 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ad8517-b714-47df-9b4f-b4a5eb66d67e None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:23.664599 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 558/1105] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 19 14:43:23 2022] GET /identity/v3/projects/1839405f904b485aa1a493c9fe69c5c3 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:23.671817 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b059fb86-50d7-480f-b36c-9771eef3a762 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:23.716427 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:23.791667 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b059fb86-50d7-480f-b36c-9771eef3a762 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:23.826377 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d48fad-7f1c-427c-b24f-206eefb68ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:23.826963 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d48fad-7f1c-427c-b24f-206eefb68ce0 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:23.827233 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d48fad-7f1c-427c-b24f-206eefb68ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:23.827498 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d48fad-7f1c-427c-b24f-206eefb68ce0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:23.828205 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d48fad-7f1c-427c-b24f-206eefb68ce0 None admin] RBAC: Adding query filter params (role.id=019bde1756cb40de8ce06cef6b261f79, scope.project.id=1839405f904b485aa1a493c9fe69c5c3, user.id=a3885a4f36b141c8b6f47990be35fc8c) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:23.828503 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d48fad-7f1c-427c-b24f-206eefb68ce0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:23.829941 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d48fad-7f1c-427c-b24f-206eefb68ce0 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:23.835601 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 548/1106] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 19 14:43:23 2022] GET /identity/v3/role_assignments?user.id=a3885a4f36b141c8b6f47990be35fc8c&scope.project.id=1839405f904b485aa1a493c9fe69c5c3&role.id=019bde1756cb40de8ce06cef6b261f79 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:26.014206 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a060e1-819d-442d-a08d-e0b059a0d910 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:26.014684 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a060e1-819d-442d-a08d-e0b059a0d910 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:26.014797 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a060e1-819d-442d-a08d-e0b059a0d910 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:26.016098 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 559/1107] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:43:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:43:26.021906 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfaf033-d212-4129-ac02-8c4b16841aab None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:26.022342 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfaf033-d212-4129-ac02-8c4b16841aab None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:26.022435 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfaf033-d212-4129-ac02-8c4b16841aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:26.042963 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-9cfaf033-d212-4129-ac02-8c4b16841aab None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:43:26.044147 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-9cfaf033-d212-4129-ac02-8c4b16841aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:43:26.118280 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 549/1108] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:43:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:43:26.393173 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a060e1-819d-442d-a08d-e0b059a0d910 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:26.421045 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:26.514506 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a060e1-819d-442d-a08d-e0b059a0d910 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:26.549878 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc0138d-a232-4a58-a817-e9646d2198e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:26.550491 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc0138d-a232-4a58-a817-e9646d2198e3 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:26.550734 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc0138d-a232-4a58-a817-e9646d2198e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:26.551026 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc0138d-a232-4a58-a817-e9646d2198e3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:26.552165 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc0138d-a232-4a58-a817-e9646d2198e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:26.553606 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc0138d-a232-4a58-a817-e9646d2198e3 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:26.555499 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 560/1109] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:43:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:26.562085 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfaf033-d212-4129-ac02-8c4b16841aab None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:26.596156 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:26.688541 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfaf033-d212-4129-ac02-8c4b16841aab None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:26.723254 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc0b106-c5a0-4e66-a908-0d7ad0962191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:26.723860 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc0b106-c5a0-4e66-a908-0d7ad0962191 None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:26.724137 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc0b106-c5a0-4e66-a908-0d7ad0962191 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:26.724405 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc0b106-c5a0-4e66-a908-0d7ad0962191 None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:26.725077 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc0b106-c5a0-4e66-a908-0d7ad0962191 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:26.726634 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc0b106-c5a0-4e66-a908-0d7ad0962191 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:26.749172 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 550/1110] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Sep 19 14:43:26 2022] POST /identity/v3/users => generated 286 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:43:28.984319 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe79da0b-5531-4a64-947c-e1cf2f390703 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:28.984895 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe79da0b-5531-4a64-947c-e1cf2f390703 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:28.984895 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe79da0b-5531-4a64-947c-e1cf2f390703 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:28.986246 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 561/1111] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:43:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:43:28.991885 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23449534-23d3-4f4e-9ef1-e2a50373d7da None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:28.992328 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23449534-23d3-4f4e-9ef1-e2a50373d7da None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:28.992417 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23449534-23d3-4f4e-9ef1-e2a50373d7da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:29.011974 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-23449534-23d3-4f4e-9ef1-e2a50373d7da None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:43:29.013185 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-23449534-23d3-4f4e-9ef1-e2a50373d7da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:43:29.082013 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 551/1112] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:43:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:43:29.347279 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe79da0b-5531-4a64-947c-e1cf2f390703 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:29.442545 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:29.460440 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe79da0b-5531-4a64-947c-e1cf2f390703 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:29.496719 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d317b314-8e46-4618-824b-5fa227bdcc1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:29.497483 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d317b314-8e46-4618-824b-5fa227bdcc1d None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:29.497766 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d317b314-8e46-4618-824b-5fa227bdcc1d None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:29.498032 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d317b314-8e46-4618-824b-5fa227bdcc1d None admin] PATH_INFO: `/v3/roles/ae7ed67e62684598a31185ab16c971ce` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:29.499653 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d317b314-8e46-4618-824b-5fa227bdcc1d None admin] RBAC: Authorizing `identity:get_role(role_id=ae7ed67e62684598a31185ab16c971ce)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:29.501212 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d317b314-8e46-4618-824b-5fa227bdcc1d None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:29.502554 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 562/1113] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 19 14:43:29 2022] GET /identity/v3/roles/ae7ed67e62684598a31185ab16c971ce => generated 223 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:29.509452 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23449534-23d3-4f4e-9ef1-e2a50373d7da None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:29.526177 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:29.627762 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23449534-23d3-4f4e-9ef1-e2a50373d7da None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:29.671558 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfe0f58-d73c-4ab0-bf69-399d1ed76aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:29.672173 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe0f58-d73c-4ab0-bf69-399d1ed76aa3 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:29.672439 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe0f58-d73c-4ab0-bf69-399d1ed76aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:29.672708 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe0f58-d73c-4ab0-bf69-399d1ed76aa3 None admin] PATH_INFO: `/v3/users/c2af2be9e6904a84a0a89531d7a55424` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:29.686571 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfe0f58-d73c-4ab0-bf69-399d1ed76aa3 None admin] RBAC: Authorizing `identity:get_user(user_id=c2af2be9e6904a84a0a89531d7a55424)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:29.687995 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfe0f58-d73c-4ab0-bf69-399d1ed76aa3 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:29.689612 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 552/1114] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 19 14:43:29 2022] GET /identity/v3/users/c2af2be9e6904a84a0a89531d7a55424 => generated 286 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:43:29.698977 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d317b314-8e46-4618-824b-5fa227bdcc1d None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:29.821277 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d317b314-8e46-4618-824b-5fa227bdcc1d None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:29.858924 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee47867-b21d-41b7-873e-c480d5d4c8bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:29.859518 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee47867-b21d-41b7-873e-c480d5d4c8bc None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:29.859792 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee47867-b21d-41b7-873e-c480d5d4c8bc None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:29.860056 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee47867-b21d-41b7-873e-c480d5d4c8bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:29.881491 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:29.943064 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee47867-b21d-41b7-873e-c480d5d4c8bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:29.944557 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee47867-b21d-41b7-873e-c480d5d4c8bc None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:30.052373 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 563/1115] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 19 14:43:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 14:43:30.059468 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfe0f58-d73c-4ab0-bf69-399d1ed76aa3 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:30.131957 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:30.166718 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfe0f58-d73c-4ab0-bf69-399d1ed76aa3 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:30.200960 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb72a77-98cc-46ec-9eba-88b7f66062c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:30.201609 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb72a77-98cc-46ec-9eba-88b7f66062c2 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:30.201883 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb72a77-98cc-46ec-9eba-88b7f66062c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:30.202149 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb72a77-98cc-46ec-9eba-88b7f66062c2 None admin] PATH_INFO: `/v3/projects/1839405f904b485aa1a493c9fe69c5c3` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:30.203309 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb72a77-98cc-46ec-9eba-88b7f66062c2 None admin] RBAC: Authorizing `identity:get_project(project_id=1839405f904b485aa1a493c9fe69c5c3)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:30.204748 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb72a77-98cc-46ec-9eba-88b7f66062c2 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:30.206436 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 553/1116] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 19 14:43:30 2022] GET /identity/v3/projects/1839405f904b485aa1a493c9fe69c5c3 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:30.213340 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee47867-b21d-41b7-873e-c480d5d4c8bc None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:30.271975 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:30.333840 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee47867-b21d-41b7-873e-c480d5d4c8bc None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:30.370384 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e7ff79-0f19-4f18-b90d-d311038cbfd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:30.370972 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e7ff79-0f19-4f18-b90d-d311038cbfd6 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:30.371250 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e7ff79-0f19-4f18-b90d-d311038cbfd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:30.371516 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e7ff79-0f19-4f18-b90d-d311038cbfd6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:30.372230 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e7ff79-0f19-4f18-b90d-d311038cbfd6 None admin] RBAC: Adding query filter params (role.id=ae7ed67e62684598a31185ab16c971ce, scope.project.id=1839405f904b485aa1a493c9fe69c5c3, user.id=c2af2be9e6904a84a0a89531d7a55424) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:30.372536 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e7ff79-0f19-4f18-b90d-d311038cbfd6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:30.373994 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e7ff79-0f19-4f18-b90d-d311038cbfd6 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:30.379465 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 564/1117] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 19 14:43:30 2022] GET /identity/v3/role_assignments?user.id=c2af2be9e6904a84a0a89531d7a55424&scope.project.id=1839405f904b485aa1a493c9fe69c5c3&role.id=ae7ed67e62684598a31185ab16c971ce => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:32.556517 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0924fda2-8475-4595-94e4-d03b99859841 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:32.557464 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0924fda2-8475-4595-94e4-d03b99859841 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:32.557464 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0924fda2-8475-4595-94e4-d03b99859841 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:32.559607 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 554/1118] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:43:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:43:32.565997 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c8cb08-c84c-4813-a516-628be200a8c6 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:32.566756 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c8cb08-c84c-4813-a516-628be200a8c6 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:32.566853 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c8cb08-c84c-4813-a516-628be200a8c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:32.593834 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-d5c8cb08-c84c-4813-a516-628be200a8c6 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:43:32.595023 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-d5c8cb08-c84c-4813-a516-628be200a8c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:43:32.673318 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 565/1119] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:43:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:43:32.941044 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0924fda2-8475-4595-94e4-d03b99859841 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:33.062501 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0924fda2-8475-4595-94e4-d03b99859841 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:33.099291 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc868f9-9fd9-43d0-8aac-586ed5aa0888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:33.099910 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc868f9-9fd9-43d0-8aac-586ed5aa0888 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:33.100186 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc868f9-9fd9-43d0-8aac-586ed5aa0888 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:33.100457 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc868f9-9fd9-43d0-8aac-586ed5aa0888 None admin] PATH_INFO: `/v3/roles/ae7ed67e62684598a31185ab16c971ce` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:33.102221 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc868f9-9fd9-43d0-8aac-586ed5aa0888 None admin] RBAC: Authorizing `identity:get_role(role_id=ae7ed67e62684598a31185ab16c971ce)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:33.103647 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc868f9-9fd9-43d0-8aac-586ed5aa0888 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:33.104980 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 555/1120] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 19 14:43:32 2022] GET /identity/v3/roles/ae7ed67e62684598a31185ab16c971ce => generated 223 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:33.111284 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c8cb08-c84c-4813-a516-628be200a8c6 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:33.161318 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:33.220265 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c8cb08-c84c-4813-a516-628be200a8c6 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:33.263832 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ce308c-80ea-4a43-9e0a-3277753a5683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:33.264462 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ce308c-80ea-4a43-9e0a-3277753a5683 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:33.264732 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ce308c-80ea-4a43-9e0a-3277753a5683 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:33.265040 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ce308c-80ea-4a43-9e0a-3277753a5683 None admin] PATH_INFO: `/v3/users/c2af2be9e6904a84a0a89531d7a55424` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:33.266199 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ce308c-80ea-4a43-9e0a-3277753a5683 None admin] RBAC: Authorizing `identity:get_user(user_id=c2af2be9e6904a84a0a89531d7a55424)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:33.267631 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ce308c-80ea-4a43-9e0a-3277753a5683 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:33.269250 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 566/1121] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 19 14:43:33 2022] GET /identity/v3/users/c2af2be9e6904a84a0a89531d7a55424 => generated 286 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:33.275503 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc868f9-9fd9-43d0-8aac-586ed5aa0888 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:33.279710 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:33.384034 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc868f9-9fd9-43d0-8aac-586ed5aa0888 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:33.418874 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79471218-4e23-465a-b1f0-f7f0bc9eb1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:33.419482 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79471218-4e23-465a-b1f0-f7f0bc9eb1f5 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:33.419753 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79471218-4e23-465a-b1f0-f7f0bc9eb1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:33.420020 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79471218-4e23-465a-b1f0-f7f0bc9eb1f5 None admin] PATH_INFO: `/v3/projects/1839405f904b485aa1a493c9fe69c5c3` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:33.421278 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79471218-4e23-465a-b1f0-f7f0bc9eb1f5 None admin] RBAC: Authorizing `identity:get_project(project_id=1839405f904b485aa1a493c9fe69c5c3)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:33.422740 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79471218-4e23-465a-b1f0-f7f0bc9eb1f5 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:33.424424 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 556/1122] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 19 14:43:33 2022] GET /identity/v3/projects/1839405f904b485aa1a493c9fe69c5c3 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:33.431652 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ce308c-80ea-4a43-9e0a-3277753a5683 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:33.543281 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ce308c-80ea-4a43-9e0a-3277753a5683 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:33.562215 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:33.579884 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e6dc16-4389-457d-b2b5-fefc41e2dbb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:33.580547 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e6dc16-4389-457d-b2b5-fefc41e2dbb5 None admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:33.580850 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e6dc16-4389-457d-b2b5-fefc41e2dbb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:33.581147 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e6dc16-4389-457d-b2b5-fefc41e2dbb5 None admin] PATH_INFO: `/v3/projects/1839405f904b485aa1a493c9fe69c5c3/users/c2af2be9e6904a84a0a89531d7a55424/roles/ae7ed67e62684598a31185ab16c971ce` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:33.583344 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e6dc16-4389-457d-b2b5-fefc41e2dbb5 None admin] RBAC: Authorizing `identity:create_grant(project_id=1839405f904b485aa1a493c9fe69c5c3, user_id=c2af2be9e6904a84a0a89531d7a55424, role_id=ae7ed67e62684598a31185ab16c971ce)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:33.584785 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e6dc16-4389-457d-b2b5-fefc41e2dbb5 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:33.602343 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 567/1123] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Sep 19 14:43:33 2022] PUT /identity/v3/projects/1839405f904b485aa1a493c9fe69c5c3/users/c2af2be9e6904a84a0a89531d7a55424/roles/ae7ed67e62684598a31185ab16c971ce => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:43:35.749939 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f977418-5487-4326-bb90-cfae9c4ec972 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:35.750819 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f977418-5487-4326-bb90-cfae9c4ec972 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:35.750819 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f977418-5487-4326-bb90-cfae9c4ec972 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:35.752924 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 557/1124] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:43:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:43:35.759917 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add5764-2353-408c-8bf0-d0cc7248ca59 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:35.760649 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add5764-2353-408c-8bf0-d0cc7248ca59 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:35.760792 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add5764-2353-408c-8bf0-d0cc7248ca59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:35.784067 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-2add5764-2353-408c-8bf0-d0cc7248ca59 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:43:35.785328 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-2add5764-2353-408c-8bf0-d0cc7248ca59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:43:35.860518 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 568/1125] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:43:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:43:36.148220 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f977418-5487-4326-bb90-cfae9c4ec972 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:36.227634 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:36.261316 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f977418-5487-4326-bb90-cfae9c4ec972 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:36.305032 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d904b9a4-790e-4083-bbe0-d9a91adaae7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:36.305710 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d904b9a4-790e-4083-bbe0-d9a91adaae7a None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:36.305987 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d904b9a4-790e-4083-bbe0-d9a91adaae7a None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:36.306247 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d904b9a4-790e-4083-bbe0-d9a91adaae7a None admin] PATH_INFO: `/v3/roles/ae7ed67e62684598a31185ab16c971ce` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:36.307799 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d904b9a4-790e-4083-bbe0-d9a91adaae7a None admin] RBAC: Authorizing `identity:get_role(role_id=ae7ed67e62684598a31185ab16c971ce)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:36.309204 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d904b9a4-790e-4083-bbe0-d9a91adaae7a None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:36.310567 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 558/1126] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 19 14:43:36 2022] GET /identity/v3/roles/ae7ed67e62684598a31185ab16c971ce => generated 223 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:36.316897 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2add5764-2353-408c-8bf0-d0cc7248ca59 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:36.424542 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2add5764-2353-408c-8bf0-d0cc7248ca59 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:36.426811 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:36.460246 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21498b30-7cd7-4afc-b154-8fedf8bf26c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:36.460593 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21498b30-7cd7-4afc-b154-8fedf8bf26c6 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:36.460866 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21498b30-7cd7-4afc-b154-8fedf8bf26c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:36.461170 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21498b30-7cd7-4afc-b154-8fedf8bf26c6 None admin] PATH_INFO: `/v3/users/c2af2be9e6904a84a0a89531d7a55424` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:36.462382 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21498b30-7cd7-4afc-b154-8fedf8bf26c6 None admin] RBAC: Authorizing `identity:get_user(user_id=c2af2be9e6904a84a0a89531d7a55424)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:36.463815 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21498b30-7cd7-4afc-b154-8fedf8bf26c6 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:36.465809 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 569/1127] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 19 14:43:36 2022] GET /identity/v3/users/c2af2be9e6904a84a0a89531d7a55424 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:36.472405 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d904b9a4-790e-4083-bbe0-d9a91adaae7a None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:36.601028 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d904b9a4-790e-4083-bbe0-d9a91adaae7a None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:36.636673 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47be51ab-51dd-4096-b596-10f251e522b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:36.637295 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be51ab-51dd-4096-b596-10f251e522b7 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:36.637571 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be51ab-51dd-4096-b596-10f251e522b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:36.637843 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be51ab-51dd-4096-b596-10f251e522b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:36.648274 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:36.718280 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47be51ab-51dd-4096-b596-10f251e522b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:36.719665 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47be51ab-51dd-4096-b596-10f251e522b7 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:36.828187 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 559/1128] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 19 14:43:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 14:43:36.837463 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21498b30-7cd7-4afc-b154-8fedf8bf26c6 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:36.942572 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21498b30-7cd7-4afc-b154-8fedf8bf26c6 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:36.978155 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848b0430-82e6-4780-8a57-92c557ee1537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:36.978713 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b0430-82e6-4780-8a57-92c557ee1537 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:36.978983 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b0430-82e6-4780-8a57-92c557ee1537 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:36.979247 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b0430-82e6-4780-8a57-92c557ee1537 None admin] PATH_INFO: `/v3/projects/1839405f904b485aa1a493c9fe69c5c3` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:36.980440 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848b0430-82e6-4780-8a57-92c557ee1537 None admin] RBAC: Authorizing `identity:get_project(project_id=1839405f904b485aa1a493c9fe69c5c3)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:36.981915 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848b0430-82e6-4780-8a57-92c557ee1537 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:36.983553 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 570/1129] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 19 14:43:36 2022] GET /identity/v3/projects/1839405f904b485aa1a493c9fe69c5c3 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:36.991777 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47be51ab-51dd-4096-b596-10f251e522b7 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:37.037911 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:37.101129 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47be51ab-51dd-4096-b596-10f251e522b7 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:37.141373 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd60a25c-2e27-4110-931c-c286d544494a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:37.142280 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd60a25c-2e27-4110-931c-c286d544494a None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:37.142751 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd60a25c-2e27-4110-931c-c286d544494a None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:37.143093 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd60a25c-2e27-4110-931c-c286d544494a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:37.144256 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd60a25c-2e27-4110-931c-c286d544494a None admin] RBAC: Adding query filter params (role.id=ae7ed67e62684598a31185ab16c971ce, scope.project.id=1839405f904b485aa1a493c9fe69c5c3, user.id=c2af2be9e6904a84a0a89531d7a55424) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:37.144710 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd60a25c-2e27-4110-931c-c286d544494a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:37.147002 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd60a25c-2e27-4110-931c-c286d544494a None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:37.153695 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 560/1130] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 19 14:43:36 2022] GET /identity/v3/role_assignments?user.id=c2af2be9e6904a84a0a89531d7a55424&scope.project.id=1839405f904b485aa1a493c9fe69c5c3&role.id=ae7ed67e62684598a31185ab16c971ce => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:39.315491 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bbb9a9-55e8-4239-837d-16f2d738d2de None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:39.316301 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bbb9a9-55e8-4239-837d-16f2d738d2de None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:39.316301 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bbb9a9-55e8-4239-837d-16f2d738d2de None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:39.318463 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 571/1131] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:43:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:43:39.324897 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be64fa26-093a-4683-89b0-8ac83f4915b4 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:39.325662 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be64fa26-093a-4683-89b0-8ac83f4915b4 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:39.325809 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be64fa26-093a-4683-89b0-8ac83f4915b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:39.350492 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-be64fa26-093a-4683-89b0-8ac83f4915b4 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:43:39.351909 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-be64fa26-093a-4683-89b0-8ac83f4915b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:43:39.423339 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 561/1132] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:43:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:43:39.690525 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bbb9a9-55e8-4239-837d-16f2d738d2de None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:39.739543 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:39.805348 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bbb9a9-55e8-4239-837d-16f2d738d2de None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:39.842423 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1344943-e52f-40c8-bc43-d3321652972d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:39.843045 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1344943-e52f-40c8-bc43-d3321652972d None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:39.843295 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1344943-e52f-40c8-bc43-d3321652972d None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:39.843592 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1344943-e52f-40c8-bc43-d3321652972d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:39.844820 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1344943-e52f-40c8-bc43-d3321652972d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:39.846408 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1344943-e52f-40c8-bc43-d3321652972d None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:39.847994 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 572/1133] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:43:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:39.855250 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be64fa26-093a-4683-89b0-8ac83f4915b4 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:39.893197 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:39.967589 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be64fa26-093a-4683-89b0-8ac83f4915b4 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:40.002991 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33175bce-71c0-46f1-9c71-03b84544258d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:40.003592 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33175bce-71c0-46f1-9c71-03b84544258d None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:40.003861 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33175bce-71c0-46f1-9c71-03b84544258d None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:40.004124 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33175bce-71c0-46f1-9c71-03b84544258d None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:40.004776 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33175bce-71c0-46f1-9c71-03b84544258d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:40.006246 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33175bce-71c0-46f1-9c71-03b84544258d None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:40.038323 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 562/1134] 10.222.0.26 () {60 vars in 1141 bytes} [Mon Sep 19 14:43:39 2022] POST /identity/v3/projects => generated 311 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 14:43:42.249793 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8916278-fa24-4eb5-be44-bc40ba9e1c35 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:42.250640 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8916278-fa24-4eb5-be44-bc40ba9e1c35 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:42.250640 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8916278-fa24-4eb5-be44-bc40ba9e1c35 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:42.252612 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 573/1135] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:43:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:43:42.260411 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35fbf25-e1e0-4e98-a8bc-3c282f8a9d31 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:42.260850 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35fbf25-e1e0-4e98-a8bc-3c282f8a9d31 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:42.260952 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35fbf25-e1e0-4e98-a8bc-3c282f8a9d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:42.281715 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-b35fbf25-e1e0-4e98-a8bc-3c282f8a9d31 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:43:42.282892 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b35fbf25-e1e0-4e98-a8bc-3c282f8a9d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:43:42.361057 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 563/1136] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:43:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 14:43:42.639150 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8916278-fa24-4eb5-be44-bc40ba9e1c35 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:42.748957 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8916278-fa24-4eb5-be44-bc40ba9e1c35 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:42.758375 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:42.784324 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0939065-14de-4771-a983-e00e19ad96f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:42.784945 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0939065-14de-4771-a983-e00e19ad96f5 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:42.785250 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0939065-14de-4771-a983-e00e19ad96f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:42.785511 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0939065-14de-4771-a983-e00e19ad96f5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:42.786662 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0939065-14de-4771-a983-e00e19ad96f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:42.788187 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0939065-14de-4771-a983-e00e19ad96f5 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:42.789781 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 574/1137] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:43:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:42.795821 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35fbf25-e1e0-4e98-a8bc-3c282f8a9d31 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:42.814049 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:42.904431 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35fbf25-e1e0-4e98-a8bc-3c282f8a9d31 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:42.939452 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b7e702-9935-457d-b2b3-8c9b28be536d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:42.940078 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b7e702-9935-457d-b2b3-8c9b28be536d None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:42.940387 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b7e702-9935-457d-b2b3-8c9b28be536d None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:42.940654 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b7e702-9935-457d-b2b3-8c9b28be536d None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:42.941308 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b7e702-9935-457d-b2b3-8c9b28be536d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:42.943085 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b7e702-9935-457d-b2b3-8c9b28be536d None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:42.967237 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 564/1138] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Sep 19 14:43:42 2022] POST /identity/v3/users => generated 286 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:43:45.159812 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e6338-d1c1-4416-8be2-fd69928e7246 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:45.160693 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e6338-d1c1-4416-8be2-fd69928e7246 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:45.160693 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e6338-d1c1-4416-8be2-fd69928e7246 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:45.162853 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 575/1139] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:43:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:43:45.169338 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa2bd41-b243-4991-8154-ee5516fc1456 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:45.169805 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa2bd41-b243-4991-8154-ee5516fc1456 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:45.169930 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa2bd41-b243-4991-8154-ee5516fc1456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:45.192080 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-1fa2bd41-b243-4991-8154-ee5516fc1456 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:43:45.193296 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-1fa2bd41-b243-4991-8154-ee5516fc1456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:43:45.264453 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 565/1140] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:43:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:43:45.534565 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840e6338-d1c1-4416-8be2-fd69928e7246 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:45.644164 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840e6338-d1c1-4416-8be2-fd69928e7246 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:45.681605 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c482ca-709e-466a-825f-0e2d6b2c03c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:45.682234 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c482ca-709e-466a-825f-0e2d6b2c03c8 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:45.682496 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c482ca-709e-466a-825f-0e2d6b2c03c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:45.682755 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c482ca-709e-466a-825f-0e2d6b2c03c8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:45.697151 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c482ca-709e-466a-825f-0e2d6b2c03c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:43:45.701917 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-78c482ca-709e-466a-825f-0e2d6b2c03c8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:43:45.701917 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:45.701917 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:45.701917 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:45.701917 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:45.701917 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:45.701917 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:45.701917 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:45.701917 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:45.701917 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:45.701917 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:45.701917 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:45.701917 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:43:45.701917 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:43:45.701917 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:43:45.701917 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:43:45.705180 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:43:45.705180 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:43:45.705180 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:43:45.705180 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:43:45.705180 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:45.705180 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:45.705180 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:45.705180 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:45.705180 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:45.705180 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:45.705180 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:45.705180 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:45.705180 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:45.705180 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:45.705180 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:45.705180 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:45.706283 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:45.706283 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:45.706283 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:45.706283 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:45.706283 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:43:45.706283 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:43:45.706283 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:43:45.706283 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:43:45.706283 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:43:45.706283 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:43:45.706283 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:43:45.706283 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:43:45.706283 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 576/1141] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 19 14:43:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:43:45.710986 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa2bd41-b243-4991-8154-ee5516fc1456 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:45.713235 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:45.821132 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa2bd41-b243-4991-8154-ee5516fc1456 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:45.868747 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ad7b82-6cbb-4e32-aaec-71f0d7bdf84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:45.869380 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ad7b82-6cbb-4e32-aaec-71f0d7bdf84f None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:45.869648 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ad7b82-6cbb-4e32-aaec-71f0d7bdf84f None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:45.869914 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ad7b82-6cbb-4e32-aaec-71f0d7bdf84f None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:45.870663 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ad7b82-6cbb-4e32-aaec-71f0d7bdf84f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:45.871114 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ad7b82-6cbb-4e32-aaec-71f0d7bdf84f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:45.873319 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ad7b82-6cbb-4e32-aaec-71f0d7bdf84f None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:45.884865 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 566/1142] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 19 14:43:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:45.892630 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c482ca-709e-466a-825f-0e2d6b2c03c8 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:45.951401 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:46.026690 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c482ca-709e-466a-825f-0e2d6b2c03c8 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:46.061617 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89523f4-152d-4ec2-9cfe-d4a7994cd005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:46.062236 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89523f4-152d-4ec2-9cfe-d4a7994cd005 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:46.062507 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89523f4-152d-4ec2-9cfe-d4a7994cd005 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:46.062769 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89523f4-152d-4ec2-9cfe-d4a7994cd005 None admin] PATH_INFO: `/v3/users/13f26ebbf43345b48b35958488a4c52f` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:46.075951 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89523f4-152d-4ec2-9cfe-d4a7994cd005 None admin] RBAC: Authorizing `identity:get_user(user_id=13f26ebbf43345b48b35958488a4c52f)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:46.077382 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89523f4-152d-4ec2-9cfe-d4a7994cd005 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:46.078930 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 577/1143] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 19 14:43:45 2022] GET /identity/v3/users/13f26ebbf43345b48b35958488a4c52f => generated 286 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:46.087303 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ad7b82-6cbb-4e32-aaec-71f0d7bdf84f None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:46.158375 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:46.206495 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ad7b82-6cbb-4e32-aaec-71f0d7bdf84f None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:46.246194 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052204ef-98f2-4e12-9f83-747fec38bad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:46.246781 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052204ef-98f2-4e12-9f83-747fec38bad5 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:46.247052 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052204ef-98f2-4e12-9f83-747fec38bad5 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:46.247313 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052204ef-98f2-4e12-9f83-747fec38bad5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:46.316543 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052204ef-98f2-4e12-9f83-747fec38bad5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:46.318001 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052204ef-98f2-4e12-9f83-747fec38bad5 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:46.397735 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:46.443354 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 567/1144] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 19 14:43:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 14:43:46.450671 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89523f4-152d-4ec2-9cfe-d4a7994cd005 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:46.561813 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:46.569947 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89523f4-152d-4ec2-9cfe-d4a7994cd005 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:46.607502 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e972804-e2d1-413f-ac3c-0e56776aee49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:46.608129 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e972804-e2d1-413f-ac3c-0e56776aee49 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:46.608404 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e972804-e2d1-413f-ac3c-0e56776aee49 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:46.608667 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e972804-e2d1-413f-ac3c-0e56776aee49 None admin] PATH_INFO: `/v3/projects/ffd18804a9bb4a97abfba8f14a65f6d1` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:46.609971 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e972804-e2d1-413f-ac3c-0e56776aee49 None admin] RBAC: Authorizing `identity:get_project(project_id=ffd18804a9bb4a97abfba8f14a65f6d1)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:46.611477 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e972804-e2d1-413f-ac3c-0e56776aee49 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:46.613136 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 578/1145] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 19 14:43:46 2022] GET /identity/v3/projects/ffd18804a9bb4a97abfba8f14a65f6d1 => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:43:46.622471 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052204ef-98f2-4e12-9f83-747fec38bad5 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:46.725991 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052204ef-98f2-4e12-9f83-747fec38bad5 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:46.761559 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d0351e-4be3-4c0b-99e6-cfc03df8aebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:46.762172 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d0351e-4be3-4c0b-99e6-cfc03df8aebc None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:46.762413 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d0351e-4be3-4c0b-99e6-cfc03df8aebc None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:46.762683 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d0351e-4be3-4c0b-99e6-cfc03df8aebc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:46.763389 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d0351e-4be3-4c0b-99e6-cfc03df8aebc None admin] RBAC: Adding query filter params (role.id=019bde1756cb40de8ce06cef6b261f79, scope.project.id=ffd18804a9bb4a97abfba8f14a65f6d1, user.id=13f26ebbf43345b48b35958488a4c52f) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:46.763685 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d0351e-4be3-4c0b-99e6-cfc03df8aebc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:46.765129 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d0351e-4be3-4c0b-99e6-cfc03df8aebc None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:46.770365 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 568/1146] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 19 14:43:46 2022] GET /identity/v3/role_assignments?user.id=13f26ebbf43345b48b35958488a4c52f&scope.project.id=ffd18804a9bb4a97abfba8f14a65f6d1&role.id=019bde1756cb40de8ce06cef6b261f79 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:43:48.880822 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f5baa-5230-4d6a-bb6a-34b44e44bbb7 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:48.881908 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f5baa-5230-4d6a-bb6a-34b44e44bbb7 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:48.881908 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f5baa-5230-4d6a-bb6a-34b44e44bbb7 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:48.883988 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 579/1147] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:43:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:43:48.891373 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff1c8a-9c53-4109-b61c-89f1af3381d4 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:48.891820 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff1c8a-9c53-4109-b61c-89f1af3381d4 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:48.891906 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff1c8a-9c53-4109-b61c-89f1af3381d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:48.914812 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-2dff1c8a-9c53-4109-b61c-89f1af3381d4 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:43:48.916007 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2dff1c8a-9c53-4109-b61c-89f1af3381d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:43:48.940713 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:48.991314 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 569/1148] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:43:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:43:49.265780 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9f5baa-5230-4d6a-bb6a-34b44e44bbb7 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:49.374740 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9f5baa-5230-4d6a-bb6a-34b44e44bbb7 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:49.410738 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019157b9-c687-4779-b9d2-a1bd01fe85b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:49.411362 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019157b9-c687-4779-b9d2-a1bd01fe85b9 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:49.411638 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019157b9-c687-4779-b9d2-a1bd01fe85b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:49.411906 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019157b9-c687-4779-b9d2-a1bd01fe85b9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:49.423270 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019157b9-c687-4779-b9d2-a1bd01fe85b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:43:49.428081 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-019157b9-c687-4779-b9d2-a1bd01fe85b9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:43:49.428081 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:49.428081 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:49.428081 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:49.428081 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:49.428081 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:49.428081 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:49.428081 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:49.428081 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:49.428081 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:49.428081 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:49.428081 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:49.428081 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:43:49.428081 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:43:49.428081 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:43:49.428081 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:43:49.429172 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:43:49.429172 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:43:49.429172 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:43:49.429172 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:43:49.429172 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:49.429172 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:49.429172 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:49.429172 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:49.429172 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:49.429172 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:49.429172 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:49.429172 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:49.429172 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:49.429172 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:49.429172 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:49.429172 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:49.430016 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:49.430016 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:49.430016 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:49.430016 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:49.430016 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:43:49.430016 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:43:49.430016 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:43:49.430016 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:43:49.430016 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:43:49.430016 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:43:49.430016 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:43:49.430016 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:43:49.430016 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 580/1149] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 19 14:43:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:43:49.435583 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dff1c8a-9c53-4109-b61c-89f1af3381d4 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:49.545127 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dff1c8a-9c53-4109-b61c-89f1af3381d4 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:49.582121 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5925e6cd-dafe-454c-a104-f4289b2a2158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:49.582728 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925e6cd-dafe-454c-a104-f4289b2a2158 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:49.583002 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925e6cd-dafe-454c-a104-f4289b2a2158 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:49.583275 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925e6cd-dafe-454c-a104-f4289b2a2158 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:49.583970 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5925e6cd-dafe-454c-a104-f4289b2a2158 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:49.584265 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5925e6cd-dafe-454c-a104-f4289b2a2158 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:49.585668 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5925e6cd-dafe-454c-a104-f4289b2a2158 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:49.594112 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 570/1150] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 19 14:43:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:49.600719 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019157b9-c687-4779-b9d2-a1bd01fe85b9 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:49.627012 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:49.709350 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019157b9-c687-4779-b9d2-a1bd01fe85b9 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:49.747025 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4687933b-a728-4688-ad79-581c1a2dbf32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:49.747633 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687933b-a728-4688-ad79-581c1a2dbf32 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:49.747906 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687933b-a728-4688-ad79-581c1a2dbf32 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:49.748169 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687933b-a728-4688-ad79-581c1a2dbf32 None admin] PATH_INFO: `/v3/users/13f26ebbf43345b48b35958488a4c52f` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:49.749409 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4687933b-a728-4688-ad79-581c1a2dbf32 None admin] RBAC: Authorizing `identity:get_user(user_id=13f26ebbf43345b48b35958488a4c52f)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:49.750837 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4687933b-a728-4688-ad79-581c1a2dbf32 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:49.752398 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 581/1151] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 19 14:43:49 2022] GET /identity/v3/users/13f26ebbf43345b48b35958488a4c52f => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:49.759080 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5925e6cd-dafe-454c-a104-f4289b2a2158 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:49.786744 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:49.870282 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5925e6cd-dafe-454c-a104-f4289b2a2158 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:49.908458 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3d341f-4937-42e9-a863-f3b9a6edef16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:49.909108 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d341f-4937-42e9-a863-f3b9a6edef16 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:49.909356 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d341f-4937-42e9-a863-f3b9a6edef16 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:49.909615 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d341f-4937-42e9-a863-f3b9a6edef16 None admin] PATH_INFO: `/v3/projects/ffd18804a9bb4a97abfba8f14a65f6d1` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:49.910834 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3d341f-4937-42e9-a863-f3b9a6edef16 None admin] RBAC: Authorizing `identity:get_project(project_id=ffd18804a9bb4a97abfba8f14a65f6d1)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:49.912627 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3d341f-4937-42e9-a863-f3b9a6edef16 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:49.913949 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 571/1152] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 19 14:43:49 2022] GET /identity/v3/projects/ffd18804a9bb4a97abfba8f14a65f6d1 => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:49.920109 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4687933b-a728-4688-ad79-581c1a2dbf32 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:50.017615 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:50.027998 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4687933b-a728-4688-ad79-581c1a2dbf32 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:50.075993 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9bb116-2d3a-4e2d-aee9-e9f5a7f7dc21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:50.076646 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9bb116-2d3a-4e2d-aee9-e9f5a7f7dc21 None admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:50.076923 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9bb116-2d3a-4e2d-aee9-e9f5a7f7dc21 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:50.077229 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9bb116-2d3a-4e2d-aee9-e9f5a7f7dc21 None admin] PATH_INFO: `/v3/projects/ffd18804a9bb4a97abfba8f14a65f6d1/users/13f26ebbf43345b48b35958488a4c52f/roles/019bde1756cb40de8ce06cef6b261f79` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:50.079374 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9bb116-2d3a-4e2d-aee9-e9f5a7f7dc21 None admin] RBAC: Authorizing `identity:create_grant(project_id=ffd18804a9bb4a97abfba8f14a65f6d1, user_id=13f26ebbf43345b48b35958488a4c52f, role_id=019bde1756cb40de8ce06cef6b261f79)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:50.080811 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9bb116-2d3a-4e2d-aee9-e9f5a7f7dc21 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:50.096534 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 582/1153] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Sep 19 14:43:49 2022] PUT /identity/v3/projects/ffd18804a9bb4a97abfba8f14a65f6d1/users/13f26ebbf43345b48b35958488a4c52f/roles/019bde1756cb40de8ce06cef6b261f79 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:43:52.207945 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df66c3-0658-4c0f-80f5-8ae29af396a8 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:52.208523 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df66c3-0658-4c0f-80f5-8ae29af396a8 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:52.208523 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df66c3-0658-4c0f-80f5-8ae29af396a8 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:52.210139 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 572/1154] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:43:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:43:52.217365 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9363f99c-1114-42ca-9f15-a7c4c768dc2b None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:52.218141 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9363f99c-1114-42ca-9f15-a7c4c768dc2b None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:52.218279 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9363f99c-1114-42ca-9f15-a7c4c768dc2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:52.246219 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-9363f99c-1114-42ca-9f15-a7c4c768dc2b None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:43:52.247417 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-9363f99c-1114-42ca-9f15-a7c4c768dc2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:43:52.321359 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 583/1155] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:43:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:43:52.600842 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0df66c3-0658-4c0f-80f5-8ae29af396a8 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:52.696625 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:52.711000 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0df66c3-0658-4c0f-80f5-8ae29af396a8 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:52.746449 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0258a541-fc0b-4896-9f30-3a1642764e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:52.747053 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0258a541-fc0b-4896-9f30-3a1642764e88 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:52.747325 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0258a541-fc0b-4896-9f30-3a1642764e88 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:52.747595 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0258a541-fc0b-4896-9f30-3a1642764e88 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:52.758823 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0258a541-fc0b-4896-9f30-3a1642764e88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:43:52.763570 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-0258a541-fc0b-4896-9f30-3a1642764e88 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:43:52.763570 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:52.763570 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:52.763570 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:52.763570 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:52.763570 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:52.763570 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:52.763570 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:52.763570 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:52.763570 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:52.763570 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:52.763570 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:52.763570 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:43:52.763570 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:43:52.763570 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:43:52.763570 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:43:52.764637 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:43:52.764637 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:43:52.764637 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:43:52.764637 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:43:52.764637 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:52.764637 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:52.764637 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:52.764637 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:52.764637 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:52.764637 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:52.764637 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:52.764637 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:52.764637 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:52.764637 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:52.764637 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:52.764637 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:52.765621 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:52.765621 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:52.765621 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:52.765621 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:52.765621 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:43:52.765621 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:43:52.765621 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:43:52.765621 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:43:52.765621 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:43:52.765621 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:43:52.765621 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:43:52.765621 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:43:52.765621 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 573/1156] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 19 14:43:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:43:52.771842 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9363f99c-1114-42ca-9f15-a7c4c768dc2b None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:52.877861 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:52.899092 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9363f99c-1114-42ca-9f15-a7c4c768dc2b None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:52.934428 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66af807-7f3f-4242-8301-992b32dccc2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:52.935018 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66af807-7f3f-4242-8301-992b32dccc2b None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:52.935305 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66af807-7f3f-4242-8301-992b32dccc2b None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:52.935545 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66af807-7f3f-4242-8301-992b32dccc2b None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:52.936198 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66af807-7f3f-4242-8301-992b32dccc2b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:52.936488 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66af807-7f3f-4242-8301-992b32dccc2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:52.937884 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66af807-7f3f-4242-8301-992b32dccc2b None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:52.946840 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 584/1157] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 19 14:43:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:52.953744 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0258a541-fc0b-4896-9f30-3a1642764e88 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:53.062314 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0258a541-fc0b-4896-9f30-3a1642764e88 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:53.097444 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8d2620-b356-40a2-bd5c-b96c6de4149d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:53.098053 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d2620-b356-40a2-bd5c-b96c6de4149d None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:53.098325 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d2620-b356-40a2-bd5c-b96c6de4149d None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:53.098596 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d2620-b356-40a2-bd5c-b96c6de4149d None admin] PATH_INFO: `/v3/users/13f26ebbf43345b48b35958488a4c52f` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:53.099921 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8d2620-b356-40a2-bd5c-b96c6de4149d None admin] RBAC: Authorizing `identity:get_user(user_id=13f26ebbf43345b48b35958488a4c52f)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:53.101410 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8d2620-b356-40a2-bd5c-b96c6de4149d None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:53.102991 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 574/1158] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 19 14:43:52 2022] GET /identity/v3/users/13f26ebbf43345b48b35958488a4c52f => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:53.109232 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66af807-7f3f-4242-8301-992b32dccc2b None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:53.212597 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66af807-7f3f-4242-8301-992b32dccc2b None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:53.248715 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd074de-dea1-46de-a4a3-8d162f5b8cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:53.249400 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd074de-dea1-46de-a4a3-8d162f5b8cd8 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:53.249598 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd074de-dea1-46de-a4a3-8d162f5b8cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:53.249864 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd074de-dea1-46de-a4a3-8d162f5b8cd8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:53.261872 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:53.333386 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd074de-dea1-46de-a4a3-8d162f5b8cd8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:53.335189 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd074de-dea1-46de-a4a3-8d162f5b8cd8 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:53.437030 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 585/1159] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 19 14:43:53 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 14:43:53.443709 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8d2620-b356-40a2-bd5c-b96c6de4149d None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:53.462960 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:53.546958 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8d2620-b356-40a2-bd5c-b96c6de4149d None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:53.582967 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0785b249-efdf-45a3-b982-166cf99fa703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:53.583605 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0785b249-efdf-45a3-b982-166cf99fa703 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:53.583971 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0785b249-efdf-45a3-b982-166cf99fa703 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:53.584268 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0785b249-efdf-45a3-b982-166cf99fa703 None admin] PATH_INFO: `/v3/projects/ffd18804a9bb4a97abfba8f14a65f6d1` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:53.585468 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0785b249-efdf-45a3-b982-166cf99fa703 None admin] RBAC: Authorizing `identity:get_project(project_id=ffd18804a9bb4a97abfba8f14a65f6d1)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:53.586926 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0785b249-efdf-45a3-b982-166cf99fa703 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:53.588576 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 575/1160] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 19 14:43:53 2022] GET /identity/v3/projects/ffd18804a9bb4a97abfba8f14a65f6d1 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:53.596043 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd074de-dea1-46de-a4a3-8d162f5b8cd8 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:53.644122 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:53.703956 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd074de-dea1-46de-a4a3-8d162f5b8cd8 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:53.740150 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd2253a-dc92-4319-9373-632fba24f2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:53.741181 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd2253a-dc92-4319-9373-632fba24f2bc None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:53.741452 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd2253a-dc92-4319-9373-632fba24f2bc None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:53.741704 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd2253a-dc92-4319-9373-632fba24f2bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:53.742421 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd2253a-dc92-4319-9373-632fba24f2bc None admin] RBAC: Adding query filter params (role.id=019bde1756cb40de8ce06cef6b261f79, scope.project.id=ffd18804a9bb4a97abfba8f14a65f6d1, user.id=13f26ebbf43345b48b35958488a4c52f) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:53.742725 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd2253a-dc92-4319-9373-632fba24f2bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:53.744147 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd2253a-dc92-4319-9373-632fba24f2bc None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:53.750661 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 586/1161] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 19 14:43:53 2022] GET /identity/v3/role_assignments?user.id=13f26ebbf43345b48b35958488a4c52f&scope.project.id=ffd18804a9bb4a97abfba8f14a65f6d1&role.id=019bde1756cb40de8ce06cef6b261f79 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:55.902258 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d568f8-5c20-4420-86ce-d0b5b2571848 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:55.903220 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d568f8-5c20-4420-86ce-d0b5b2571848 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:55.903220 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d568f8-5c20-4420-86ce-d0b5b2571848 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:55.905538 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 576/1162] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:43:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:43:55.914519 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d509d0-e4ce-4bb2-be0c-5977ee775d2b None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:55.915022 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d509d0-e4ce-4bb2-be0c-5977ee775d2b None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:55.915022 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d509d0-e4ce-4bb2-be0c-5977ee775d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:55.935168 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-88d509d0-e4ce-4bb2-be0c-5977ee775d2b None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:43:55.936332 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-88d509d0-e4ce-4bb2-be0c-5977ee775d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:43:56.011941 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 587/1163] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:43:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:43:56.285356 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d568f8-5c20-4420-86ce-d0b5b2571848 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:56.390540 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:56.412436 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d568f8-5c20-4420-86ce-d0b5b2571848 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:56.451304 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1918d3e2-0862-444f-b7c9-9655e5fbcd48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:56.451893 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1918d3e2-0862-444f-b7c9-9655e5fbcd48 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:56.452165 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1918d3e2-0862-444f-b7c9-9655e5fbcd48 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:56.452433 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1918d3e2-0862-444f-b7c9-9655e5fbcd48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:56.524228 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1918d3e2-0862-444f-b7c9-9655e5fbcd48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:56.525744 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1918d3e2-0862-444f-b7c9-9655e5fbcd48 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:56.611569 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:56.628630 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 577/1164] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 19 14:43:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 14:43:56.635181 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d509d0-e4ce-4bb2-be0c-5977ee775d2b None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:56.671297 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:56.741684 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d509d0-e4ce-4bb2-be0c-5977ee775d2b None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:56.777749 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb57b38-1b81-436b-b97a-1451b349f805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:56.778360 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb57b38-1b81-436b-b97a-1451b349f805 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:56.778633 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb57b38-1b81-436b-b97a-1451b349f805 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:56.778900 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb57b38-1b81-436b-b97a-1451b349f805 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:56.785556 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb57b38-1b81-436b-b97a-1451b349f805 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:56.787047 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb57b38-1b81-436b-b97a-1451b349f805 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:56.799059 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-1fb57b38-1b81-436b-b97a-1451b349f805 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 19 14:43:56.799059 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:56.799059 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 19 14:43:56.799059 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 19 14:43:56.799059 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:43:56.799059 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:43:56.799059 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:43:56.799059 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:43:56.799059 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 19 14:43:56.799059 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:43:56.799059 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 14:43:56.799059 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:43:56.799059 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:43:56.799059 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:43:56.799059 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:43:56.799059 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:43:56.799059 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:43:56.800287 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:43:56.800287 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:43:56.800287 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:43:56.800287 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:43:56.800287 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:43:56.800287 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:43:56.800287 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:43:56.800287 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:43:56.800287 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:43:56.800287 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:43:56.800287 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:43:56.800287 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:43:56.800287 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:43:56.800287 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:43:56.800287 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:43:56.800287 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:43:56.801159 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:43:56.801159 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:43:56.801159 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:43:56.801159 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:43:56.801159 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:43:56.801159 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:43:56.801159 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:43:56.801159 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:43:56.801159 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:43:56.801159 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:43:56.801159 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 19 14:43:56.801159 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:43:56.801159 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 19 14:43:56.801159 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:43:56.801159 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 588/1165] 10.222.0.26 () {56 vars in 1117 bytes} [Mon Sep 19 14:43:56 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:43:56.807185 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1918d3e2-0862-444f-b7c9-9655e5fbcd48 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:56.928452 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1918d3e2-0862-444f-b7c9-9655e5fbcd48 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:56.965699 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840dc027-fbaa-457d-962b-801205880c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:56.966307 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840dc027-fbaa-457d-962b-801205880c32 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:56.966649 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840dc027-fbaa-457d-962b-801205880c32 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:56.966820 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840dc027-fbaa-457d-962b-801205880c32 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:56.967483 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840dc027-fbaa-457d-962b-801205880c32 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:43:56.967774 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840dc027-fbaa-457d-962b-801205880c32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:56.969169 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840dc027-fbaa-457d-962b-801205880c32 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:56.976590 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 578/1166] 10.222.0.26 () {56 vars in 1115 bytes} [Mon Sep 19 14:43:56 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:43:59.170919 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4304927a-0679-4314-a7d7-66b4e5c0d208 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:59.171812 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4304927a-0679-4314-a7d7-66b4e5c0d208 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:59.171812 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4304927a-0679-4314-a7d7-66b4e5c0d208 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:59.173980 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 589/1167] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:43:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:43:59.181084 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9c620b-bcfb-46d4-b4f1-90d6e4c7ee64 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:59.181537 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9c620b-bcfb-46d4-b4f1-90d6e4c7ee64 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:59.181630 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9c620b-bcfb-46d4-b4f1-90d6e4c7ee64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:59.206256 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-ae9c620b-bcfb-46d4-b4f1-90d6e4c7ee64 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:43:59.207438 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ae9c620b-bcfb-46d4-b4f1-90d6e4c7ee64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:43:59.259653 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:59.284632 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 579/1168] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:43:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:43:59.565507 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4304927a-0679-4314-a7d7-66b4e5c0d208 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:43:59.670104 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:43:59.678880 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4304927a-0679-4314-a7d7-66b4e5c0d208 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:43:59.716649 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0eadd7-27cb-4aed-b22a-b731562ab624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:43:59.717269 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0eadd7-27cb-4aed-b22a-b731562ab624 None admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:43:59.717543 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0eadd7-27cb-4aed-b22a-b731562ab624 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:43:59.717808 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0eadd7-27cb-4aed-b22a-b731562ab624 None admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:43:59.718463 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0eadd7-27cb-4aed-b22a-b731562ab624 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:43:59.719849 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0eadd7-27cb-4aed-b22a-b731562ab624 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:43:59.739140 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 590/1169] 10.222.0.26 () {60 vars in 1138 bytes} [Mon Sep 19 14:43:59 2022] POST /identity/v3/domains => generated 267 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:44:01.919142 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3540a4-a3f9-4140-bfa8-11f5f369b6b4 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:01.919732 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3540a4-a3f9-4140-bfa8-11f5f369b6b4 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:01.919732 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3540a4-a3f9-4140-bfa8-11f5f369b6b4 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:01.921049 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 580/1170] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:44:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:44:01.927706 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a35bdef-31ae-4d14-a816-13f7ccd50db0 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:01.928410 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a35bdef-31ae-4d14-a816-13f7ccd50db0 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:01.928599 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a35bdef-31ae-4d14-a816-13f7ccd50db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:01.959158 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-5a35bdef-31ae-4d14-a816-13f7ccd50db0 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:44:01.960381 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-5a35bdef-31ae-4d14-a816-13f7ccd50db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:44:02.049963 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 591/1171] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:44:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:44:02.315871 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3540a4-a3f9-4140-bfa8-11f5f369b6b4 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:02.430565 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3540a4-a3f9-4140-bfa8-11f5f369b6b4 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:02.468105 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1c6759-f6e4-4764-95c8-d2279551575d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:02.468722 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c6759-f6e4-4764-95c8-d2279551575d None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:02.469032 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c6759-f6e4-4764-95c8-d2279551575d None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:02.469297 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c6759-f6e4-4764-95c8-d2279551575d None admin] PATH_INFO: `/v3/domains/675c17c3c7fd4aa3867c51ac348ff7ca` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:02.481100 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1c6759-f6e4-4764-95c8-d2279551575d None admin] RBAC: Authorizing `identity:get_domain(domain_id=675c17c3c7fd4aa3867c51ac348ff7ca)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:02.482554 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1c6759-f6e4-4764-95c8-d2279551575d None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:02.484145 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 581/1172] 10.222.0.26 () {56 vars in 1183 bytes} [Mon Sep 19 14:44:02 2022] GET /identity/v3/domains/675c17c3c7fd4aa3867c51ac348ff7ca => generated 267 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:02.492537 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a35bdef-31ae-4d14-a816-13f7ccd50db0 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:02.595680 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:02.614396 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a35bdef-31ae-4d14-a816-13f7ccd50db0 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:02.649756 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab356296-40b9-4c98-85cf-986de59d3081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:02.650356 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab356296-40b9-4c98-85cf-986de59d3081 None admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:02.650635 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab356296-40b9-4c98-85cf-986de59d3081 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:02.650910 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab356296-40b9-4c98-85cf-986de59d3081 None admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:02.651559 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab356296-40b9-4c98-85cf-986de59d3081 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:02.653026 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab356296-40b9-4c98-85cf-986de59d3081 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:02.688057 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 592/1173] 10.222.0.26 () {60 vars in 1141 bytes} [Mon Sep 19 14:44:02 2022] POST /identity/v3/projects => generated 361 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:44:04.965782 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2efb6bf-7b72-45f9-9501-371256319fd2 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:04.966682 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2efb6bf-7b72-45f9-9501-371256319fd2 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:04.966682 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2efb6bf-7b72-45f9-9501-371256319fd2 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:04.969047 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 582/1174] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:44:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:44:04.974732 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c1e099-8229-4a8e-9743-eb60de17aaf5 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:04.975159 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c1e099-8229-4a8e-9743-eb60de17aaf5 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:04.975389 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c1e099-8229-4a8e-9743-eb60de17aaf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:04.995675 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-d1c1e099-8229-4a8e-9743-eb60de17aaf5 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:44:04.996869 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-d1c1e099-8229-4a8e-9743-eb60de17aaf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:44:05.068523 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 593/1175] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:44:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 14:44:05.341184 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2efb6bf-7b72-45f9-9501-371256319fd2 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:05.388511 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:05.461526 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2efb6bf-7b72-45f9-9501-371256319fd2 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:05.496220 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3237e1-72bf-4dfb-9fe9-556ca82542f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:05.496904 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3237e1-72bf-4dfb-9fe9-556ca82542f3 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:05.497188 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3237e1-72bf-4dfb-9fe9-556ca82542f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:05.497462 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3237e1-72bf-4dfb-9fe9-556ca82542f3 None admin] PATH_INFO: `/v3/domains/675c17c3c7fd4aa3867c51ac348ff7ca` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:05.498589 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3237e1-72bf-4dfb-9fe9-556ca82542f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=675c17c3c7fd4aa3867c51ac348ff7ca)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:05.500025 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3237e1-72bf-4dfb-9fe9-556ca82542f3 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:05.501659 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 583/1176] 10.222.0.26 () {56 vars in 1183 bytes} [Mon Sep 19 14:44:05 2022] GET /identity/v3/domains/675c17c3c7fd4aa3867c51ac348ff7ca => generated 267 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:05.511450 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c1e099-8229-4a8e-9743-eb60de17aaf5 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:05.587429 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:05.624126 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c1e099-8229-4a8e-9743-eb60de17aaf5 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:05.659214 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995a9509-f2c7-4c8f-87f3-32a8d9557b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:05.659808 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995a9509-f2c7-4c8f-87f3-32a8d9557b12 None admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:05.660080 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995a9509-f2c7-4c8f-87f3-32a8d9557b12 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:05.660345 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995a9509-f2c7-4c8f-87f3-32a8d9557b12 None admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:05.661024 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995a9509-f2c7-4c8f-87f3-32a8d9557b12 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:05.662496 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995a9509-f2c7-4c8f-87f3-32a8d9557b12 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:05.688097 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 594/1177] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Sep 19 14:44:05 2022] POST /identity/v3/users => generated 311 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:44:07.873428 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2617016-a164-4503-9664-0acc680a63fa None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:07.874468 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2617016-a164-4503-9664-0acc680a63fa None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:07.874468 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2617016-a164-4503-9664-0acc680a63fa None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:07.876476 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 584/1178] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:44:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:44:07.883065 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e583964-f0b7-4734-b552-e32f1d4f26dd None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:07.883531 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e583964-f0b7-4734-b552-e32f1d4f26dd None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:07.883642 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e583964-f0b7-4734-b552-e32f1d4f26dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:07.907101 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-7e583964-f0b7-4734-b552-e32f1d4f26dd None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:44:07.908280 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-7e583964-f0b7-4734-b552-e32f1d4f26dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:44:07.978791 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 595/1179] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:44:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:44:08.246987 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2617016-a164-4503-9664-0acc680a63fa None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:08.356734 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2617016-a164-4503-9664-0acc680a63fa None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:08.363458 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:08.396274 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b408a275-8923-41b8-a1e4-67b7f5ab15c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:08.396873 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b408a275-8923-41b8-a1e4-67b7f5ab15c2 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:08.397172 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b408a275-8923-41b8-a1e4-67b7f5ab15c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:08.397439 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b408a275-8923-41b8-a1e4-67b7f5ab15c2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:08.408040 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b408a275-8923-41b8-a1e4-67b7f5ab15c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:44:08.412952 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-b408a275-8923-41b8-a1e4-67b7f5ab15c2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:44:08.412952 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:08.412952 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:08.412952 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:08.412952 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:08.412952 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:08.412952 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:08.412952 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:08.412952 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:08.412952 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:08.412952 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:08.412952 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:08.412952 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:44:08.412952 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:44:08.412952 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:44:08.412952 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:44:08.414007 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:44:08.414007 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:44:08.414007 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:44:08.414007 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:44:08.414007 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:08.414007 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:08.414007 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:08.414007 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:08.414007 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:08.414007 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:08.414007 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:08.414007 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:08.414007 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:08.414007 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:08.414007 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:08.414007 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:08.414925 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:08.414925 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:08.414925 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:08.414925 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:08.414925 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:44:08.414925 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:44:08.414925 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:44:08.414925 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:44:08.414925 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:44:08.414925 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:44:08.414925 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:44:08.414925 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:44:08.414925 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 585/1180] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 19 14:44:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:08.420472 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e583964-f0b7-4734-b552-e32f1d4f26dd None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:08.488149 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:08.539845 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e583964-f0b7-4734-b552-e32f1d4f26dd None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:08.579069 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7b96d9-4af3-4e2c-a87c-cbceba34dd78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:08.579674 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b96d9-4af3-4e2c-a87c-cbceba34dd78 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:08.579954 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b96d9-4af3-4e2c-a87c-cbceba34dd78 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:08.580229 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b96d9-4af3-4e2c-a87c-cbceba34dd78 None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:08.580890 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7b96d9-4af3-4e2c-a87c-cbceba34dd78 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:08.581221 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7b96d9-4af3-4e2c-a87c-cbceba34dd78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:08.582585 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7b96d9-4af3-4e2c-a87c-cbceba34dd78 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:08.591787 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 596/1181] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 19 14:44:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:08.598166 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b408a275-8923-41b8-a1e4-67b7f5ab15c2 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:08.710257 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b408a275-8923-41b8-a1e4-67b7f5ab15c2 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:08.744161 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7421a71c-2a43-4c8a-810e-e84d504567af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:08.744775 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7421a71c-2a43-4c8a-810e-e84d504567af None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:08.745080 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7421a71c-2a43-4c8a-810e-e84d504567af None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:08.745347 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7421a71c-2a43-4c8a-810e-e84d504567af None admin] PATH_INFO: `/v3/users/c88e9748c7b6401abe6828a19ba7a6d1` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:08.758527 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7421a71c-2a43-4c8a-810e-e84d504567af None admin] RBAC: Authorizing `identity:get_user(user_id=c88e9748c7b6401abe6828a19ba7a6d1)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:08.759987 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7421a71c-2a43-4c8a-810e-e84d504567af None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:08.761657 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 586/1182] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 19 14:44:08 2022] GET /identity/v3/users/c88e9748c7b6401abe6828a19ba7a6d1 => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:08.768274 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7b96d9-4af3-4e2c-a87c-cbceba34dd78 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:08.889964 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7b96d9-4af3-4e2c-a87c-cbceba34dd78 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:08.915291 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:08.935856 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd76c942-6f8d-4cdb-be6b-f6b1fa496ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:08.936461 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd76c942-6f8d-4cdb-be6b-f6b1fa496ae2 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:08.936745 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd76c942-6f8d-4cdb-be6b-f6b1fa496ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:08.937031 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd76c942-6f8d-4cdb-be6b-f6b1fa496ae2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:09.010689 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd76c942-6f8d-4cdb-be6b-f6b1fa496ae2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:09.012146 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd76c942-6f8d-4cdb-be6b-f6b1fa496ae2 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:09.117773 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 597/1183] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 19 14:44:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 14:44:09.128217 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7421a71c-2a43-4c8a-810e-e84d504567af None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:09.155388 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:09.235599 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7421a71c-2a43-4c8a-810e-e84d504567af None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:09.276938 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460ff794-5a74-4aa8-9e08-37093a7e8078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:09.277567 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ff794-5a74-4aa8-9e08-37093a7e8078 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:09.277839 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ff794-5a74-4aa8-9e08-37093a7e8078 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:09.278107 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ff794-5a74-4aa8-9e08-37093a7e8078 None admin] PATH_INFO: `/v3/projects/049a4d8d08d041518f21b8a1586455a5` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:09.279306 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460ff794-5a74-4aa8-9e08-37093a7e8078 None admin] RBAC: Authorizing `identity:get_project(project_id=049a4d8d08d041518f21b8a1586455a5)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:09.287788 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460ff794-5a74-4aa8-9e08-37093a7e8078 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:09.289470 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 587/1184] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 19 14:44:09 2022] GET /identity/v3/projects/049a4d8d08d041518f21b8a1586455a5 => generated 361 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:09.295952 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd76c942-6f8d-4cdb-be6b-f6b1fa496ae2 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:09.315692 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:09.404472 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd76c942-6f8d-4cdb-be6b-f6b1fa496ae2 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:09.440459 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d8d601-fcc7-45bf-ace8-97338f3a62ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:09.440982 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d8d601-fcc7-45bf-ace8-97338f3a62ba None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:09.441283 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d8d601-fcc7-45bf-ace8-97338f3a62ba None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:09.441617 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d8d601-fcc7-45bf-ace8-97338f3a62ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:09.442331 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d8d601-fcc7-45bf-ace8-97338f3a62ba None admin] RBAC: Adding query filter params (role.id=019bde1756cb40de8ce06cef6b261f79, scope.project.id=049a4d8d08d041518f21b8a1586455a5, user.id=c88e9748c7b6401abe6828a19ba7a6d1) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:09.442636 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d8d601-fcc7-45bf-ace8-97338f3a62ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:09.444521 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d8d601-fcc7-45bf-ace8-97338f3a62ba None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:09.450738 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 598/1185] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 19 14:44:09 2022] GET /identity/v3/role_assignments?user.id=c88e9748c7b6401abe6828a19ba7a6d1&scope.project.id=049a4d8d08d041518f21b8a1586455a5&role.id=019bde1756cb40de8ce06cef6b261f79 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:11.622832 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c6e1c4-2d8e-458e-8db4-8ef3f15ecebb None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:11.623734 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c6e1c4-2d8e-458e-8db4-8ef3f15ecebb None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:11.623734 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c6e1c4-2d8e-458e-8db4-8ef3f15ecebb None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:11.625905 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 588/1186] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:44:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:44:11.635648 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d4ccc-ffdc-4ed5-86e6-e7b9af010831 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:11.636326 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d4ccc-ffdc-4ed5-86e6-e7b9af010831 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:11.636479 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d4ccc-ffdc-4ed5-86e6-e7b9af010831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:11.661704 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-7c8d4ccc-ffdc-4ed5-86e6-e7b9af010831 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:44:11.663718 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-7c8d4ccc-ffdc-4ed5-86e6-e7b9af010831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:44:11.738576 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 599/1187] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:44:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:44:12.005637 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c6e1c4-2d8e-458e-8db4-8ef3f15ecebb None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:12.108114 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:12.120864 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c6e1c4-2d8e-458e-8db4-8ef3f15ecebb None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:12.158661 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc73edc2-76d0-4fb6-8e18-ed53667e9740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:12.159274 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc73edc2-76d0-4fb6-8e18-ed53667e9740 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:12.159548 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc73edc2-76d0-4fb6-8e18-ed53667e9740 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:12.159815 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc73edc2-76d0-4fb6-8e18-ed53667e9740 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:12.170395 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc73edc2-76d0-4fb6-8e18-ed53667e9740 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:44:12.175183 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-fc73edc2-76d0-4fb6-8e18-ed53667e9740 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:44:12.175183 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:12.175183 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:12.175183 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:12.175183 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:12.175183 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:12.175183 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:12.175183 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:12.175183 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:12.175183 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:12.175183 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:12.175183 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:12.175183 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:44:12.175183 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:44:12.175183 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:44:12.175183 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:44:12.176204 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:44:12.176204 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:44:12.176204 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:44:12.176204 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:44:12.176204 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:12.176204 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:12.176204 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:12.176204 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:12.176204 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:12.176204 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:12.176204 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:12.176204 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:12.176204 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:12.176204 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:12.176204 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:12.176204 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:12.177262 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:12.177262 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:12.177262 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:12.177262 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:12.177262 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:44:12.177262 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:44:12.177262 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:44:12.177262 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:44:12.177262 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:44:12.177262 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:44:12.177262 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:44:12.177262 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:44:12.177262 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 589/1188] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 19 14:44:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:12.182796 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8d4ccc-ffdc-4ed5-86e6-e7b9af010831 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:12.194617 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:12.286275 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8d4ccc-ffdc-4ed5-86e6-e7b9af010831 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:12.321220 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1831c2e3-1bda-4ce4-8e2d-855baa9da5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:12.321811 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1831c2e3-1bda-4ce4-8e2d-855baa9da5a9 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:12.322082 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1831c2e3-1bda-4ce4-8e2d-855baa9da5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:12.322350 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1831c2e3-1bda-4ce4-8e2d-855baa9da5a9 None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:12.323007 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1831c2e3-1bda-4ce4-8e2d-855baa9da5a9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:12.323308 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1831c2e3-1bda-4ce4-8e2d-855baa9da5a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:12.324669 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1831c2e3-1bda-4ce4-8e2d-855baa9da5a9 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:12.332786 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 600/1189] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 19 14:44:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:12.339612 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc73edc2-76d0-4fb6-8e18-ed53667e9740 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:12.454640 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc73edc2-76d0-4fb6-8e18-ed53667e9740 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:12.494228 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a46b28-451c-4461-95fe-f2cb44430a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:12.494852 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a46b28-451c-4461-95fe-f2cb44430a96 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:12.495131 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a46b28-451c-4461-95fe-f2cb44430a96 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:12.495405 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a46b28-451c-4461-95fe-f2cb44430a96 None admin] PATH_INFO: `/v3/users/c88e9748c7b6401abe6828a19ba7a6d1` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:12.496645 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a46b28-451c-4461-95fe-f2cb44430a96 None admin] RBAC: Authorizing `identity:get_user(user_id=c88e9748c7b6401abe6828a19ba7a6d1)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:12.498123 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a46b28-451c-4461-95fe-f2cb44430a96 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:12.499724 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 590/1190] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 19 14:44:12 2022] GET /identity/v3/users/c88e9748c7b6401abe6828a19ba7a6d1 => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:12.506296 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1831c2e3-1bda-4ce4-8e2d-855baa9da5a9 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:12.582671 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:12.624716 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1831c2e3-1bda-4ce4-8e2d-855baa9da5a9 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:12.664473 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c59dd9-2884-466a-b748-45dd4bd9c1aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:12.665143 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c59dd9-2884-466a-b748-45dd4bd9c1aa None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:12.665378 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c59dd9-2884-466a-b748-45dd4bd9c1aa None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:12.665651 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c59dd9-2884-466a-b748-45dd4bd9c1aa None admin] PATH_INFO: `/v3/projects/049a4d8d08d041518f21b8a1586455a5` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:12.666881 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c59dd9-2884-466a-b748-45dd4bd9c1aa None admin] RBAC: Authorizing `identity:get_project(project_id=049a4d8d08d041518f21b8a1586455a5)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:12.668315 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c59dd9-2884-466a-b748-45dd4bd9c1aa None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:12.670141 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 601/1191] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 19 14:44:12 2022] GET /identity/v3/projects/049a4d8d08d041518f21b8a1586455a5 => generated 361 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:12.676619 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a46b28-451c-4461-95fe-f2cb44430a96 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:12.701963 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:12.784875 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a46b28-451c-4461-95fe-f2cb44430a96 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:12.819823 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3199351c-b47b-4742-9b64-5c604e51e086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:12.820449 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3199351c-b47b-4742-9b64-5c604e51e086 None admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:12.820722 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3199351c-b47b-4742-9b64-5c604e51e086 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:12.820982 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3199351c-b47b-4742-9b64-5c604e51e086 None admin] PATH_INFO: `/v3/projects/049a4d8d08d041518f21b8a1586455a5/users/c88e9748c7b6401abe6828a19ba7a6d1/roles/019bde1756cb40de8ce06cef6b261f79` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:12.823128 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3199351c-b47b-4742-9b64-5c604e51e086 None admin] RBAC: Authorizing `identity:create_grant(project_id=049a4d8d08d041518f21b8a1586455a5, user_id=c88e9748c7b6401abe6828a19ba7a6d1, role_id=019bde1756cb40de8ce06cef6b261f79)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:12.824551 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3199351c-b47b-4742-9b64-5c604e51e086 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:12.840780 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 591/1192] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Sep 19 14:44:12 2022] PUT /identity/v3/projects/049a4d8d08d041518f21b8a1586455a5/users/c88e9748c7b6401abe6828a19ba7a6d1/roles/019bde1756cb40de8ce06cef6b261f79 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:44:15.009874 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60859710-05b2-4650-a25a-60f0cc074307 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:15.010352 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60859710-05b2-4650-a25a-60f0cc074307 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:15.010453 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60859710-05b2-4650-a25a-60f0cc074307 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:15.012479 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 602/1193] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:44:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:44:15.017823 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8baf4c-4d5c-46f3-825f-638cb6cdf631 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:15.018273 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8baf4c-4d5c-46f3-825f-638cb6cdf631 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:15.018374 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8baf4c-4d5c-46f3-825f-638cb6cdf631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:15.038607 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-8d8baf4c-4d5c-46f3-825f-638cb6cdf631 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:44:15.039770 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-8d8baf4c-4d5c-46f3-825f-638cb6cdf631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:44:15.111042 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 592/1194] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:44:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:44:15.391728 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60859710-05b2-4650-a25a-60f0cc074307 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:15.511388 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60859710-05b2-4650-a25a-60f0cc074307 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:15.546683 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcbf879-b7c7-4ea7-88e2-d5bcae3da8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:15.547304 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcbf879-b7c7-4ea7-88e2-d5bcae3da8fa None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:15.547582 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcbf879-b7c7-4ea7-88e2-d5bcae3da8fa None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:15.547844 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcbf879-b7c7-4ea7-88e2-d5bcae3da8fa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:15.555964 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:15.560227 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcbf879-b7c7-4ea7-88e2-d5bcae3da8fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:44:15.565422 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-0fcbf879-b7c7-4ea7-88e2-d5bcae3da8fa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:44:15.565422 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:44:15.565422 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:44:15.565422 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:44:15.565422 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:44:15.565422 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:44:15.565422 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:44:15.565422 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:44:15.565422 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:44:15.565422 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:44:15.565422 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:44:15.565422 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:44:15.565422 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:44:15.565422 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:44:15.565422 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:44:15.565422 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:44:15.566558 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:44:15.566558 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:44:15.566558 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:44:15.566558 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:44:15.566558 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:44:15.566558 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:44:15.566558 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:44:15.566558 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:44:15.566558 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:44:15.566558 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:44:15.566558 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:44:15.566558 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:44:15.566558 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:44:15.566558 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:44:15.566558 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:44:15.566558 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:44:15.567418 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:44:15.567418 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:44:15.567418 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:44:15.567418 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:44:15.567418 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:44:15.567418 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:44:15.567418 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:44:15.567418 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:44:15.567418 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:44:15.567418 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:44:15.567418 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:44:15.567418 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:44:15.567418 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 603/1195] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 19 14:44:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:44:15.572973 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8baf4c-4d5c-46f3-825f-638cb6cdf631 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:15.584785 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:15.690057 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8baf4c-4d5c-46f3-825f-638cb6cdf631 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:15.726598 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d93a8d9-e4c1-4bbd-b3e0-5b10fa2cfe29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:15.727195 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d93a8d9-e4c1-4bbd-b3e0-5b10fa2cfe29 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:15.727470 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d93a8d9-e4c1-4bbd-b3e0-5b10fa2cfe29 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:15.727739 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d93a8d9-e4c1-4bbd-b3e0-5b10fa2cfe29 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:15.728404 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d93a8d9-e4c1-4bbd-b3e0-5b10fa2cfe29 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:15.728703 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d93a8d9-e4c1-4bbd-b3e0-5b10fa2cfe29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:15.730172 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d93a8d9-e4c1-4bbd-b3e0-5b10fa2cfe29 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:15.738276 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 593/1196] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 19 14:44:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:15.745017 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcbf879-b7c7-4ea7-88e2-d5bcae3da8fa None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:15.852468 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcbf879-b7c7-4ea7-88e2-d5bcae3da8fa None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:15.886798 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11f889e-6b0e-4cbe-86b1-d013d9f95ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:15.887407 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11f889e-6b0e-4cbe-86b1-d013d9f95ef9 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:15.887676 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11f889e-6b0e-4cbe-86b1-d013d9f95ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:15.887936 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11f889e-6b0e-4cbe-86b1-d013d9f95ef9 None admin] PATH_INFO: `/v3/users/c88e9748c7b6401abe6828a19ba7a6d1` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:15.889183 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11f889e-6b0e-4cbe-86b1-d013d9f95ef9 None admin] RBAC: Authorizing `identity:get_user(user_id=c88e9748c7b6401abe6828a19ba7a6d1)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:15.890604 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11f889e-6b0e-4cbe-86b1-d013d9f95ef9 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:15.892149 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 604/1197] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Sep 19 14:44:15 2022] GET /identity/v3/users/c88e9748c7b6401abe6828a19ba7a6d1 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:15.899925 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d93a8d9-e4c1-4bbd-b3e0-5b10fa2cfe29 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:15.974164 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:16.011071 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d93a8d9-e4c1-4bbd-b3e0-5b10fa2cfe29 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:16.045268 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f365afbf-a76b-4ff1-af4a-b5a4da42a71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:16.045899 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f365afbf-a76b-4ff1-af4a-b5a4da42a71d None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:16.046121 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f365afbf-a76b-4ff1-af4a-b5a4da42a71d None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:16.046385 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f365afbf-a76b-4ff1-af4a-b5a4da42a71d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:16.116149 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f365afbf-a76b-4ff1-af4a-b5a4da42a71d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:16.117614 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f365afbf-a76b-4ff1-af4a-b5a4da42a71d None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:16.188228 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:16.229120 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 594/1198] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 19 14:44:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 14:44:16.238729 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11f889e-6b0e-4cbe-86b1-d013d9f95ef9 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:16.310937 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:16.346196 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11f889e-6b0e-4cbe-86b1-d013d9f95ef9 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:16.381733 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed70ccb2-b19c-4cf6-a958-ed035a3617d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:16.382356 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed70ccb2-b19c-4cf6-a958-ed035a3617d3 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:16.382628 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed70ccb2-b19c-4cf6-a958-ed035a3617d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:16.382893 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed70ccb2-b19c-4cf6-a958-ed035a3617d3 None admin] PATH_INFO: `/v3/projects/049a4d8d08d041518f21b8a1586455a5` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:16.384142 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed70ccb2-b19c-4cf6-a958-ed035a3617d3 None admin] RBAC: Authorizing `identity:get_project(project_id=049a4d8d08d041518f21b8a1586455a5)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:16.385610 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed70ccb2-b19c-4cf6-a958-ed035a3617d3 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:16.387275 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 605/1199] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Sep 19 14:44:16 2022] GET /identity/v3/projects/049a4d8d08d041518f21b8a1586455a5 => generated 361 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:16.394038 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f365afbf-a76b-4ff1-af4a-b5a4da42a71d None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:44:16.503105 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f365afbf-a76b-4ff1-af4a-b5a4da42a71d None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:44:16.539380 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc072463-c098-46e2-8f0a-6365c9c8e774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:44:16.539977 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc072463-c098-46e2-8f0a-6365c9c8e774 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:44:16.540249 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc072463-c098-46e2-8f0a-6365c9c8e774 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:44:16.540512 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc072463-c098-46e2-8f0a-6365c9c8e774 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:44:16.541260 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc072463-c098-46e2-8f0a-6365c9c8e774 None admin] RBAC: Adding query filter params (role.id=019bde1756cb40de8ce06cef6b261f79, scope.project.id=049a4d8d08d041518f21b8a1586455a5, user.id=c88e9748c7b6401abe6828a19ba7a6d1) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:44:16.541565 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc072463-c098-46e2-8f0a-6365c9c8e774 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:44:16.543010 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc072463-c098-46e2-8f0a-6365c9c8e774 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:44:16.548726 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 595/1200] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 19 14:44:16 2022] GET /identity/v3/role_assignments?user.id=c88e9748c7b6401abe6828a19ba7a6d1&scope.project.id=049a4d8d08d041518f21b8a1586455a5&role.id=019bde1756cb40de8ce06cef6b261f79 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:44:26.376692 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=32 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:44:26.546138 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=82 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:12.723639 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ecde8-33db-432b-b87f-31752355e7d3 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:12.724271 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ecde8-33db-432b-b87f-31752355e7d3 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:12.724271 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ecde8-33db-432b-b87f-31752355e7d3 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:12.725716 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 606/1201] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:45:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 14:45:12.732571 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f601d9f-de1a-4738-a75f-ca0d11283e46 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:12.733275 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f601d9f-de1a-4738-a75f-ca0d11283e46 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:12.733275 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f601d9f-de1a-4738-a75f-ca0d11283e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:12.754921 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-9f601d9f-de1a-4738-a75f-ca0d11283e46 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:45:12.756184 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-9f601d9f-de1a-4738-a75f-ca0d11283e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:45:12.844951 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 596/1202] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:45:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:45:13.184263 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039ecde8-33db-432b-b87f-31752355e7d3 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:13.320656 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039ecde8-33db-432b-b87f-31752355e7d3 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:13.360847 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827ce380-b0ca-457f-a34d-5abc05967ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:13.361515 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827ce380-b0ca-457f-a34d-5abc05967ded None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:13.361786 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827ce380-b0ca-457f-a34d-5abc05967ded None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:13.362048 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827ce380-b0ca-457f-a34d-5abc05967ded None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:13.376466 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827ce380-b0ca-457f-a34d-5abc05967ded None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:13.377297 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827ce380-b0ca-457f-a34d-5abc05967ded None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:13.400740 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-827ce380-b0ca-457f-a34d-5abc05967ded None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:45:13.400740 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:45:13.400740 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:45:13.400740 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:45:13.400740 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:45:13.400740 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:45:13.400740 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:45:13.400740 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:45:13.400740 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:45:13.400740 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:45:13.400740 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:45:13.400740 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:45:13.400740 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:45:13.400740 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:45:13.400740 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:45:13.400740 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:45:13.402033 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:45:13.402033 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:45:13.402033 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:45:13.402033 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:45:13.402033 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:45:13.402033 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:45:13.402033 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:45:13.402033 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:45:13.402033 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:45:13.402033 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:45:13.402033 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:45:13.402033 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:45:13.402033 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:45:13.402033 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:45:13.402033 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:45:13.402033 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:45:13.402033 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:45:13.402990 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:45:13.402990 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:45:13.402990 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:45:13.402990 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 607/1203] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:45:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:45:13.409178 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f601d9f-de1a-4738-a75f-ca0d11283e46 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:13.537164 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f601d9f-de1a-4738-a75f-ca0d11283e46 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:13.574415 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:13.582774 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c715d8-b089-488e-bf5b-647e373976bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:13.583015 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c715d8-b089-488e-bf5b-647e373976bc None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:13.583630 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c715d8-b089-488e-bf5b-647e373976bc None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:13.583935 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c715d8-b089-488e-bf5b-647e373976bc None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:13.589034 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c715d8-b089-488e-bf5b-647e373976bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:45:13.589963 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c715d8-b089-488e-bf5b-647e373976bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:13.591809 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c715d8-b089-488e-bf5b-647e373976bc None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:13.607163 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 597/1204] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 19 14:45:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:45:13.612832 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827ce380-b0ca-457f-a34d-5abc05967ded None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:13.688442 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:13.749338 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827ce380-b0ca-457f-a34d-5abc05967ded None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:13.793497 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d80c43a-f4df-4712-853c-ee011d2c356f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:13.794141 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d80c43a-f4df-4712-853c-ee011d2c356f None admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:13.794420 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d80c43a-f4df-4712-853c-ee011d2c356f None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:13.794695 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d80c43a-f4df-4712-853c-ee011d2c356f None admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:13.795772 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d80c43a-f4df-4712-853c-ee011d2c356f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:13.797560 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d80c43a-f4df-4712-853c-ee011d2c356f None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:13.822563 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 608/1205] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Sep 19 14:45:13 2022] POST /identity/v3/users => generated 251 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:45:16.452600 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9885e03-527f-4861-93cb-48d98351a9c8 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:16.455741 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9885e03-527f-4861-93cb-48d98351a9c8 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:16.455741 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9885e03-527f-4861-93cb-48d98351a9c8 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:16.455741 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 598/1206] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:45:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:45:16.462794 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee5fc48-896c-437b-92f6-4767d1399ee7 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:16.463375 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee5fc48-896c-437b-92f6-4767d1399ee7 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:16.463375 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee5fc48-896c-437b-92f6-4767d1399ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:16.486879 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-7ee5fc48-896c-437b-92f6-4767d1399ee7 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:45:16.486879 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-7ee5fc48-896c-437b-92f6-4767d1399ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:45:16.578104 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 609/1207] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:45:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:45:16.868402 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9885e03-527f-4861-93cb-48d98351a9c8 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:16.988588 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9885e03-527f-4861-93cb-48d98351a9c8 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:17.031658 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e3c6f6-af6d-4ac5-ac25-52d208afcdff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:17.032727 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e3c6f6-af6d-4ac5-ac25-52d208afcdff None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:17.033140 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e3c6f6-af6d-4ac5-ac25-52d208afcdff None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:17.033406 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e3c6f6-af6d-4ac5-ac25-52d208afcdff None admin] PATH_INFO: `/v3/roles/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:17.046072 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e3c6f6-af6d-4ac5-ac25-52d208afcdff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:45:17.051135 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-40e3c6f6-af6d-4ac5-ac25-52d208afcdff None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:45:17.051135 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:45:17.051135 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:45:17.051135 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:45:17.051135 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:45:17.051135 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:45:17.051135 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:45:17.051135 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:45:17.051135 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:45:17.051135 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:45:17.051135 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:45:17.051135 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:45:17.051135 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:45:17.051135 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:45:17.051135 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:45:17.051135 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:45:17.052203 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:45:17.052203 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:45:17.052203 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:45:17.052203 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:45:17.052203 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:45:17.052203 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:45:17.052203 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:45:17.052203 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:45:17.052203 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:45:17.052203 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:45:17.052203 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:45:17.052203 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:45:17.052203 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:45:17.052203 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:45:17.052203 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:45:17.052203 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:45:17.053159 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:45:17.053159 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:45:17.053159 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:45:17.053159 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:45:17.053159 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:45:17.053159 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:45:17.053159 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:45:17.053159 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:45:17.053159 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:45:17.053159 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:45:17.053159 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:45:17.053159 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:45:17.053159 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 599/1208] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Sep 19 14:45:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:45:17.058460 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee5fc48-896c-437b-92f6-4767d1399ee7 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:17.106512 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:17.171498 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee5fc48-896c-437b-92f6-4767d1399ee7 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:17.208594 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5853d024-3dd7-4b85-a620-afedd4c170b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:17.209235 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5853d024-3dd7-4b85-a620-afedd4c170b4 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:17.209541 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5853d024-3dd7-4b85-a620-afedd4c170b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:17.209848 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5853d024-3dd7-4b85-a620-afedd4c170b4 None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:17.210505 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5853d024-3dd7-4b85-a620-afedd4c170b4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:45:17.210799 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5853d024-3dd7-4b85-a620-afedd4c170b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:17.212480 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5853d024-3dd7-4b85-a620-afedd4c170b4 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:17.223678 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 610/1209] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Sep 19 14:45:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:45:17.228028 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e3c6f6-af6d-4ac5-ac25-52d208afcdff None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:17.286425 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:17.344887 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e3c6f6-af6d-4ac5-ac25-52d208afcdff None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:17.382719 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22be677-3c51-4517-a515-3d255db2f53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:17.383473 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22be677-3c51-4517-a515-3d255db2f53c None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:17.383716 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22be677-3c51-4517-a515-3d255db2f53c None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:17.384168 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22be677-3c51-4517-a515-3d255db2f53c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:17.397779 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22be677-3c51-4517-a515-3d255db2f53c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:17.399380 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22be677-3c51-4517-a515-3d255db2f53c None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:17.416243 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-b22be677-3c51-4517-a515-3d255db2f53c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:45:17.416243 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:45:17.416243 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:45:17.416243 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:45:17.416243 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:45:17.416243 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:45:17.416243 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:45:17.416243 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:45:17.416243 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:45:17.416243 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:45:17.416243 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:45:17.416243 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:45:17.416243 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:45:17.416243 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:45:17.416243 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:45:17.416243 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:45:17.417533 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:45:17.417533 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:45:17.417533 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:45:17.417533 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:45:17.417533 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:45:17.417533 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:45:17.417533 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:45:17.417533 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:45:17.417533 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:45:17.417533 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:45:17.417533 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:45:17.417533 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:45:17.417533 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:45:17.417533 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:45:17.417533 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:45:17.417533 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:45:17.417533 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:45:17.418410 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:45:17.418410 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:45:17.418410 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:45:17.422757 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 600/1210] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:45:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:45:17.423480 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5853d024-3dd7-4b85-a620-afedd4c170b4 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:17.554600 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:17.558414 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5853d024-3dd7-4b85-a620-afedd4c170b4 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:17.606832 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909185c6-7429-4269-9cbc-596d9b675f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:17.607446 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909185c6-7429-4269-9cbc-596d9b675f3c None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:17.607724 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909185c6-7429-4269-9cbc-596d9b675f3c None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:17.607994 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909185c6-7429-4269-9cbc-596d9b675f3c None admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:17.608687 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909185c6-7429-4269-9cbc-596d9b675f3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:45:17.609009 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909185c6-7429-4269-9cbc-596d9b675f3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:17.610386 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909185c6-7429-4269-9cbc-596d9b675f3c None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:17.623979 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 611/1211] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 19 14:45:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:45:17.630196 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22be677-3c51-4517-a515-3d255db2f53c None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:17.748056 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22be677-3c51-4517-a515-3d255db2f53c None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:17.749571 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:17.784826 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ec10d7-fe4b-46bf-8e2a-839d860ea52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:17.785481 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec10d7-fe4b-46bf-8e2a-839d860ea52a None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:17.785763 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec10d7-fe4b-46bf-8e2a-839d860ea52a None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:17.786075 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec10d7-fe4b-46bf-8e2a-839d860ea52a None admin] PATH_INFO: `/v3/users/placement` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:17.793998 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ec10d7-fe4b-46bf-8e2a-839d860ea52a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:17.795480 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ec10d7-fe4b-46bf-8e2a-839d860ea52a None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:17.808256 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-63ec10d7-fe4b-46bf-8e2a-839d860ea52a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 19 14:45:17.808256 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:45:17.808256 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:45:17.808256 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:45:17.808256 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:45:17.808256 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:45:17.808256 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:45:17.808256 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:45:17.808256 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:45:17.808256 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:45:17.808256 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:45:17.808256 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:45:17.808256 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:45:17.808256 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:45:17.808256 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:45:17.808256 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:45:17.809500 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:45:17.809500 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:45:17.809500 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:45:17.809500 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:45:17.809500 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:45:17.809500 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:45:17.809500 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:45:17.809500 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:45:17.809500 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:45:17.809500 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:45:17.809500 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:45:17.809500 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:45:17.809500 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:45:17.809500 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:45:17.809500 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:45:17.809500 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:45:17.809500 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:45:17.809500 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:45:17.810465 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:45:17.810465 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:45:17.810465 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:45:17.810465 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:45:17.810465 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:45:17.810465 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:45:17.810465 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:45:17.810465 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:45:17.810465 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 19 14:45:17.810465 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:45:17.810465 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 601/1212] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:45:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:45:17.816400 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909185c6-7429-4269-9cbc-596d9b675f3c None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:17.931314 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909185c6-7429-4269-9cbc-596d9b675f3c None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:17.969703 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aec6d3-1620-4082-bdb6-8aac93ea0e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:17.970658 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aec6d3-1620-4082-bdb6-8aac93ea0e34 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:17.971024 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aec6d3-1620-4082-bdb6-8aac93ea0e34 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:17.971392 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aec6d3-1620-4082-bdb6-8aac93ea0e34 None admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:17.972469 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aec6d3-1620-4082-bdb6-8aac93ea0e34 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:45:17.972887 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aec6d3-1620-4082-bdb6-8aac93ea0e34 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:17.974547 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aec6d3-1620-4082-bdb6-8aac93ea0e34 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:18.000127 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 612/1213] 10.222.0.26 () {56 vars in 1143 bytes} [Mon Sep 19 14:45:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:45:18.001518 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ec10d7-fe4b-46bf-8e2a-839d860ea52a None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:18.122010 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ec10d7-fe4b-46bf-8e2a-839d860ea52a None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:18.163860 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae391ebe-fa32-4e68-bf0b-1cf7490b337a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:18.164469 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae391ebe-fa32-4e68-bf0b-1cf7490b337a None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:18.164773 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae391ebe-fa32-4e68-bf0b-1cf7490b337a None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:18.165198 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae391ebe-fa32-4e68-bf0b-1cf7490b337a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:18.200287 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:18.241615 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae391ebe-fa32-4e68-bf0b-1cf7490b337a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:18.243199 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae391ebe-fa32-4e68-bf0b-1cf7490b337a None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:18.361598 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 602/1214] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 19 14:45:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 14:45:18.367974 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aec6d3-1620-4082-bdb6-8aac93ea0e34 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:18.390122 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:18.495969 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aec6d3-1620-4082-bdb6-8aac93ea0e34 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:18.539878 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60c25cc-2611-4025-ac34-f774a6a16c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:18.540724 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c25cc-2611-4025-ac34-f774a6a16c24 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:18.541245 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c25cc-2611-4025-ac34-f774a6a16c24 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:18.541531 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c25cc-2611-4025-ac34-f774a6a16c24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:18.553967 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60c25cc-2611-4025-ac34-f774a6a16c24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:18.555709 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60c25cc-2611-4025-ac34-f774a6a16c24 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:18.573168 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-a60c25cc-2611-4025-ac34-f774a6a16c24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:45:18.573168 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:45:18.573168 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:45:18.573168 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:45:18.573168 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:45:18.573168 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:45:18.573168 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:45:18.573168 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:45:18.573168 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:45:18.573168 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:45:18.573168 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:45:18.573168 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:45:18.573168 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:45:18.573168 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:45:18.573168 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:45:18.573168 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:45:18.574231 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:45:18.574231 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:45:18.574231 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:45:18.574231 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:45:18.574231 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:45:18.574231 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:45:18.574231 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:45:18.574231 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:45:18.574231 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:45:18.574231 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:45:18.574231 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:45:18.574231 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:45:18.574231 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:45:18.574231 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:45:18.574231 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:45:18.574231 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:45:18.574231 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:45:18.575100 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:45:18.575100 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:45:18.575100 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:45:18.575100 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 613/1215] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:45:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:45:18.580531 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae391ebe-fa32-4e68-bf0b-1cf7490b337a None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:18.657034 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:18.710656 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae391ebe-fa32-4e68-bf0b-1cf7490b337a None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:18.754724 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b550189-358d-4665-b5d5-93843024ae54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:18.755348 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b550189-358d-4665-b5d5-93843024ae54 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:18.755650 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b550189-358d-4665-b5d5-93843024ae54 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:18.755922 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b550189-358d-4665-b5d5-93843024ae54 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:18.756570 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b550189-358d-4665-b5d5-93843024ae54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:45:18.756874 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b550189-358d-4665-b5d5-93843024ae54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:18.758302 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b550189-358d-4665-b5d5-93843024ae54 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:18.772227 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 603/1216] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 19 14:45:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:45:18.778113 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60c25cc-2611-4025-ac34-f774a6a16c24 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:18.855700 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:18.889095 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60c25cc-2611-4025-ac34-f774a6a16c24 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:18.924040 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4286da77-9838-4098-9188-e18f33fdd1ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:18.924847 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4286da77-9838-4098-9188-e18f33fdd1ad None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:18.924847 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4286da77-9838-4098-9188-e18f33fdd1ad None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:18.925160 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4286da77-9838-4098-9188-e18f33fdd1ad None admin] PATH_INFO: `/v3/projects/service` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:18.933560 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4286da77-9838-4098-9188-e18f33fdd1ad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:18.935294 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4286da77-9838-4098-9188-e18f33fdd1ad None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:18.947329 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-4286da77-9838-4098-9188-e18f33fdd1ad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:45:18.947329 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:45:18.947329 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:45:18.947329 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:45:18.947329 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:45:18.947329 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:45:18.947329 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:45:18.947329 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:45:18.947329 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:45:18.947329 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:45:18.947329 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:45:18.947329 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:45:18.947329 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:45:18.947329 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:45:18.947329 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:45:18.948434 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:45:18.948434 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:45:18.948434 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:45:18.948434 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:45:18.948434 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:45:18.948434 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:45:18.948434 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:45:18.948434 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:45:18.948434 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:45:18.948434 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:45:18.948434 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:45:18.948434 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:45:18.948434 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:45:18.948434 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:45:18.948434 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:45:18.948434 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:45:18.948434 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:45:18.949398 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:45:18.949398 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:45:18.949398 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:45:18.949398 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:45:18.949398 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:45:18.949398 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:45:18.949398 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:45:18.949398 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:45:18.949398 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 614/1217] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 19 14:45:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:45:18.954736 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b550189-358d-4665-b5d5-93843024ae54 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:19.070589 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b550189-358d-4665-b5d5-93843024ae54 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:19.098969 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:19.112648 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9d9c82-e053-47c7-bd52-00a716f6269c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:19.113362 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9d9c82-e053-47c7-bd52-00a716f6269c None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:19.113642 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9d9c82-e053-47c7-bd52-00a716f6269c None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:19.113942 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9d9c82-e053-47c7-bd52-00a716f6269c None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:19.114760 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9d9c82-e053-47c7-bd52-00a716f6269c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:45:19.115098 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9d9c82-e053-47c7-bd52-00a716f6269c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:19.116801 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9d9c82-e053-47c7-bd52-00a716f6269c None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:19.130391 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 604/1218] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 19 14:45:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:45:19.137156 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4286da77-9838-4098-9188-e18f33fdd1ad None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:19.255234 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4286da77-9838-4098-9188-e18f33fdd1ad None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:19.284494 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:19.291594 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92a05f6-e7ed-4ae6-956b-757f1fde813f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:19.292254 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92a05f6-e7ed-4ae6-956b-757f1fde813f None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:19.292587 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92a05f6-e7ed-4ae6-956b-757f1fde813f None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:19.292982 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92a05f6-e7ed-4ae6-956b-757f1fde813f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:19.293697 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92a05f6-e7ed-4ae6-956b-757f1fde813f None admin] RBAC: Adding query filter params (role.id=3d5d4018951045e18e7577ee742c10ca, scope.project.id=9ede5dc59ece4d9282867a99e94c4c41, user.id=da0a58c526f34afda909e4ede2b1e1c5) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:45:19.294010 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92a05f6-e7ed-4ae6-956b-757f1fde813f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:19.295531 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92a05f6-e7ed-4ae6-956b-757f1fde813f None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:19.301415 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 615/1219] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 19 14:45:19 2022] GET /identity/v3/role_assignments?user.id=da0a58c526f34afda909e4ede2b1e1c5&scope.project.id=9ede5dc59ece4d9282867a99e94c4c41&role.id=3d5d4018951045e18e7577ee742c10ca => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:45:21.696165 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a5aa8-4a64-4895-a4cc-ec7aa383ddd2 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:21.696741 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a5aa8-4a64-4895-a4cc-ec7aa383ddd2 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:21.696741 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a5aa8-4a64-4895-a4cc-ec7aa383ddd2 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:21.698116 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 605/1220] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:45:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:45:21.704270 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d8c69-d117-4a5b-bdb1-1b5514a26b95 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:21.704754 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d8c69-d117-4a5b-bdb1-1b5514a26b95 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:21.704754 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d8c69-d117-4a5b-bdb1-1b5514a26b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:21.727337 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-688d8c69-d117-4a5b-bdb1-1b5514a26b95 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:45:21.728531 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-688d8c69-d117-4a5b-bdb1-1b5514a26b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:45:21.806363 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 616/1221] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:45:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:45:22.073337 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5a5aa8-4a64-4895-a4cc-ec7aa383ddd2 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:22.191095 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5a5aa8-4a64-4895-a4cc-ec7aa383ddd2 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:22.228570 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15b8931-e651-41c6-a9d8-5f93cb524179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:22.229306 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b8931-e651-41c6-a9d8-5f93cb524179 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:22.229658 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b8931-e651-41c6-a9d8-5f93cb524179 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:22.229926 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b8931-e651-41c6-a9d8-5f93cb524179 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:22.241562 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15b8931-e651-41c6-a9d8-5f93cb524179 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:45:22.246691 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-c15b8931-e651-41c6-a9d8-5f93cb524179 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:45:22.246691 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:45:22.246691 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:45:22.246691 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:45:22.246691 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:45:22.246691 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:45:22.246691 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:45:22.246691 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:45:22.246691 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:45:22.246691 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:45:22.246691 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:45:22.246691 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:45:22.246691 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:45:22.246691 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:45:22.246691 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:45:22.246691 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:45:22.248597 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:45:22.248597 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:45:22.248597 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:45:22.248597 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:45:22.248597 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:45:22.248597 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:45:22.248597 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:45:22.248597 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:45:22.248597 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:45:22.248597 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:45:22.248597 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:45:22.248597 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:45:22.248597 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:45:22.248597 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:45:22.248597 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:45:22.248597 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:45:22.250192 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:45:22.250192 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:45:22.250192 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:45:22.250192 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:45:22.250192 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:45:22.250192 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:45:22.250192 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:45:22.250192 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:45:22.250192 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:45:22.250192 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:45:22.250192 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:45:22.250192 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:45:22.250192 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 606/1222] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Sep 19 14:45:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:45:22.254305 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688d8c69-d117-4a5b-bdb1-1b5514a26b95 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:22.361313 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688d8c69-d117-4a5b-bdb1-1b5514a26b95 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:22.388182 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:22.401420 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30ed56e-4e7d-4533-846d-ce6e9fd78975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:22.402075 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ed56e-4e7d-4533-846d-ce6e9fd78975 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:22.402368 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ed56e-4e7d-4533-846d-ce6e9fd78975 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:22.402704 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ed56e-4e7d-4533-846d-ce6e9fd78975 None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:22.403456 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30ed56e-4e7d-4533-846d-ce6e9fd78975 None admin] RBAC: Adding query filter params (name=service) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:45:22.403783 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30ed56e-4e7d-4533-846d-ce6e9fd78975 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:22.405308 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30ed56e-4e7d-4533-846d-ce6e9fd78975 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:22.419354 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 617/1223] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Sep 19 14:45:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:45:22.420647 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15b8931-e651-41c6-a9d8-5f93cb524179 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:22.472967 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:22.548783 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15b8931-e651-41c6-a9d8-5f93cb524179 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:22.587944 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b21ce7-ce0c-449e-bd8a-36f8a9366a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:22.588617 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b21ce7-ce0c-449e-bd8a-36f8a9366a30 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:22.588918 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b21ce7-ce0c-449e-bd8a-36f8a9366a30 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:22.589329 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b21ce7-ce0c-449e-bd8a-36f8a9366a30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:22.602709 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b21ce7-ce0c-449e-bd8a-36f8a9366a30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:22.604805 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b21ce7-ce0c-449e-bd8a-36f8a9366a30 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:22.622433 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-65b21ce7-ce0c-449e-bd8a-36f8a9366a30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:45:22.622433 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:45:22.622433 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:45:22.622433 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:45:22.622433 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:45:22.622433 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:45:22.622433 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:45:22.622433 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:45:22.622433 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:45:22.622433 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:45:22.622433 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:45:22.622433 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:45:22.622433 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:45:22.622433 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:45:22.622433 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:45:22.622433 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:45:22.623452 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:45:22.623452 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:45:22.623452 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:45:22.623452 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:45:22.623452 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:45:22.623452 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:45:22.623452 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:45:22.623452 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:45:22.623452 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:45:22.623452 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:45:22.623452 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:45:22.623452 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:45:22.623452 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:45:22.623452 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:45:22.623452 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:45:22.623452 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:45:22.623452 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:45:22.624707 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:45:22.624707 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:45:22.624707 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:45:22.624707 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 607/1224] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:45:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:45:22.629987 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30ed56e-4e7d-4533-846d-ce6e9fd78975 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:22.751684 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30ed56e-4e7d-4533-846d-ce6e9fd78975 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:22.789851 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531412a9-9b53-465b-a555-cb9cd2d92ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:22.790728 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531412a9-9b53-465b-a555-cb9cd2d92ab7 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:22.791008 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531412a9-9b53-465b-a555-cb9cd2d92ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:22.791282 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531412a9-9b53-465b-a555-cb9cd2d92ab7 None admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:22.792051 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531412a9-9b53-465b-a555-cb9cd2d92ab7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:45:22.792277 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531412a9-9b53-465b-a555-cb9cd2d92ab7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:22.794070 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531412a9-9b53-465b-a555-cb9cd2d92ab7 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:22.813329 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 618/1225] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 19 14:45:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:45:22.814600 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b21ce7-ce0c-449e-bd8a-36f8a9366a30 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:22.921275 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:22.929165 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b21ce7-ce0c-449e-bd8a-36f8a9366a30 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:22.967717 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cb8575-51b7-4078-a022-38c595aa8c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:22.968488 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cb8575-51b7-4078-a022-38c595aa8c12 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:22.968766 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cb8575-51b7-4078-a022-38c595aa8c12 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:22.969124 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cb8575-51b7-4078-a022-38c595aa8c12 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:22.978398 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cb8575-51b7-4078-a022-38c595aa8c12 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:22.979900 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cb8575-51b7-4078-a022-38c595aa8c12 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:22.992572 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-e3cb8575-51b7-4078-a022-38c595aa8c12 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 19 14:45:22.992572 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:45:22.992572 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:45:22.992572 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:45:22.992572 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:45:22.992572 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:45:22.992572 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:45:22.992572 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:45:22.992572 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:45:22.992572 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:45:22.992572 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:45:22.992572 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:45:22.992572 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:45:22.992572 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:45:22.992572 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:45:22.992572 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:45:22.993821 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:45:22.993821 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:45:22.993821 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:45:22.993821 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:45:22.993821 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:45:22.993821 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:45:22.993821 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:45:22.993821 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:45:22.993821 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:45:22.993821 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:45:22.993821 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:45:22.993821 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:45:22.993821 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:45:22.993821 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:45:22.993821 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:45:22.993821 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:45:22.993821 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:45:22.993821 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:45:22.994938 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:45:22.994938 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:45:22.994938 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:45:22.994938 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:45:22.994938 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:45:22.994938 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:45:22.994938 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:45:22.994938 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:45:22.994938 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 19 14:45:22.994938 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:45:22.995602 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 608/1226] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:45:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:45:23.002279 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531412a9-9b53-465b-a555-cb9cd2d92ab7 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:23.054083 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:23.128575 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531412a9-9b53-465b-a555-cb9cd2d92ab7 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:23.176313 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2395daad-4888-4413-a2db-f9daaa730ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:23.177104 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2395daad-4888-4413-a2db-f9daaa730ace None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:23.177368 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2395daad-4888-4413-a2db-f9daaa730ace None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:23.177641 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2395daad-4888-4413-a2db-f9daaa730ace None admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:23.178447 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2395daad-4888-4413-a2db-f9daaa730ace None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:45:23.178752 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2395daad-4888-4413-a2db-f9daaa730ace None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:23.180330 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2395daad-4888-4413-a2db-f9daaa730ace None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:23.200152 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 619/1227] 10.222.0.26 () {56 vars in 1143 bytes} [Mon Sep 19 14:45:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:45:23.207839 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cb8575-51b7-4078-a022-38c595aa8c12 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:23.321934 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cb8575-51b7-4078-a022-38c595aa8c12 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:23.375062 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43baccb-0ea6-4bfe-93c9-307d3d0c6f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:23.376042 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43baccb-0ea6-4bfe-93c9-307d3d0c6f6d None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:23.376509 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43baccb-0ea6-4bfe-93c9-307d3d0c6f6d None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:23.377077 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43baccb-0ea6-4bfe-93c9-307d3d0c6f6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:23.395922 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43baccb-0ea6-4bfe-93c9-307d3d0c6f6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:23.398763 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43baccb-0ea6-4bfe-93c9-307d3d0c6f6d None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:23.424438 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-a43baccb-0ea6-4bfe-93c9-307d3d0c6f6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:45:23.424438 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:45:23.424438 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:45:23.424438 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:45:23.424438 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:45:23.424438 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:45:23.424438 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:45:23.424438 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:45:23.424438 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:45:23.424438 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:45:23.424438 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:45:23.424438 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:45:23.424438 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:45:23.424438 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:45:23.424438 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:45:23.424438 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:45:23.426191 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:45:23.426191 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:45:23.426191 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:45:23.426191 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:45:23.426191 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:45:23.426191 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:45:23.426191 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:45:23.426191 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:45:23.426191 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:45:23.426191 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:45:23.426191 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:45:23.426191 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:45:23.426191 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:45:23.426191 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:45:23.426191 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:45:23.426191 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:45:23.426191 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:45:23.427325 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:45:23.427325 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:45:23.427325 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:45:23.427325 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 609/1228] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:45:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:45:23.434290 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2395daad-4888-4413-a2db-f9daaa730ace None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:23.580077 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2395daad-4888-4413-a2db-f9daaa730ace None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:23.583596 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:23.618938 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b1fa8e-95e1-401d-b1a2-98b48533fecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:23.619539 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b1fa8e-95e1-401d-b1a2-98b48533fecc None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:23.619817 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b1fa8e-95e1-401d-b1a2-98b48533fecc None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:23.620123 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b1fa8e-95e1-401d-b1a2-98b48533fecc None admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:23.620768 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b1fa8e-95e1-401d-b1a2-98b48533fecc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:45:23.621145 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b1fa8e-95e1-401d-b1a2-98b48533fecc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:23.622620 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b1fa8e-95e1-401d-b1a2-98b48533fecc None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:23.635291 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 620/1229] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 19 14:45:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:45:23.641808 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43baccb-0ea6-4bfe-93c9-307d3d0c6f6d None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:23.653587 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:23.769015 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43baccb-0ea6-4bfe-93c9-307d3d0c6f6d None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:23.807839 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768a6767-542f-46db-ae8b-1883e8dc2fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:23.808552 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a6767-542f-46db-ae8b-1883e8dc2fec None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:23.808798 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a6767-542f-46db-ae8b-1883e8dc2fec None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:23.809146 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a6767-542f-46db-ae8b-1883e8dc2fec None admin] PATH_INFO: `/v3/projects/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:23.817048 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768a6767-542f-46db-ae8b-1883e8dc2fec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:23.818539 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768a6767-542f-46db-ae8b-1883e8dc2fec None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:23.831486 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-768a6767-542f-46db-ae8b-1883e8dc2fec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:45:23.831486 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:45:23.831486 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:45:23.831486 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:45:23.831486 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:45:23.831486 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:45:23.831486 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:45:23.831486 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:45:23.831486 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:45:23.831486 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:45:23.831486 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:45:23.831486 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:45:23.831486 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:45:23.831486 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:45:23.831486 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:45:23.832523 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:45:23.832523 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:45:23.832523 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:45:23.832523 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:45:23.832523 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:45:23.832523 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:45:23.832523 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:45:23.832523 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:45:23.832523 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:45:23.832523 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:45:23.832523 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:45:23.832523 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:45:23.832523 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:45:23.832523 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:45:23.832523 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:45:23.832523 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:45:23.832523 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:45:23.833496 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:45:23.833496 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:45:23.833496 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:45:23.833496 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:45:23.833496 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:45:23.833496 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:45:23.833496 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:45:23.833496 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:45:23.833496 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 610/1230] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 19 14:45:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:45:23.839359 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b1fa8e-95e1-401d-b1a2-98b48533fecc None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:23.950140 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b1fa8e-95e1-401d-b1a2-98b48533fecc None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:23.991519 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdd364a-0fcf-4dbb-8522-e233deb48f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:23.992207 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd364a-0fcf-4dbb-8522-e233deb48f06 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:23.992550 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd364a-0fcf-4dbb-8522-e233deb48f06 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:23.992817 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd364a-0fcf-4dbb-8522-e233deb48f06 None admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:23.994018 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdd364a-0fcf-4dbb-8522-e233deb48f06 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:45:23.994328 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdd364a-0fcf-4dbb-8522-e233deb48f06 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:23.995776 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdd364a-0fcf-4dbb-8522-e233deb48f06 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:24.011666 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 621/1231] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 19 14:45:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:45:24.017894 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768a6767-542f-46db-ae8b-1883e8dc2fec None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:24.086264 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:24.126054 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768a6767-542f-46db-ae8b-1883e8dc2fec None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:24.173424 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d15df7-1326-4382-948b-51db1ec0a925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:24.174050 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d15df7-1326-4382-948b-51db1ec0a925 None admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:24.174323 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d15df7-1326-4382-948b-51db1ec0a925 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:24.174643 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d15df7-1326-4382-948b-51db1ec0a925 None admin] PATH_INFO: `/v3/projects/9ede5dc59ece4d9282867a99e94c4c41/users/da0a58c526f34afda909e4ede2b1e1c5/roles/3d5d4018951045e18e7577ee742c10ca` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:24.190962 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d15df7-1326-4382-948b-51db1ec0a925 None admin] RBAC: Authorizing `identity:create_grant(project_id=9ede5dc59ece4d9282867a99e94c4c41, user_id=da0a58c526f34afda909e4ede2b1e1c5, role_id=3d5d4018951045e18e7577ee742c10ca)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:24.192421 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d15df7-1326-4382-948b-51db1ec0a925 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:24.207254 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 611/1232] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Sep 19 14:45:24 2022] PUT /identity/v3/projects/9ede5dc59ece4d9282867a99e94c4c41/users/da0a58c526f34afda909e4ede2b1e1c5/roles/3d5d4018951045e18e7577ee742c10ca => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:45:26.407148 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08704e9c-c71c-412f-839e-c105c92b54b1 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:26.407821 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08704e9c-c71c-412f-839e-c105c92b54b1 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:26.407821 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08704e9c-c71c-412f-839e-c105c92b54b1 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:26.409877 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 622/1233] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:45:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:45:26.418184 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aba1e8-2aef-43c1-a91c-8f6c2e0edc21 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:26.420093 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aba1e8-2aef-43c1-a91c-8f6c2e0edc21 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:26.420477 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aba1e8-2aef-43c1-a91c-8f6c2e0edc21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:26.439122 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-a3aba1e8-2aef-43c1-a91c-8f6c2e0edc21 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:45:26.440898 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a3aba1e8-2aef-43c1-a91c-8f6c2e0edc21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:45:26.523927 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 612/1234] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:45:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:45:26.806881 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08704e9c-c71c-412f-839e-c105c92b54b1 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:26.835324 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:26.932277 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08704e9c-c71c-412f-839e-c105c92b54b1 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:26.968754 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b487623-3028-4f84-8298-ee7327d6fc02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:26.969431 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b487623-3028-4f84-8298-ee7327d6fc02 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:26.969885 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b487623-3028-4f84-8298-ee7327d6fc02 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:26.970227 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b487623-3028-4f84-8298-ee7327d6fc02 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:26.983171 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b487623-3028-4f84-8298-ee7327d6fc02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:45:26.989284 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-9b487623-3028-4f84-8298-ee7327d6fc02 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:45:26.989284 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:45:26.989284 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:45:26.989284 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:45:26.989284 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:45:26.989284 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:45:26.989284 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:45:26.989284 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:45:26.989284 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:45:26.989284 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:45:26.989284 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:45:26.989284 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:45:26.989284 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:45:26.989284 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:45:26.989284 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:45:26.989284 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:45:26.990292 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:45:26.990292 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:45:26.990292 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:45:26.990292 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:45:26.990292 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:45:26.990292 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:45:26.990292 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:45:26.990292 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:45:26.990292 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:45:26.990292 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:45:26.990292 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:45:26.990292 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:45:26.990292 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:45:26.990292 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:45:26.990292 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:45:26.990292 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:45:26.991128 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:45:26.991128 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:45:26.991128 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:45:26.991128 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:45:26.991128 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:45:26.991128 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:45:26.991128 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:45:26.991128 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:45:26.991128 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:45:26.991128 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:45:26.991128 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 14:45:26.991128 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:45:26.991128 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 623/1235] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Sep 19 14:45:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:45:26.997194 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aba1e8-2aef-43c1-a91c-8f6c2e0edc21 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:27.045771 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:27.107547 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aba1e8-2aef-43c1-a91c-8f6c2e0edc21 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:27.150148 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d4571a-4796-4b8b-a3c5-9f68283e0b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:27.150758 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d4571a-4796-4b8b-a3c5-9f68283e0b6b None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:27.151030 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d4571a-4796-4b8b-a3c5-9f68283e0b6b None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:27.151264 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d4571a-4796-4b8b-a3c5-9f68283e0b6b None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:27.151968 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d4571a-4796-4b8b-a3c5-9f68283e0b6b None admin] RBAC: Adding query filter params (name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:45:27.152264 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d4571a-4796-4b8b-a3c5-9f68283e0b6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:27.153898 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d4571a-4796-4b8b-a3c5-9f68283e0b6b None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:27.162878 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 613/1236] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Sep 19 14:45:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:45:27.170591 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b487623-3028-4f84-8298-ee7327d6fc02 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:27.273056 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:27.290845 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b487623-3028-4f84-8298-ee7327d6fc02 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:27.333476 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f7d084-cd42-46a7-96a8-3dd30cb8f6ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:27.334145 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f7d084-cd42-46a7-96a8-3dd30cb8f6ec None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:27.334390 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f7d084-cd42-46a7-96a8-3dd30cb8f6ec None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:27.334657 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f7d084-cd42-46a7-96a8-3dd30cb8f6ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:27.347896 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f7d084-cd42-46a7-96a8-3dd30cb8f6ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:27.349454 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f7d084-cd42-46a7-96a8-3dd30cb8f6ec None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:27.365139 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-86f7d084-cd42-46a7-96a8-3dd30cb8f6ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:45:27.365139 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:45:27.365139 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:45:27.365139 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:45:27.365139 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:45:27.365139 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:45:27.365139 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:45:27.365139 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:45:27.365139 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:45:27.365139 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:45:27.365139 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:45:27.365139 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:45:27.365139 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:45:27.365139 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:45:27.365139 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:45:27.365139 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:45:27.366454 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:45:27.366454 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:45:27.366454 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:45:27.366454 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:45:27.366454 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:45:27.366454 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:45:27.366454 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:45:27.366454 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:45:27.366454 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:45:27.366454 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:45:27.366454 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:45:27.366454 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:45:27.366454 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:45:27.366454 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:45:27.366454 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:45:27.366454 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:45:27.366454 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:45:27.367354 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:45:27.367354 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:45:27.367354 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:45:27.367354 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 624/1237] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:45:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:45:27.372614 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d4571a-4796-4b8b-a3c5-9f68283e0b6b None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:27.488679 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d4571a-4796-4b8b-a3c5-9f68283e0b6b None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:27.498067 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:27.528960 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7751a0-5f0d-4f6c-8dfc-5c02d85e7eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:27.529620 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7751a0-5f0d-4f6c-8dfc-5c02d85e7eec None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:27.529867 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7751a0-5f0d-4f6c-8dfc-5c02d85e7eec None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:27.530148 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7751a0-5f0d-4f6c-8dfc-5c02d85e7eec None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:27.530981 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7751a0-5f0d-4f6c-8dfc-5c02d85e7eec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:45:27.531382 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7751a0-5f0d-4f6c-8dfc-5c02d85e7eec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:27.532664 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7751a0-5f0d-4f6c-8dfc-5c02d85e7eec None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:27.547381 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 614/1238] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 19 14:45:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:45:27.554841 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f7d084-cd42-46a7-96a8-3dd30cb8f6ec None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:27.669326 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f7d084-cd42-46a7-96a8-3dd30cb8f6ec None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:27.706058 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac31c69-ae41-4c52-a19c-10f7f97646e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:27.706680 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac31c69-ae41-4c52-a19c-10f7f97646e9 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:27.706971 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac31c69-ae41-4c52-a19c-10f7f97646e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:27.707284 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac31c69-ae41-4c52-a19c-10f7f97646e9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:27.710148 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:27.721261 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac31c69-ae41-4c52-a19c-10f7f97646e9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:27.723542 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac31c69-ae41-4c52-a19c-10f7f97646e9 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:27.745691 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-4ac31c69-ae41-4c52-a19c-10f7f97646e9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 19 14:45:27.745691 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:45:27.745691 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:45:27.745691 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:45:27.745691 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:45:27.745691 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:45:27.745691 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:45:27.745691 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:45:27.745691 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:45:27.745691 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:45:27.745691 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:45:27.745691 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:45:27.745691 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:45:27.745691 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:45:27.745691 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:45:27.745691 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:45:27.746867 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:45:27.746867 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:45:27.746867 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:45:27.746867 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:45:27.746867 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:45:27.746867 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:45:27.746867 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:45:27.746867 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:45:27.746867 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:45:27.746867 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:45:27.746867 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:45:27.746867 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:45:27.746867 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:45:27.746867 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:45:27.746867 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:45:27.746867 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:45:27.746867 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:45:27.746867 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:45:27.748156 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:45:27.748156 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:45:27.748156 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:45:27.748156 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:45:27.748156 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:45:27.748156 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:45:27.748156 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:45:27.748156 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:45:27.748156 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 19 14:45:27.748156 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:45:27.756441 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 625/1239] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:45:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:45:27.757618 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7751a0-5f0d-4f6c-8dfc-5c02d85e7eec None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:27.865851 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7751a0-5f0d-4f6c-8dfc-5c02d85e7eec None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:27.904760 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583b1590-80d2-41ef-ac4b-4633d4d064da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:27.905417 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b1590-80d2-41ef-ac4b-4633d4d064da None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:27.905727 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b1590-80d2-41ef-ac4b-4633d4d064da None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:27.906000 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b1590-80d2-41ef-ac4b-4633d4d064da None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:27.906974 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583b1590-80d2-41ef-ac4b-4633d4d064da None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:45:27.907286 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583b1590-80d2-41ef-ac4b-4633d4d064da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:27.908923 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583b1590-80d2-41ef-ac4b-4633d4d064da None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:27.935767 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 615/1240] 10.222.0.26 () {56 vars in 1143 bytes} [Mon Sep 19 14:45:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:45:27.937016 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac31c69-ae41-4c52-a19c-10f7f97646e9 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:28.049167 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac31c69-ae41-4c52-a19c-10f7f97646e9 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:28.084569 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc16a99-a92d-44ba-aaed-5275e243dbaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:28.085240 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc16a99-a92d-44ba-aaed-5275e243dbaa None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:28.085515 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc16a99-a92d-44ba-aaed-5275e243dbaa None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:28.085780 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc16a99-a92d-44ba-aaed-5275e243dbaa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:28.154976 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:28.163344 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc16a99-a92d-44ba-aaed-5275e243dbaa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:28.165169 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc16a99-a92d-44ba-aaed-5275e243dbaa None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:28.277217 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 626/1241] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 19 14:45:27 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 19 14:45:28.285997 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583b1590-80d2-41ef-ac4b-4633d4d064da None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:28.318370 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:28.407476 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583b1590-80d2-41ef-ac4b-4633d4d064da None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:28.446397 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0d127a-4b6c-4863-904e-9cd3543d65c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:28.447068 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d127a-4b6c-4863-904e-9cd3543d65c5 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:28.447342 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d127a-4b6c-4863-904e-9cd3543d65c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:28.447697 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d127a-4b6c-4863-904e-9cd3543d65c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:28.459600 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0d127a-4b6c-4863-904e-9cd3543d65c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:28.461533 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0d127a-4b6c-4863-904e-9cd3543d65c5 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:28.478239 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-8f0d127a-4b6c-4863-904e-9cd3543d65c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:45:28.478239 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:45:28.478239 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:45:28.478239 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:45:28.478239 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:45:28.478239 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:45:28.478239 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:45:28.478239 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:45:28.478239 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:45:28.478239 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:45:28.478239 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:45:28.478239 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:45:28.478239 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:45:28.478239 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:45:28.478239 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:45:28.478239 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:45:28.479239 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:45:28.479239 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:45:28.479239 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:45:28.479239 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:45:28.479239 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:45:28.479239 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:45:28.479239 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:45:28.479239 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:45:28.479239 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:45:28.479239 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:45:28.479239 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:45:28.479239 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:45:28.479239 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:45:28.479239 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:45:28.479239 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:45:28.479239 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:45:28.479239 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:45:28.480147 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:45:28.480147 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:45:28.480147 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:45:28.480147 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 616/1242] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:45:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:45:28.485820 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc16a99-a92d-44ba-aaed-5275e243dbaa None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:28.597318 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:28.603655 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc16a99-a92d-44ba-aaed-5275e243dbaa None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:28.640847 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa978561-3a4c-4642-b8ac-259caf651097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:28.641489 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa978561-3a4c-4642-b8ac-259caf651097 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:28.641765 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa978561-3a4c-4642-b8ac-259caf651097 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:28.642110 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa978561-3a4c-4642-b8ac-259caf651097 None admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:28.642746 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa978561-3a4c-4642-b8ac-259caf651097 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:45:28.643061 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa978561-3a4c-4642-b8ac-259caf651097 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:28.644530 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa978561-3a4c-4642-b8ac-259caf651097 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:28.656239 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 627/1243] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 19 14:45:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:45:28.662181 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0d127a-4b6c-4863-904e-9cd3543d65c5 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:28.756778 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:28.782071 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0d127a-4b6c-4863-904e-9cd3543d65c5 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:28.822095 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b796abb-8a76-4c23-aafe-7b7578e1e3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:28.822758 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b796abb-8a76-4c23-aafe-7b7578e1e3b8 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:28.823019 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b796abb-8a76-4c23-aafe-7b7578e1e3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:28.823315 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b796abb-8a76-4c23-aafe-7b7578e1e3b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:28.830768 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b796abb-8a76-4c23-aafe-7b7578e1e3b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:28.832449 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b796abb-8a76-4c23-aafe-7b7578e1e3b8 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:28.844469 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-8b796abb-8a76-4c23-aafe-7b7578e1e3b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:45:28.844469 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:45:28.844469 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:45:28.844469 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:45:28.844469 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:45:28.844469 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:45:28.844469 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:45:28.844469 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:45:28.844469 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:45:28.844469 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:45:28.844469 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:45:28.844469 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:45:28.844469 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:45:28.844469 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:45:28.844469 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:45:28.845551 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:45:28.845551 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:45:28.845551 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:45:28.845551 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:45:28.845551 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:45:28.845551 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:45:28.845551 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:45:28.845551 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:45:28.845551 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:45:28.845551 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:45:28.845551 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:45:28.845551 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:45:28.845551 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:45:28.845551 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:45:28.845551 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:45:28.845551 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:45:28.845551 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:45:28.846715 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:45:28.846715 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:45:28.846715 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:45:28.846715 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:45:28.846715 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:45:28.846715 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:45:28.846715 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:45:28.846715 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:45:28.851022 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 617/1244] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 19 14:45:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:45:28.852009 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa978561-3a4c-4642-b8ac-259caf651097 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:28.965584 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa978561-3a4c-4642-b8ac-259caf651097 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:29.003704 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8fbd6e-4af1-43ef-90ee-a7e44fa3924f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:29.004365 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8fbd6e-4af1-43ef-90ee-a7e44fa3924f None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:29.004678 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8fbd6e-4af1-43ef-90ee-a7e44fa3924f None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:29.004891 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8fbd6e-4af1-43ef-90ee-a7e44fa3924f None admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:29.006304 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8fbd6e-4af1-43ef-90ee-a7e44fa3924f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:45:29.006304 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8fbd6e-4af1-43ef-90ee-a7e44fa3924f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:29.007723 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8fbd6e-4af1-43ef-90ee-a7e44fa3924f None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:29.021561 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 628/1245] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 19 14:45:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:45:29.028038 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b796abb-8a76-4c23-aafe-7b7578e1e3b8 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:29.142410 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b796abb-8a76-4c23-aafe-7b7578e1e3b8 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:29.183223 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e8e211-3f36-4a95-854d-48598ed3b3d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:29.183896 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e8e211-3f36-4a95-854d-48598ed3b3d0 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:29.184175 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e8e211-3f36-4a95-854d-48598ed3b3d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:29.184442 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e8e211-3f36-4a95-854d-48598ed3b3d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:29.185202 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e8e211-3f36-4a95-854d-48598ed3b3d0 None admin] RBAC: Adding query filter params (role.id=3d5d4018951045e18e7577ee742c10ca, scope.project.id=9ede5dc59ece4d9282867a99e94c4c41, user.id=da0a58c526f34afda909e4ede2b1e1c5) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:45:29.186870 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e8e211-3f36-4a95-854d-48598ed3b3d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:29.188573 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e8e211-3f36-4a95-854d-48598ed3b3d0 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:29.195275 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 618/1246] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 19 14:45:29 2022] GET /identity/v3/role_assignments?user.id=da0a58c526f34afda909e4ede2b1e1c5&scope.project.id=9ede5dc59ece4d9282867a99e94c4c41&role.id=3d5d4018951045e18e7577ee742c10ca => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:45:31.704011 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1188e3bd-5e4f-45c9-a0e1-748ff9b8cfdf None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:31.704664 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1188e3bd-5e4f-45c9-a0e1-748ff9b8cfdf None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:31.704664 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1188e3bd-5e4f-45c9-a0e1-748ff9b8cfdf None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:31.706517 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 629/1247] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:45:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:45:31.713009 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed99d367-c759-47b7-a3d7-bc304b73320a None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:31.713523 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed99d367-c759-47b7-a3d7-bc304b73320a None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:31.713761 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed99d367-c759-47b7-a3d7-bc304b73320a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:31.720569 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:31.734816 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-ed99d367-c759-47b7-a3d7-bc304b73320a None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:45:31.736186 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ed99d367-c759-47b7-a3d7-bc304b73320a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:45:31.806328 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 619/1248] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:45:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:45:32.074144 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1188e3bd-5e4f-45c9-a0e1-748ff9b8cfdf None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:32.095256 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:32.184546 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1188e3bd-5e4f-45c9-a0e1-748ff9b8cfdf None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:32.223318 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09a83a8-bd9e-4ec9-8f6e-7649e2bc253d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:32.223951 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a83a8-bd9e-4ec9-8f6e-7649e2bc253d None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:32.224233 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a83a8-bd9e-4ec9-8f6e-7649e2bc253d None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:32.224503 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a83a8-bd9e-4ec9-8f6e-7649e2bc253d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:32.234938 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09a83a8-bd9e-4ec9-8f6e-7649e2bc253d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:45:32.240047 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-e09a83a8-bd9e-4ec9-8f6e-7649e2bc253d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:45:32.240047 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:45:32.240047 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:45:32.240047 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:45:32.240047 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:45:32.240047 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:45:32.240047 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:45:32.240047 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:45:32.240047 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:45:32.240047 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:45:32.240047 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:45:32.240047 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:45:32.240047 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:45:32.240047 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:45:32.240047 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:45:32.240047 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:45:32.241186 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:45:32.241186 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:45:32.241186 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:45:32.241186 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:45:32.241186 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:45:32.241186 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:45:32.241186 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:45:32.241186 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:45:32.241186 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:45:32.241186 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:45:32.241186 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:45:32.241186 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:45:32.241186 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:45:32.241186 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:45:32.241186 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:45:32.241186 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:45:32.242134 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:45:32.242134 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:45:32.242134 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:45:32.242134 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:45:32.242134 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:45:32.242134 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:45:32.242134 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:45:32.242134 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:45:32.242134 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:45:32.242134 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:45:32.242134 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:45:32.242134 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:45:32.242134 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 630/1249] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 19 14:45:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:45:32.247276 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed99d367-c759-47b7-a3d7-bc304b73320a None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:32.354013 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed99d367-c759-47b7-a3d7-bc304b73320a None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:32.387036 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:32.394204 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0264cf-7a18-497a-a1b9-bf0987546252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:32.395141 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0264cf-7a18-497a-a1b9-bf0987546252 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:32.395417 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0264cf-7a18-497a-a1b9-bf0987546252 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:32.395682 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0264cf-7a18-497a-a1b9-bf0987546252 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:32.396338 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0264cf-7a18-497a-a1b9-bf0987546252 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:45:32.396636 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0264cf-7a18-497a-a1b9-bf0987546252 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:32.398472 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0264cf-7a18-497a-a1b9-bf0987546252 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:32.408817 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 620/1250] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 19 14:45:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:45:32.414827 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09a83a8-bd9e-4ec9-8f6e-7649e2bc253d None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:32.510915 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:32.538707 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09a83a8-bd9e-4ec9-8f6e-7649e2bc253d None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:32.578486 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a69ede-9406-45ea-a22f-8b88fcd8a672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:32.579163 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a69ede-9406-45ea-a22f-8b88fcd8a672 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:32.579481 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a69ede-9406-45ea-a22f-8b88fcd8a672 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:32.579772 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a69ede-9406-45ea-a22f-8b88fcd8a672 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:32.591990 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a69ede-9406-45ea-a22f-8b88fcd8a672 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:32.593475 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a69ede-9406-45ea-a22f-8b88fcd8a672 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:32.609326 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-04a69ede-9406-45ea-a22f-8b88fcd8a672 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:45:32.609326 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:45:32.609326 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:45:32.609326 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:45:32.609326 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:45:32.609326 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:45:32.609326 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:45:32.609326 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:45:32.609326 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:45:32.609326 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:45:32.609326 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:45:32.609326 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:45:32.609326 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:45:32.609326 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:45:32.609326 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:45:32.609326 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:45:32.610348 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:45:32.610348 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:45:32.610348 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:45:32.610348 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:45:32.610348 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:45:32.610348 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:45:32.610348 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:45:32.610348 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:45:32.610348 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:45:32.610348 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:45:32.610348 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:45:32.610348 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:45:32.610348 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:45:32.610348 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:45:32.610348 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:45:32.610348 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:45:32.610348 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:45:32.611228 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:45:32.611228 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:45:32.611228 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:45:32.611228 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 631/1251] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:45:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:45:32.616317 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0264cf-7a18-497a-a1b9-bf0987546252 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:32.734471 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0264cf-7a18-497a-a1b9-bf0987546252 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:32.772648 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7718c10-1718-4178-a844-e91d5e3b6a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:32.773346 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7718c10-1718-4178-a844-e91d5e3b6a80 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:32.773629 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7718c10-1718-4178-a844-e91d5e3b6a80 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:32.773895 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7718c10-1718-4178-a844-e91d5e3b6a80 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:32.774600 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7718c10-1718-4178-a844-e91d5e3b6a80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:45:32.774909 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7718c10-1718-4178-a844-e91d5e3b6a80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:32.776348 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7718c10-1718-4178-a844-e91d5e3b6a80 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:32.795691 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 621/1252] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 19 14:45:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:45:32.797021 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a69ede-9406-45ea-a22f-8b88fcd8a672 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:32.914224 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a69ede-9406-45ea-a22f-8b88fcd8a672 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:32.945145 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:32.953950 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5905ab2f-3ec1-4f57-9870-7095841ecfa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:32.954591 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5905ab2f-3ec1-4f57-9870-7095841ecfa9 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:32.954869 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5905ab2f-3ec1-4f57-9870-7095841ecfa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:32.955140 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5905ab2f-3ec1-4f57-9870-7095841ecfa9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:32.965484 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5905ab2f-3ec1-4f57-9870-7095841ecfa9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:32.966975 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5905ab2f-3ec1-4f57-9870-7095841ecfa9 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:32.979369 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-5905ab2f-3ec1-4f57-9870-7095841ecfa9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 19 14:45:32.979369 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:45:32.979369 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:45:32.979369 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:45:32.979369 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:45:32.979369 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:45:32.979369 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:45:32.979369 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:45:32.979369 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:45:32.979369 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:45:32.979369 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:45:32.979369 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:45:32.979369 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:45:32.979369 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:45:32.979369 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:45:32.979369 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:45:32.980532 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:45:32.980532 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:45:32.980532 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:45:32.980532 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:45:32.980532 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:45:32.980532 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:45:32.980532 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:45:32.980532 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:45:32.980532 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:45:32.980532 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:45:32.980532 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:45:32.980532 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:45:32.980532 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:45:32.980532 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:45:32.980532 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:45:32.980532 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:45:32.980532 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:45:32.980532 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:45:32.981610 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:45:32.981610 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:45:32.981610 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:45:32.981610 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:45:32.981610 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:45:32.981610 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:45:32.981610 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:45:32.981610 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:45:32.981610 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 19 14:45:32.981610 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:45:32.981610 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 632/1253] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:45:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:45:32.987045 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7718c10-1718-4178-a844-e91d5e3b6a80 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:33.045577 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:33.097546 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7718c10-1718-4178-a844-e91d5e3b6a80 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:33.134729 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af5fc76-d2f1-42b4-942c-6041dcf86374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:33.135426 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af5fc76-d2f1-42b4-942c-6041dcf86374 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:33.135792 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af5fc76-d2f1-42b4-942c-6041dcf86374 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:33.136053 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af5fc76-d2f1-42b4-942c-6041dcf86374 None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:33.136796 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af5fc76-d2f1-42b4-942c-6041dcf86374 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:45:33.137130 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af5fc76-d2f1-42b4-942c-6041dcf86374 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:33.138594 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af5fc76-d2f1-42b4-942c-6041dcf86374 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:33.157757 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 622/1254] 10.222.0.26 () {56 vars in 1143 bytes} [Mon Sep 19 14:45:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:45:33.163824 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5905ab2f-3ec1-4f57-9870-7095841ecfa9 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:33.267661 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5905ab2f-3ec1-4f57-9870-7095841ecfa9 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:33.303532 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11178048-ffde-467e-9729-66984a8c4f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:33.304135 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11178048-ffde-467e-9729-66984a8c4f5b None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:33.304413 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11178048-ffde-467e-9729-66984a8c4f5b None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:33.304691 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11178048-ffde-467e-9729-66984a8c4f5b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:33.364393 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:33.377018 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11178048-ffde-467e-9729-66984a8c4f5b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:33.378909 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11178048-ffde-467e-9729-66984a8c4f5b None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:33.491528 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 633/1255] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 19 14:45:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 14:45:33.497745 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af5fc76-d2f1-42b4-942c-6041dcf86374 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:33.624212 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af5fc76-d2f1-42b4-942c-6041dcf86374 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:33.638881 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:33.663257 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34267b2c-c6e0-4a4a-ac42-f55844dc4969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:33.663873 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34267b2c-c6e0-4a4a-ac42-f55844dc4969 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:33.664142 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34267b2c-c6e0-4a4a-ac42-f55844dc4969 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:33.664404 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34267b2c-c6e0-4a4a-ac42-f55844dc4969 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:33.675148 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34267b2c-c6e0-4a4a-ac42-f55844dc4969 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:33.676590 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34267b2c-c6e0-4a4a-ac42-f55844dc4969 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:33.691471 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-34267b2c-c6e0-4a4a-ac42-f55844dc4969 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:45:33.691471 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:45:33.691471 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:45:33.691471 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:45:33.691471 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:45:33.691471 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:45:33.691471 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:45:33.691471 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:45:33.691471 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:45:33.691471 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:45:33.691471 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:45:33.691471 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:45:33.691471 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:45:33.691471 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:45:33.691471 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:45:33.691471 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:45:33.692496 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:45:33.692496 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:45:33.692496 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:45:33.692496 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:45:33.692496 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:45:33.692496 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:45:33.692496 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:45:33.692496 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:45:33.692496 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:45:33.692496 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:45:33.692496 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:45:33.692496 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:45:33.692496 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:45:33.692496 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:45:33.692496 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:45:33.692496 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:45:33.692496 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:45:33.693550 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:45:33.693550 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:45:33.693550 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:45:33.693550 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 623/1256] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:45:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:45:33.700864 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11178048-ffde-467e-9729-66984a8c4f5b None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:33.800135 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:33.815693 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11178048-ffde-467e-9729-66984a8c4f5b None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:33.852934 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc05c5f-e37d-4d6e-888d-a1c470bacb24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:33.853554 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc05c5f-e37d-4d6e-888d-a1c470bacb24 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:33.853833 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc05c5f-e37d-4d6e-888d-a1c470bacb24 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:33.854102 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc05c5f-e37d-4d6e-888d-a1c470bacb24 None admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:33.854742 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc05c5f-e37d-4d6e-888d-a1c470bacb24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:45:33.855042 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc05c5f-e37d-4d6e-888d-a1c470bacb24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:33.856408 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc05c5f-e37d-4d6e-888d-a1c470bacb24 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:33.868009 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 634/1257] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 19 14:45:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:45:33.877250 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34267b2c-c6e0-4a4a-ac42-f55844dc4969 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:33.993377 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34267b2c-c6e0-4a4a-ac42-f55844dc4969 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:34.037029 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322a7d1d-17e2-4189-9eae-e9c540cb7085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:34.037671 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a7d1d-17e2-4189-9eae-e9c540cb7085 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:34.037945 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a7d1d-17e2-4189-9eae-e9c540cb7085 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:34.038211 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a7d1d-17e2-4189-9eae-e9c540cb7085 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:34.045019 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322a7d1d-17e2-4189-9eae-e9c540cb7085 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:34.046510 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322a7d1d-17e2-4189-9eae-e9c540cb7085 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:34.059095 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-322a7d1d-17e2-4189-9eae-e9c540cb7085 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:45:34.059095 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:45:34.059095 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:45:34.059095 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:45:34.059095 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:45:34.059095 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:45:34.059095 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:45:34.059095 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:45:34.059095 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:45:34.059095 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:45:34.059095 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:45:34.059095 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:45:34.059095 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:45:34.059095 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:45:34.059095 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:45:34.060079 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:45:34.060079 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:45:34.060079 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:45:34.060079 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:45:34.060079 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:45:34.060079 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:45:34.060079 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:45:34.060079 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:45:34.060079 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:45:34.060079 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:45:34.060079 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:45:34.060079 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:45:34.060079 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:45:34.060079 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:45:34.060079 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:45:34.060079 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:45:34.060079 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:45:34.061060 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:45:34.061060 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:45:34.061060 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:45:34.061060 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:45:34.061060 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:45:34.061060 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:45:34.061060 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:45:34.061060 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:45:34.061060 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 624/1258] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 19 14:45:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:45:34.069345 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc05c5f-e37d-4d6e-888d-a1c470bacb24 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:34.187105 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc05c5f-e37d-4d6e-888d-a1c470bacb24 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:34.222668 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c873bc04-7f6d-4c30-aef3-116bc0ee21c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:34.223262 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c873bc04-7f6d-4c30-aef3-116bc0ee21c8 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:34.223538 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c873bc04-7f6d-4c30-aef3-116bc0ee21c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:34.223805 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c873bc04-7f6d-4c30-aef3-116bc0ee21c8 None admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:34.224491 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c873bc04-7f6d-4c30-aef3-116bc0ee21c8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:45:34.224792 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c873bc04-7f6d-4c30-aef3-116bc0ee21c8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:34.226252 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c873bc04-7f6d-4c30-aef3-116bc0ee21c8 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:34.240626 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 635/1259] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 19 14:45:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:45:34.247710 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322a7d1d-17e2-4189-9eae-e9c540cb7085 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:34.277169 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:34.372925 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322a7d1d-17e2-4189-9eae-e9c540cb7085 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:34.411045 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4733f6c7-a9b0-4f26-8780-955cc9dfb6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:34.411632 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733f6c7-a9b0-4f26-8780-955cc9dfb6dc None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:34.411932 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733f6c7-a9b0-4f26-8780-955cc9dfb6dc None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:34.412195 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733f6c7-a9b0-4f26-8780-955cc9dfb6dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:34.412906 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4733f6c7-a9b0-4f26-8780-955cc9dfb6dc None admin] RBAC: Adding query filter params (role.id=019bde1756cb40de8ce06cef6b261f79, scope.project.id=9ede5dc59ece4d9282867a99e94c4c41, user.id=da0a58c526f34afda909e4ede2b1e1c5) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:45:34.413230 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4733f6c7-a9b0-4f26-8780-955cc9dfb6dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:34.414661 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4733f6c7-a9b0-4f26-8780-955cc9dfb6dc None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:34.420701 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 625/1260] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 19 14:45:34 2022] GET /identity/v3/role_assignments?user.id=da0a58c526f34afda909e4ede2b1e1c5&scope.project.id=9ede5dc59ece4d9282867a99e94c4c41&role.id=019bde1756cb40de8ce06cef6b261f79 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:45:36.580044 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5aa4e0-7396-4722-a6d0-664cef98bbcc None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:36.580607 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5aa4e0-7396-4722-a6d0-664cef98bbcc None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:36.580858 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5aa4e0-7396-4722-a6d0-664cef98bbcc None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:36.582245 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 636/1261] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:45:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:45:36.588666 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32344b5d-c8e3-40d4-8bf1-d1961ac829d4 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:36.589128 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32344b5d-c8e3-40d4-8bf1-d1961ac829d4 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:36.589331 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32344b5d-c8e3-40d4-8bf1-d1961ac829d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:36.611044 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-32344b5d-c8e3-40d4-8bf1-d1961ac829d4 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:45:36.612356 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-32344b5d-c8e3-40d4-8bf1-d1961ac829d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:45:36.683670 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 626/1262] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:45:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 14:45:36.946615 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5aa4e0-7396-4722-a6d0-664cef98bbcc None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:36.959134 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:37.054999 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5aa4e0-7396-4722-a6d0-664cef98bbcc None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:37.093102 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d4a8c1-22ab-49c2-8fa3-78e17988c6b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:37.093709 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d4a8c1-22ab-49c2-8fa3-78e17988c6b8 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:37.093977 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d4a8c1-22ab-49c2-8fa3-78e17988c6b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:37.094242 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d4a8c1-22ab-49c2-8fa3-78e17988c6b8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:37.105235 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d4a8c1-22ab-49c2-8fa3-78e17988c6b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:45:37.110104 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-f7d4a8c1-22ab-49c2-8fa3-78e17988c6b8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:45:37.110104 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:45:37.110104 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:45:37.110104 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:45:37.110104 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:45:37.110104 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:45:37.110104 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:45:37.110104 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:45:37.110104 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:45:37.110104 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:45:37.110104 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:45:37.110104 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:45:37.110104 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:45:37.110104 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:45:37.110104 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:45:37.110104 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:45:37.111119 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:45:37.111119 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:45:37.111119 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:45:37.111119 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:45:37.111119 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:45:37.111119 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:45:37.111119 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:45:37.111119 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:45:37.111119 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:45:37.111119 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:45:37.111119 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:45:37.111119 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:45:37.111119 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:45:37.111119 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:45:37.111119 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:45:37.111119 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:45:37.112578 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:45:37.112578 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:45:37.112578 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:45:37.112578 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:45:37.112578 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:45:37.112578 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:45:37.112578 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:45:37.112578 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:45:37.112578 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:45:37.112578 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:45:37.112578 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:45:37.112578 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:45:37.112578 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 637/1263] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 19 14:45:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:45:37.117955 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32344b5d-c8e3-40d4-8bf1-d1961ac829d4 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:37.146151 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:37.244727 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32344b5d-c8e3-40d4-8bf1-d1961ac829d4 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:37.281647 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c37f88-b352-49d4-9faa-194d173d1a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:37.282246 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c37f88-b352-49d4-9faa-194d173d1a34 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:37.282537 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c37f88-b352-49d4-9faa-194d173d1a34 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:37.282796 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c37f88-b352-49d4-9faa-194d173d1a34 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:37.283638 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c37f88-b352-49d4-9faa-194d173d1a34 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:45:37.283964 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c37f88-b352-49d4-9faa-194d173d1a34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:37.285453 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c37f88-b352-49d4-9faa-194d173d1a34 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:37.293420 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 627/1264] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 19 14:45:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:45:37.302591 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d4a8c1-22ab-49c2-8fa3-78e17988c6b8 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:37.384463 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:37.421177 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d4a8c1-22ab-49c2-8fa3-78e17988c6b8 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:37.456014 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc67663-bc01-4ab4-82da-87e17cdb7ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:37.456628 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc67663-bc01-4ab4-82da-87e17cdb7ce8 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:37.456898 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc67663-bc01-4ab4-82da-87e17cdb7ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:37.457195 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc67663-bc01-4ab4-82da-87e17cdb7ce8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:37.468353 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc67663-bc01-4ab4-82da-87e17cdb7ce8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:37.469814 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc67663-bc01-4ab4-82da-87e17cdb7ce8 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:37.485340 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-7fc67663-bc01-4ab4-82da-87e17cdb7ce8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:45:37.485340 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:45:37.485340 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:45:37.485340 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:45:37.485340 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:45:37.485340 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:45:37.485340 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:45:37.485340 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:45:37.485340 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:45:37.485340 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:45:37.485340 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:45:37.485340 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:45:37.485340 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:45:37.485340 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:45:37.485340 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:45:37.485340 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:45:37.486428 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:45:37.486428 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:45:37.486428 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:45:37.486428 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:45:37.486428 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:45:37.486428 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:45:37.486428 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:45:37.486428 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:45:37.486428 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:45:37.486428 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:45:37.486428 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:45:37.486428 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:45:37.486428 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:45:37.486428 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:45:37.486428 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:45:37.486428 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:45:37.486428 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:45:37.487605 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:45:37.487605 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:45:37.487605 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:45:37.487605 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 638/1265] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:45:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:45:37.495308 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c37f88-b352-49d4-9faa-194d173d1a34 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:37.603262 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:37.626467 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c37f88-b352-49d4-9faa-194d173d1a34 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:37.663186 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2858d565-8e46-4c31-afe4-bc5cf3525628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:37.663775 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2858d565-8e46-4c31-afe4-bc5cf3525628 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:37.664056 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2858d565-8e46-4c31-afe4-bc5cf3525628 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:37.664320 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2858d565-8e46-4c31-afe4-bc5cf3525628 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:37.664944 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2858d565-8e46-4c31-afe4-bc5cf3525628 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:45:37.665276 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2858d565-8e46-4c31-afe4-bc5cf3525628 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:37.666640 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2858d565-8e46-4c31-afe4-bc5cf3525628 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:37.678841 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 628/1266] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 19 14:45:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:45:37.687430 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc67663-bc01-4ab4-82da-87e17cdb7ce8 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:37.808654 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc67663-bc01-4ab4-82da-87e17cdb7ce8 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:37.828466 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:37.847819 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5253e915-d972-4e07-8ae7-438e8837dcf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:37.848436 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253e915-d972-4e07-8ae7-438e8837dcf0 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:37.848710 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253e915-d972-4e07-8ae7-438e8837dcf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:37.848978 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253e915-d972-4e07-8ae7-438e8837dcf0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:37.857267 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5253e915-d972-4e07-8ae7-438e8837dcf0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:37.858693 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5253e915-d972-4e07-8ae7-438e8837dcf0 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:37.870251 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-5253e915-d972-4e07-8ae7-438e8837dcf0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 19 14:45:37.870251 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:45:37.870251 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:45:37.870251 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:45:37.870251 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:45:37.870251 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:45:37.870251 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:45:37.870251 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:45:37.870251 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:45:37.870251 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:45:37.870251 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:45:37.870251 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:45:37.870251 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:45:37.870251 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:45:37.870251 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:45:37.870251 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:45:37.871351 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:45:37.871351 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:45:37.871351 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:45:37.871351 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:45:37.871351 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:45:37.871351 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:45:37.871351 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:45:37.871351 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:45:37.871351 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:45:37.871351 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:45:37.871351 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:45:37.871351 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:45:37.871351 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:45:37.871351 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:45:37.871351 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:45:37.871351 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:45:37.871351 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:45:37.871351 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:45:37.872297 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:45:37.872297 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:45:37.872297 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:45:37.872297 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:45:37.872297 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:45:37.872297 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:45:37.872297 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:45:37.872297 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:45:37.872297 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 19 14:45:37.872297 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:45:37.872297 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 639/1267] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:45:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 14:45:37.877735 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2858d565-8e46-4c31-afe4-bc5cf3525628 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:37.986228 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2858d565-8e46-4c31-afe4-bc5cf3525628 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:38.023204 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dbd26a-b11e-4174-9c94-ffdc8de5a6e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:38.023833 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dbd26a-b11e-4174-9c94-ffdc8de5a6e6 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:38.024111 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dbd26a-b11e-4174-9c94-ffdc8de5a6e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:38.024379 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dbd26a-b11e-4174-9c94-ffdc8de5a6e6 None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:38.025132 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dbd26a-b11e-4174-9c94-ffdc8de5a6e6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:45:38.025431 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dbd26a-b11e-4174-9c94-ffdc8de5a6e6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:38.026861 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dbd26a-b11e-4174-9c94-ffdc8de5a6e6 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:38.036334 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:38.046059 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 629/1268] 10.222.0.26 () {56 vars in 1143 bytes} [Mon Sep 19 14:45:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:45:38.052775 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5253e915-d972-4e07-8ae7-438e8837dcf0 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:38.162250 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5253e915-d972-4e07-8ae7-438e8837dcf0 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:38.196870 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68897ed-87aa-434c-9cc9-9297d9fc631a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:38.197508 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68897ed-87aa-434c-9cc9-9297d9fc631a None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:38.197785 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68897ed-87aa-434c-9cc9-9297d9fc631a None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:38.198059 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68897ed-87aa-434c-9cc9-9297d9fc631a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:38.208983 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68897ed-87aa-434c-9cc9-9297d9fc631a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:38.210492 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68897ed-87aa-434c-9cc9-9297d9fc631a None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:38.225181 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-e68897ed-87aa-434c-9cc9-9297d9fc631a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:45:38.225181 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:45:38.225181 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:45:38.225181 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:45:38.225181 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:45:38.225181 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:45:38.225181 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:45:38.225181 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:45:38.225181 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:45:38.225181 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:45:38.225181 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:45:38.225181 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:45:38.225181 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:45:38.225181 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:45:38.225181 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:45:38.225181 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:45:38.226218 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:45:38.226218 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:45:38.226218 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:45:38.226218 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:45:38.226218 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:45:38.226218 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:45:38.226218 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:45:38.226218 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:45:38.226218 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:45:38.226218 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:45:38.226218 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:45:38.226218 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:45:38.226218 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:45:38.226218 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:45:38.226218 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:45:38.226218 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:45:38.226218 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:45:38.227244 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:45:38.227244 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:45:38.227244 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:45:38.227244 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 640/1269] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:45:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:45:38.232481 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dbd26a-b11e-4174-9c94-ffdc8de5a6e6 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:38.332846 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dbd26a-b11e-4174-9c94-ffdc8de5a6e6 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:38.367583 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96137a48-29b3-4697-992d-676ee0a40e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:38.368166 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96137a48-29b3-4697-992d-676ee0a40e53 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:38.368444 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96137a48-29b3-4697-992d-676ee0a40e53 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:38.368710 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96137a48-29b3-4697-992d-676ee0a40e53 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:38.369373 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96137a48-29b3-4697-992d-676ee0a40e53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:45:38.369668 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96137a48-29b3-4697-992d-676ee0a40e53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:38.371047 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96137a48-29b3-4697-992d-676ee0a40e53 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:38.382552 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 630/1270] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 19 14:45:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:45:38.389033 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68897ed-87aa-434c-9cc9-9297d9fc631a None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:38.424039 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:38.506301 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68897ed-87aa-434c-9cc9-9297d9fc631a None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:38.543802 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e96f5e-018d-479a-ba78-712338f59d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:38.544418 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e96f5e-018d-479a-ba78-712338f59d18 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:38.544691 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e96f5e-018d-479a-ba78-712338f59d18 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:38.544960 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e96f5e-018d-479a-ba78-712338f59d18 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:38.552007 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e96f5e-018d-479a-ba78-712338f59d18 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:38.553508 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e96f5e-018d-479a-ba78-712338f59d18 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:38.565540 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-c7e96f5e-018d-479a-ba78-712338f59d18 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:45:38.565540 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:45:38.565540 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:45:38.565540 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:45:38.565540 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:45:38.565540 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:45:38.565540 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:45:38.565540 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:45:38.565540 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:45:38.565540 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:45:38.565540 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:45:38.565540 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:45:38.565540 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:45:38.565540 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:45:38.565540 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:45:38.566511 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:45:38.566511 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:45:38.566511 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:45:38.566511 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:45:38.566511 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:45:38.566511 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:45:38.566511 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:45:38.566511 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:45:38.566511 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:45:38.566511 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:45:38.566511 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:45:38.566511 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:45:38.566511 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:45:38.566511 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:45:38.566511 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:45:38.566511 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:45:38.566511 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:45:38.567396 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:45:38.567396 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:45:38.567396 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:45:38.567396 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:45:38.567396 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:45:38.567396 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:45:38.567396 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:45:38.567396 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:45:38.567396 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 641/1271] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 19 14:45:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:45:38.572679 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96137a48-29b3-4697-992d-676ee0a40e53 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:38.640681 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:38.688791 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96137a48-29b3-4697-992d-676ee0a40e53 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:38.723539 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93a6507-1542-4748-ad20-308f32fca237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:38.724127 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a6507-1542-4748-ad20-308f32fca237 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:38.724402 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a6507-1542-4748-ad20-308f32fca237 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:38.724666 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a6507-1542-4748-ad20-308f32fca237 None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:38.725380 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93a6507-1542-4748-ad20-308f32fca237 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:45:38.725689 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93a6507-1542-4748-ad20-308f32fca237 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:38.727110 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93a6507-1542-4748-ad20-308f32fca237 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:38.739268 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 631/1272] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 19 14:45:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:45:38.745622 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e96f5e-018d-479a-ba78-712338f59d18 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:38.845061 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:38.854934 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e96f5e-018d-479a-ba78-712338f59d18 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:38.890679 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f93fad-955e-40ae-8a60-540b0296ed24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:38.891311 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f93fad-955e-40ae-8a60-540b0296ed24 None admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:38.891582 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f93fad-955e-40ae-8a60-540b0296ed24 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:38.891847 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f93fad-955e-40ae-8a60-540b0296ed24 None admin] PATH_INFO: `/v3/projects/9ede5dc59ece4d9282867a99e94c4c41/users/da0a58c526f34afda909e4ede2b1e1c5/roles/019bde1756cb40de8ce06cef6b261f79` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:38.893792 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f93fad-955e-40ae-8a60-540b0296ed24 None admin] RBAC: Authorizing `identity:create_grant(project_id=9ede5dc59ece4d9282867a99e94c4c41, user_id=da0a58c526f34afda909e4ede2b1e1c5, role_id=019bde1756cb40de8ce06cef6b261f79)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:38.895201 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f93fad-955e-40ae-8a60-540b0296ed24 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:38.912126 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 642/1273] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Sep 19 14:45:38 2022] PUT /identity/v3/projects/9ede5dc59ece4d9282867a99e94c4c41/users/da0a58c526f34afda909e4ede2b1e1c5/roles/019bde1756cb40de8ce06cef6b261f79 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:45:41.019658 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa95fbe-c327-4274-8476-ed2d0406125a None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:41.020471 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa95fbe-c327-4274-8476-ed2d0406125a None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:41.020471 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa95fbe-c327-4274-8476-ed2d0406125a None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:41.022474 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 632/1274] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:45:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:45:41.030686 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9669bd33-59e8-4d24-a112-e86477f257e7 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:41.031152 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9669bd33-59e8-4d24-a112-e86477f257e7 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:41.031260 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9669bd33-59e8-4d24-a112-e86477f257e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:41.052924 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-9669bd33-59e8-4d24-a112-e86477f257e7 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:45:41.054156 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-9669bd33-59e8-4d24-a112-e86477f257e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:45:41.127479 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 643/1275] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:45:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:45:41.394472 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa95fbe-c327-4274-8476-ed2d0406125a None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:41.526644 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa95fbe-c327-4274-8476-ed2d0406125a None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:41.546983 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:41.567041 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d394f690-51c4-48b0-93c6-2d0c0ce8ad04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:41.567673 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d394f690-51c4-48b0-93c6-2d0c0ce8ad04 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:41.568009 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d394f690-51c4-48b0-93c6-2d0c0ce8ad04 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:41.568225 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d394f690-51c4-48b0-93c6-2d0c0ce8ad04 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:41.579586 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d394f690-51c4-48b0-93c6-2d0c0ce8ad04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 14:45:41.585076 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-d394f690-51c4-48b0-93c6-2d0c0ce8ad04 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:45:41.585076 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:45:41.585076 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:45:41.585076 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:45:41.585076 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:45:41.585076 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:45:41.585076 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:45:41.585076 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:45:41.585076 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:45:41.585076 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:45:41.585076 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:45:41.585076 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:45:41.585076 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 14:45:41.585076 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 14:45:41.585076 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 14:45:41.585076 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 14:45:41.586734 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 14:45:41.586734 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 14:45:41.586734 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 14:45:41.586734 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 14:45:41.586734 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:45:41.586734 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:45:41.586734 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:45:41.586734 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:45:41.586734 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:45:41.586734 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:45:41.586734 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:45:41.586734 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:45:41.586734 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:45:41.586734 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:45:41.586734 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:45:41.586734 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:45:41.587641 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:45:41.587641 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:45:41.587641 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:45:41.587641 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:45:41.587641 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 14:45:41.587641 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 14:45:41.587641 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 14:45:41.587641 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 14:45:41.587641 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 14:45:41.587641 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 14:45:41.587641 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 14:45:41.587641 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:45:41.587641 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 633/1276] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Sep 19 14:45:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:45:41.594334 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9669bd33-59e8-4d24-a112-e86477f257e7 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:41.684549 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:41.713233 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9669bd33-59e8-4d24-a112-e86477f257e7 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:41.751351 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efea933d-800e-48a9-b49b-33defe782686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:41.752008 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea933d-800e-48a9-b49b-33defe782686 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:41.752356 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea933d-800e-48a9-b49b-33defe782686 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:41.752642 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea933d-800e-48a9-b49b-33defe782686 None admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:41.753339 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efea933d-800e-48a9-b49b-33defe782686 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:45:41.753639 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efea933d-800e-48a9-b49b-33defe782686 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:41.755007 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efea933d-800e-48a9-b49b-33defe782686 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:41.763227 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 644/1277] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Sep 19 14:45:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:45:41.769595 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d394f690-51c4-48b0-93c6-2d0c0ce8ad04 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:41.889446 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d394f690-51c4-48b0-93c6-2d0c0ce8ad04 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:41.924123 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba18d1c7-dcbb-430b-86c4-db0e42673275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:41.924731 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba18d1c7-dcbb-430b-86c4-db0e42673275 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:41.925015 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba18d1c7-dcbb-430b-86c4-db0e42673275 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:41.925293 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba18d1c7-dcbb-430b-86c4-db0e42673275 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:41.935203 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba18d1c7-dcbb-430b-86c4-db0e42673275 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:41.936579 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba18d1c7-dcbb-430b-86c4-db0e42673275 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:41.951226 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-ba18d1c7-dcbb-430b-86c4-db0e42673275 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:45:41.951226 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:45:41.951226 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:45:41.951226 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:45:41.951226 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:45:41.951226 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:45:41.951226 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:45:41.951226 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:45:41.951226 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:45:41.951226 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:45:41.951226 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:45:41.951226 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:45:41.951226 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:45:41.951226 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:45:41.951226 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:45:41.951226 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:45:41.952297 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:45:41.952297 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:45:41.952297 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:45:41.952297 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:45:41.952297 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:45:41.952297 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:45:41.952297 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:45:41.952297 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:45:41.952297 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:45:41.952297 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:45:41.952297 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:45:41.952297 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:45:41.952297 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:45:41.952297 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:45:41.952297 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:45:41.952297 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:45:41.952297 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:45:41.953239 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:45:41.953239 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:45:41.953239 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:45:41.953239 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 634/1278] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:45:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:45:41.962340 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efea933d-800e-48a9-b49b-33defe782686 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:42.073536 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efea933d-800e-48a9-b49b-33defe782686 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:42.110838 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c9e633-d8c8-4162-8227-1cefffb83d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:42.111668 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c9e633-d8c8-4162-8227-1cefffb83d67 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:42.111813 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c9e633-d8c8-4162-8227-1cefffb83d67 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:42.112052 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c9e633-d8c8-4162-8227-1cefffb83d67 None admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:42.112711 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c9e633-d8c8-4162-8227-1cefffb83d67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:45:42.113028 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c9e633-d8c8-4162-8227-1cefffb83d67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:42.114434 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c9e633-d8c8-4162-8227-1cefffb83d67 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:42.126505 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 645/1279] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 19 14:45:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:45:42.134968 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba18d1c7-dcbb-430b-86c4-db0e42673275 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:42.171655 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:42.248204 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba18d1c7-dcbb-430b-86c4-db0e42673275 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:42.283620 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a78714-a6b7-4548-8631-66d199ed8736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:42.284228 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a78714-a6b7-4548-8631-66d199ed8736 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:42.284503 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a78714-a6b7-4548-8631-66d199ed8736 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:42.284768 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a78714-a6b7-4548-8631-66d199ed8736 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:42.292583 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a78714-a6b7-4548-8631-66d199ed8736 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:42.294050 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a78714-a6b7-4548-8631-66d199ed8736 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:42.305737 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-d2a78714-a6b7-4548-8631-66d199ed8736 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 19 14:45:42.305737 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:45:42.305737 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:45:42.305737 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:45:42.305737 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:45:42.305737 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:45:42.305737 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:45:42.305737 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:45:42.305737 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:45:42.305737 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:45:42.305737 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:45:42.305737 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:45:42.305737 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 14:45:42.305737 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 14:45:42.305737 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 14:45:42.305737 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 14:45:42.306833 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:45:42.306833 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:45:42.306833 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 14:45:42.306833 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:45:42.306833 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 14:45:42.306833 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 14:45:42.306833 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:45:42.306833 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:45:42.306833 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:45:42.306833 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:45:42.306833 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:45:42.306833 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:45:42.306833 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:45:42.306833 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:45:42.306833 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:45:42.306833 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:45:42.306833 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:45:42.306833 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:45:42.307799 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:45:42.307799 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:45:42.307799 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 14:45:42.307799 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 14:45:42.307799 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 14:45:42.307799 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 14:45:42.307799 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 14:45:42.307799 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 14:45:42.307799 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 19 14:45:42.307799 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:45:42.309231 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 635/1280] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:45:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:45:42.312980 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c9e633-d8c8-4162-8227-1cefffb83d67 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:42.317234 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:42.417992 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c9e633-d8c8-4162-8227-1cefffb83d67 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:42.452976 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6859c2-19a3-4b6b-acf5-f2f9d10a189b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:42.453591 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6859c2-19a3-4b6b-acf5-f2f9d10a189b None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:42.453865 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6859c2-19a3-4b6b-acf5-f2f9d10a189b None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:42.454128 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6859c2-19a3-4b6b-acf5-f2f9d10a189b None admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:42.454895 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6859c2-19a3-4b6b-acf5-f2f9d10a189b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:45:42.455377 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6859c2-19a3-4b6b-acf5-f2f9d10a189b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:42.457221 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6859c2-19a3-4b6b-acf5-f2f9d10a189b None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:42.475183 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 646/1281] 10.222.0.26 () {56 vars in 1143 bytes} [Mon Sep 19 14:45:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:45:42.482168 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a78714-a6b7-4548-8631-66d199ed8736 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:42.583783 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:42.599242 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a78714-a6b7-4548-8631-66d199ed8736 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:42.637817 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f27880a-537d-406c-a5db-a60b71911ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:42.638439 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f27880a-537d-406c-a5db-a60b71911ee7 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:42.638711 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f27880a-537d-406c-a5db-a60b71911ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:42.638977 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f27880a-537d-406c-a5db-a60b71911ee7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:42.714189 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f27880a-537d-406c-a5db-a60b71911ee7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:42.715645 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f27880a-537d-406c-a5db-a60b71911ee7 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:42.817657 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:42.829054 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 636/1282] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Sep 19 14:45:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 14:45:42.835273 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6859c2-19a3-4b6b-acf5-f2f9d10a189b None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:42.902336 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:42.950281 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6859c2-19a3-4b6b-acf5-f2f9d10a189b None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:42.989038 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3cbd0a-6336-436d-840a-0644b2e8fcd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:42.989685 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3cbd0a-6336-436d-840a-0644b2e8fcd8 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:42.989959 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3cbd0a-6336-436d-840a-0644b2e8fcd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:42.990223 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3cbd0a-6336-436d-840a-0644b2e8fcd8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:43.000331 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3cbd0a-6336-436d-840a-0644b2e8fcd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:43.001787 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3cbd0a-6336-436d-840a-0644b2e8fcd8 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:43.016046 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-cf3cbd0a-6336-436d-840a-0644b2e8fcd8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:45:43.016046 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:45:43.016046 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:45:43.016046 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:45:43.016046 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:45:43.016046 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:45:43.016046 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:45:43.016046 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:45:43.016046 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:45:43.016046 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:45:43.016046 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:45:43.016046 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:45:43.016046 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 14:45:43.016046 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 14:45:43.016046 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 14:45:43.016046 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 14:45:43.017074 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:45:43.017074 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:45:43.017074 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:45:43.017074 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:45:43.017074 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:45:43.017074 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:45:43.017074 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:45:43.017074 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:45:43.017074 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:45:43.017074 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:45:43.017074 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:45:43.017074 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:45:43.017074 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:45:43.017074 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:45:43.017074 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:45:43.017074 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:45:43.017074 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 14:45:43.018087 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 14:45:43.018087 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 14:45:43.018087 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:45:43.018087 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 647/1283] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:45:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:45:43.023276 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f27880a-537d-406c-a5db-a60b71911ee7 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:43.130149 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f27880a-537d-406c-a5db-a60b71911ee7 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:43.168979 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ce92f8-41c5-4f23-b98d-4375332d320c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:43.169613 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce92f8-41c5-4f23-b98d-4375332d320c None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:43.169845 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce92f8-41c5-4f23-b98d-4375332d320c None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:43.170110 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce92f8-41c5-4f23-b98d-4375332d320c None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:43.170736 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ce92f8-41c5-4f23-b98d-4375332d320c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:45:43.171039 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ce92f8-41c5-4f23-b98d-4375332d320c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:43.172444 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ce92f8-41c5-4f23-b98d-4375332d320c None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:43.183965 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 637/1284] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Sep 19 14:45:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:45:43.193028 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3cbd0a-6336-436d-840a-0644b2e8fcd8 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:43.301197 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3cbd0a-6336-436d-840a-0644b2e8fcd8 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:43.314809 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:43.338840 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f363362a-1dbb-42be-bf8f-734471b08998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:43.339766 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363362a-1dbb-42be-bf8f-734471b08998 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:43.340178 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363362a-1dbb-42be-bf8f-734471b08998 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:43.340523 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363362a-1dbb-42be-bf8f-734471b08998 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:43.350977 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f363362a-1dbb-42be-bf8f-734471b08998 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:43.352426 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f363362a-1dbb-42be-bf8f-734471b08998 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:43.364886 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application [None req-f363362a-1dbb-42be-bf8f-734471b08998 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:45:43.364886 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:45:43.364886 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:45:43.364886 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:45:43.364886 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:45:43.364886 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:45:43.364886 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:45:43.364886 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:45:43.364886 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:45:43.364886 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:45:43.364886 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:45:43.364886 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:45:43.364886 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 14:45:43.364886 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 14:45:43.364886 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 14:45:43.366008 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 14:45:43.366008 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:45:43.366008 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:45:43.366008 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:45:43.366008 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:45:43.366008 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:45:43.366008 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:45:43.366008 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:45:43.366008 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application with Lock( Sep 19 14:45:43.366008 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:45:43.366008 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:45:43.366008 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:45:43.366008 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:45:43.366008 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:45:43.366008 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:45:43.366008 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:45:43.366008 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:45:43.367117 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 14:45:43.367117 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 14:45:43.367117 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 14:45:43.367117 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 14:45:43.367117 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 14:45:43.367117 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 14:45:43.367117 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 14:45:43.367117 dv-cinder-756709-7-smb devstack@keystone.service[81471]: ERROR keystone.server.flask.application Sep 19 14:45:43.367117 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 648/1285] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Sep 19 14:45:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:45:43.374139 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ce92f8-41c5-4f23-b98d-4375332d320c None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:43.425478 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:43.476890 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ce92f8-41c5-4f23-b98d-4375332d320c None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:43.516068 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfb83c9-338e-49a5-b5ed-d4d22437826a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:43.516669 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb83c9-338e-49a5-b5ed-d4d22437826a None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:43.516946 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb83c9-338e-49a5-b5ed-d4d22437826a None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:43.517248 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb83c9-338e-49a5-b5ed-d4d22437826a None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:43.517939 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfb83c9-338e-49a5-b5ed-d4d22437826a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:45:43.518373 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfb83c9-338e-49a5-b5ed-d4d22437826a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:43.520192 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfb83c9-338e-49a5-b5ed-d4d22437826a None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:43.533499 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 638/1286] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Sep 19 14:45:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:45:43.543048 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f363362a-1dbb-42be-bf8f-734471b08998 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:43.654911 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f363362a-1dbb-42be-bf8f-734471b08998 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:43.689899 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a081fc86-c404-4634-b853-2a117e2620a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:43.690618 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081fc86-c404-4634-b853-2a117e2620a0 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:43.691063 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081fc86-c404-4634-b853-2a117e2620a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:43.691332 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081fc86-c404-4634-b853-2a117e2620a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:43.692046 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a081fc86-c404-4634-b853-2a117e2620a0 None admin] RBAC: Adding query filter params (role.id=019bde1756cb40de8ce06cef6b261f79, scope.project.id=9ede5dc59ece4d9282867a99e94c4c41, user.id=da0a58c526f34afda909e4ede2b1e1c5) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:45:43.692318 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a081fc86-c404-4634-b853-2a117e2620a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:43.693786 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a081fc86-c404-4634-b853-2a117e2620a0 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:43.699817 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 649/1287] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Sep 19 14:45:43 2022] GET /identity/v3/role_assignments?user.id=da0a58c526f34afda909e4ede2b1e1c5&scope.project.id=9ede5dc59ece4d9282867a99e94c4c41&role.id=019bde1756cb40de8ce06cef6b261f79 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:45:45.860606 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f464d0-544f-47ba-bf7f-40a9d2ad1601 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:45.861656 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f464d0-544f-47ba-bf7f-40a9d2ad1601 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:45.861656 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f464d0-544f-47ba-bf7f-40a9d2ad1601 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:45.863237 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 639/1288] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:45:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:45:45.872355 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07665c86-9b48-457f-8e85-7ed3b92158e8 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:45.873054 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07665c86-9b48-457f-8e85-7ed3b92158e8 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:45.873171 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07665c86-9b48-457f-8e85-7ed3b92158e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:45.899401 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-07665c86-9b48-457f-8e85-7ed3b92158e8 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:45:45.900585 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-07665c86-9b48-457f-8e85-7ed3b92158e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:45:45.933307 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:45.985764 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 650/1289] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:45:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:45:46.253715 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f464d0-544f-47ba-bf7f-40a9d2ad1601 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:46.378856 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f464d0-544f-47ba-bf7f-40a9d2ad1601 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:46.389186 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:46.415790 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72627cd2-e3c7-4a4c-8df3-bb9d9c45e852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:46.416404 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72627cd2-e3c7-4a4c-8df3-bb9d9c45e852 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:46.416671 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72627cd2-e3c7-4a4c-8df3-bb9d9c45e852 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:46.416934 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72627cd2-e3c7-4a4c-8df3-bb9d9c45e852 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:46.417538 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72627cd2-e3c7-4a4c-8df3-bb9d9c45e852 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:46.418904 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72627cd2-e3c7-4a4c-8df3-bb9d9c45e852 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:46.427892 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-72627cd2-e3c7-4a4c-8df3-bb9d9c45e852 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 19 14:45:46.427892 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:45:46.427892 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 14:45:46.427892 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 14:45:46.427892 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 14:45:46.427892 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 14:45:46.427892 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 14:45:46.427892 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:45:46.427892 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 19 14:45:46.427892 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:45:46.427892 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 14:45:46.427892 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:45:46.427892 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:45:46.427892 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:45:46.427892 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:45:46.427892 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:45:46.427892 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:45:46.428978 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:45:46.428978 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:45:46.428978 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:45:46.428978 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:45:46.428978 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:45:46.428978 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:45:46.428978 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 14:45:46.428978 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 14:45:46.428978 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 14:45:46.428978 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 14:45:46.428978 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:45:46.428978 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:45:46.428978 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:45:46.428978 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:45:46.428978 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:45:46.428978 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:45:46.429913 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:45:46.429913 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:45:46.429913 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:45:46.429913 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:45:46.429913 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:45:46.429913 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:45:46.429913 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:45:46.429913 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:45:46.429913 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:45:46.429913 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:45:46.429913 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 14:45:46.429913 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:45:46.429913 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 19 14:45:46.429913 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:45:46.429913 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 640/1290] 10.222.0.26 () {56 vars in 1117 bytes} [Mon Sep 19 14:45:46 2022] GET /identity/v3/services/placement => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:45:46.436030 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07665c86-9b48-457f-8e85-7ed3b92158e8 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:46.550412 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07665c86-9b48-457f-8e85-7ed3b92158e8 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:46.588804 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaee956-9f95-4dc0-8e75-e521cb0ca7ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:46.589475 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaee956-9f95-4dc0-8e75-e521cb0ca7ec None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:46.589812 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaee956-9f95-4dc0-8e75-e521cb0ca7ec None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:46.590040 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaee956-9f95-4dc0-8e75-e521cb0ca7ec None admin] PATH_INFO: `/v3/services` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:46.590691 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaee956-9f95-4dc0-8e75-e521cb0ca7ec None admin] RBAC: Adding query filter params (name=placement) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:45:46.590970 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaee956-9f95-4dc0-8e75-e521cb0ca7ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:46.592327 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaee956-9f95-4dc0-8e75-e521cb0ca7ec None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:46.597561 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 651/1291] 10.222.0.26 () {56 vars in 1116 bytes} [Mon Sep 19 14:45:46 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:45:46.604377 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72627cd2-e3c7-4a4c-8df3-bb9d9c45e852 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:46.717140 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72627cd2-e3c7-4a4c-8df3-bb9d9c45e852 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:46.752892 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3fac06-440e-4bd4-82de-66ad25cb10aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:46.753508 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3fac06-440e-4bd4-82de-66ad25cb10aa None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:46.753782 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3fac06-440e-4bd4-82de-66ad25cb10aa None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:46.754042 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3fac06-440e-4bd4-82de-66ad25cb10aa None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:46.754647 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3fac06-440e-4bd4-82de-66ad25cb10aa None admin] RBAC: Adding query filter params (type=placement) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:45:46.754944 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3fac06-440e-4bd4-82de-66ad25cb10aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:46.756304 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3fac06-440e-4bd4-82de-66ad25cb10aa None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:46.760690 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 641/1292] 10.222.0.26 () {56 vars in 1116 bytes} [Mon Sep 19 14:45:46 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:45:48.900896 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9075eb2f-d88d-4732-87b5-f186a0912df3 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:48.901858 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9075eb2f-d88d-4732-87b5-f186a0912df3 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:48.901858 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9075eb2f-d88d-4732-87b5-f186a0912df3 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:48.904022 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 652/1293] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:45:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:45:48.910356 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5a1de-eb47-4c2b-a120-39594461494d None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:48.911093 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5a1de-eb47-4c2b-a120-39594461494d None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:48.911238 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5a1de-eb47-4c2b-a120-39594461494d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:48.935517 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-15a5a1de-eb47-4c2b-a120-39594461494d None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:45:48.936693 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-15a5a1de-eb47-4c2b-a120-39594461494d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:45:48.970285 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:49.012203 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 642/1294] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:45:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:45:49.276140 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9075eb2f-d88d-4732-87b5-f186a0912df3 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:49.317267 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:49.397310 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9075eb2f-d88d-4732-87b5-f186a0912df3 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:49.432706 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009c8e7f-f35d-4b69-b428-0d6d445c887c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:49.433330 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c8e7f-f35d-4b69-b428-0d6d445c887c None admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:49.433601 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c8e7f-f35d-4b69-b428-0d6d445c887c None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:49.433876 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c8e7f-f35d-4b69-b428-0d6d445c887c None admin] PATH_INFO: `/v3/services` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:49.434510 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009c8e7f-f35d-4b69-b428-0d6d445c887c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:49.435867 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009c8e7f-f35d-4b69-b428-0d6d445c887c None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:49.453447 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 653/1295] 10.222.0.26 () {60 vars in 1141 bytes} [Mon Sep 19 14:45:49 2022] POST /identity/v3/services => generated 246 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:45:51.626691 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec109e8-2e97-4de6-9663-6e8e459d8ad7 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:51.627284 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec109e8-2e97-4de6-9663-6e8e459d8ad7 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:51.627284 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec109e8-2e97-4de6-9663-6e8e459d8ad7 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:51.628772 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 643/1296] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:45:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:45:51.636534 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7372d0-ceac-443e-89ca-57547ada9508 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:51.637408 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7372d0-ceac-443e-89ca-57547ada9508 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:51.638157 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7372d0-ceac-443e-89ca-57547ada9508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:51.667810 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-0c7372d0-ceac-443e-89ca-57547ada9508 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:45:51.669022 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-0c7372d0-ceac-443e-89ca-57547ada9508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:45:51.754879 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 654/1297] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:45:51 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:45:52.019025 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec109e8-2e97-4de6-9663-6e8e459d8ad7 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:52.130785 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec109e8-2e97-4de6-9663-6e8e459d8ad7 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:52.169595 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aac634-4439-4d99-bf9e-791a04edf316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:52.170208 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aac634-4439-4d99-bf9e-791a04edf316 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:52.170484 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aac634-4439-4d99-bf9e-791a04edf316 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:52.170756 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aac634-4439-4d99-bf9e-791a04edf316 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:52.171338 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aac634-4439-4d99-bf9e-791a04edf316 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:52.172715 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aac634-4439-4d99-bf9e-791a04edf316 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:52.182102 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-63aac634-4439-4d99-bf9e-791a04edf316 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 19 14:45:52.182102 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:45:52.182102 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 14:45:52.182102 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 14:45:52.182102 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 14:45:52.182102 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 14:45:52.182102 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 14:45:52.182102 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:45:52.182102 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 19 14:45:52.182102 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:45:52.182102 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 14:45:52.182102 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:45:52.182102 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:45:52.182102 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:45:52.182102 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:45:52.182102 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:45:52.182102 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:45:52.183256 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:45:52.183256 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:45:52.183256 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:45:52.183256 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:45:52.183256 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:45:52.183256 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:45:52.183256 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 14:45:52.183256 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 14:45:52.183256 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 14:45:52.183256 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 14:45:52.183256 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:45:52.183256 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:45:52.183256 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:45:52.183256 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:45:52.183256 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:45:52.183256 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:45:52.184097 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:45:52.184097 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:45:52.184097 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:45:52.184097 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:45:52.184097 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:45:52.184097 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:45:52.184097 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:45:52.184097 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:45:52.184097 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:45:52.184097 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:45:52.184097 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 14:45:52.184097 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:45:52.184097 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 19 14:45:52.184097 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:45:52.184097 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 644/1298] 10.222.0.26 () {56 vars in 1117 bytes} [Mon Sep 19 14:45:52 2022] GET /identity/v3/services/placement => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:45:52.189679 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7372d0-ceac-443e-89ca-57547ada9508 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:52.210023 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:52.300637 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7372d0-ceac-443e-89ca-57547ada9508 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:52.335279 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0de66c-ae66-4aa5-9ee5-6e26a41b1a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:52.336215 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0de66c-ae66-4aa5-9ee5-6e26a41b1a01 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:52.336480 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0de66c-ae66-4aa5-9ee5-6e26a41b1a01 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:52.336745 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0de66c-ae66-4aa5-9ee5-6e26a41b1a01 None admin] PATH_INFO: `/v3/services` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:52.337393 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0de66c-ae66-4aa5-9ee5-6e26a41b1a01 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:45:52.337682 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0de66c-ae66-4aa5-9ee5-6e26a41b1a01 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:52.339051 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0de66c-ae66-4aa5-9ee5-6e26a41b1a01 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:52.344229 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 655/1299] 10.222.0.26 () {56 vars in 1116 bytes} [Mon Sep 19 14:45:52 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:45:52.353825 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aac634-4439-4d99-bf9e-791a04edf316 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:52.388361 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:52.460820 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aac634-4439-4d99-bf9e-791a04edf316 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:52.501111 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91d9d41-5ba8-4f3d-8f26-677031430d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:52.501707 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91d9d41-5ba8-4f3d-8f26-677031430d27 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:52.501979 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91d9d41-5ba8-4f3d-8f26-677031430d27 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:52.502572 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91d9d41-5ba8-4f3d-8f26-677031430d27 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:52.503267 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91d9d41-5ba8-4f3d-8f26-677031430d27 None admin] RBAC: Adding query filter params (interface=public, service_id=9cafb44f44fb4bcab184d6a5847331d6, region_id=RegionOne) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:45:52.503564 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91d9d41-5ba8-4f3d-8f26-677031430d27 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:52.504931 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91d9d41-5ba8-4f3d-8f26-677031430d27 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:52.510254 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 645/1300] 10.222.0.26 () {56 vars in 1251 bytes} [Mon Sep 19 14:45:52 2022] GET /identity/v3/endpoints?service_id=9cafb44f44fb4bcab184d6a5847331d6&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:45:52.519247 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0de66c-ae66-4aa5-9ee5-6e26a41b1a01 None admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:52.611831 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:52.635902 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0de66c-ae66-4aa5-9ee5-6e26a41b1a01 None admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:52.673299 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccc290d-bcee-48f7-ab7a-a96f8aa4945c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:52.674628 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc290d-bcee-48f7-ab7a-a96f8aa4945c None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:52.674628 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc290d-bcee-48f7-ab7a-a96f8aa4945c None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:52.674628 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc290d-bcee-48f7-ab7a-a96f8aa4945c None admin] PATH_INFO: `/v3/services` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:52.675082 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccc290d-bcee-48f7-ab7a-a96f8aa4945c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:52.676452 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccc290d-bcee-48f7-ab7a-a96f8aa4945c None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:52.683480 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 656/1301] 10.222.0.26 () {56 vars in 1087 bytes} [Mon Sep 19 14:45:52 2022] GET /identity/v3/services => generated 2191 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:45:54.793408 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316f0e8-bfc9-4e7d-bc21-9e4d8e731e60 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:54.794338 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316f0e8-bfc9-4e7d-bc21-9e4d8e731e60 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:54.794338 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316f0e8-bfc9-4e7d-bc21-9e4d8e731e60 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:54.796449 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 646/1302] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:45:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:45:54.802019 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af8e6c-ba8e-46af-bf05-9cb9c75920a6 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:54.802465 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af8e6c-ba8e-46af-bf05-9cb9c75920a6 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:54.802557 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af8e6c-ba8e-46af-bf05-9cb9c75920a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:54.822073 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-c2af8e6c-ba8e-46af-bf05-9cb9c75920a6 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:45:54.823257 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-c2af8e6c-ba8e-46af-bf05-9cb9c75920a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:45:54.891549 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 657/1303] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:45:54 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 14:45:55.152177 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2316f0e8-bfc9-4e7d-bc21-9e4d8e731e60 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:55.260632 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:55.273345 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2316f0e8-bfc9-4e7d-bc21-9e4d8e731e60 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:55.312957 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38080898-22cf-4e1b-aaf8-726c2fa29dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:55.313595 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38080898-22cf-4e1b-aaf8-726c2fa29dcd None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:55.313868 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38080898-22cf-4e1b-aaf8-726c2fa29dcd None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:55.314133 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38080898-22cf-4e1b-aaf8-726c2fa29dcd None admin] PATH_INFO: `/v3/services/placement` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:55.314764 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38080898-22cf-4e1b-aaf8-726c2fa29dcd None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:55.316234 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38080898-22cf-4e1b-aaf8-726c2fa29dcd None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:55.325309 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-38080898-22cf-4e1b-aaf8-726c2fa29dcd None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 19 14:45:55.325309 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:45:55.325309 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 14:45:55.325309 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 14:45:55.325309 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 14:45:55.325309 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 14:45:55.325309 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 14:45:55.325309 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:45:55.325309 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 19 14:45:55.325309 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:45:55.325309 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 14:45:55.325309 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:45:55.325309 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 14:45:55.325309 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 14:45:55.325309 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 14:45:55.325309 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 14:45:55.325309 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 14:45:55.326445 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 14:45:55.326445 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 14:45:55.326445 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 14:45:55.326445 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 14:45:55.326445 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 14:45:55.326445 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 14:45:55.326445 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 14:45:55.326445 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 14:45:55.326445 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 14:45:55.326445 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 14:45:55.326445 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 14:45:55.326445 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 14:45:55.326445 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 14:45:55.326445 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 14:45:55.326445 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 14:45:55.326445 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 14:45:55.327453 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 14:45:55.327453 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 19 14:45:55.327453 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 14:45:55.327453 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 19 14:45:55.327453 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 14:45:55.327453 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 14:45:55.327453 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 14:45:55.327453 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 19 14:45:55.327453 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 14:45:55.327453 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 19 14:45:55.327453 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 14:45:55.327453 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 14:45:55.327453 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 19 14:45:55.327453 dv-cinder-756709-7-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 19 14:45:55.329183 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 647/1304] 10.222.0.26 () {56 vars in 1117 bytes} [Mon Sep 19 14:45:55 2022] GET /identity/v3/services/placement => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 14:45:55.332904 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2af8e6c-ba8e-46af-bf05-9cb9c75920a6 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:55.422186 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:55.447686 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2af8e6c-ba8e-46af-bf05-9cb9c75920a6 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:55.487400 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6adeb9-b384-4224-985a-1f1ba86d0315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:55.488009 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6adeb9-b384-4224-985a-1f1ba86d0315 None admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:55.488283 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6adeb9-b384-4224-985a-1f1ba86d0315 None admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:55.488547 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6adeb9-b384-4224-985a-1f1ba86d0315 None admin] PATH_INFO: `/v3/services` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:55.489210 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6adeb9-b384-4224-985a-1f1ba86d0315 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:45:55.489508 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6adeb9-b384-4224-985a-1f1ba86d0315 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:55.490883 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6adeb9-b384-4224-985a-1f1ba86d0315 None admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:55.496309 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 658/1305] 10.222.0.26 () {56 vars in 1116 bytes} [Mon Sep 19 14:45:55 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:45:55.502487 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38080898-22cf-4e1b-aaf8-726c2fa29dcd None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:45:55.609253 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38080898-22cf-4e1b-aaf8-726c2fa29dcd None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:45:55.646938 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326df8e9-0bd7-44cd-bc38-dede7eee5c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:45:55.647529 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326df8e9-0bd7-44cd-bc38-dede7eee5c48 None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:45:55.647804 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326df8e9-0bd7-44cd-bc38-dede7eee5c48 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:45:55.648072 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326df8e9-0bd7-44cd-bc38-dede7eee5c48 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:45:55.648721 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326df8e9-0bd7-44cd-bc38-dede7eee5c48 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:45:55.650135 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326df8e9-0bd7-44cd-bc38-dede7eee5c48 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:45:55.676396 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 648/1306] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 14:45:55 2022] POST /identity/v3/endpoints => generated 331 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:46:05.493553 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=30 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:46:05.670527 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:00.794038 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc46904-6f9d-4488-80ac-838396e4a825 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:00.794994 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc46904-6f9d-4488-80ac-838396e4a825 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:00.795463 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc46904-6f9d-4488-80ac-838396e4a825 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:00.803683 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a87d22c-6e24-473f-ba86-ec708aab542d None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:00.804629 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a87d22c-6e24-473f-ba86-ec708aab542d None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:00.805155 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a87d22c-6e24-473f-ba86-ec708aab542d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:00.808302 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 659/1307] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:47:00 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:47:00.888086 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-4a87d22c-6e24-473f-ba86-ec708aab542d None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:47:00.889790 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-4a87d22c-6e24-473f-ba86-ec708aab542d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:47:01.003240 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 649/1308] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:47:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 14:47:01.298549 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f6f698-a651-4b28-bc88-7b8c4957ecbf None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:01.298903 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f6f698-a651-4b28-bc88-7b8c4957ecbf None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:01.299096 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f6f698-a651-4b28-bc88-7b8c4957ecbf None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:01.300722 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 660/1309] 10.222.0.26 () {54 vars in 963 bytes} [Mon Sep 19 14:47:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:47:01.307350 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9557916-4ef5-47c1-8299-410f0471624d None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:01.307886 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9557916-4ef5-47c1-8299-410f0471624d None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:01.308230 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9557916-4ef5-47c1-8299-410f0471624d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:01.396568 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-e9557916-4ef5-47c1-8299-410f0471624d None None] MFA Rules not processed for user `d20a0d24e7034b6db447ba842ac986dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:47:01.397841 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e9557916-4ef5-47c1-8299-410f0471624d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:47:01.419985 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:01.482547 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 650/1310] 10.222.0.26 () {58 vars in 1060 bytes} [Mon Sep 19 14:47:01 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:47:01.491718 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f6f698-a651-4b28-bc88-7b8c4957ecbf None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:47:01.493495 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-a2f6f698-a651-4b28-bc88-7b8c4957ecbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:47:01.614331 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f6f698-a651-4b28-bc88-7b8c4957ecbf None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:47:01.697744 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e465fca-a3c0-49b8-abdf-3a524260d344 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:47:01.698457 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e465fca-a3c0-49b8-abdf-3a524260d344 service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:01.698736 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e465fca-a3c0-49b8-abdf-3a524260d344 service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:01.698998 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e465fca-a3c0-49b8-abdf-3a524260d344 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:01.701150 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-5e465fca-a3c0-49b8-abdf-3a524260d344 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:47:01.759883 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:01.819201 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e465fca-a3c0-49b8-abdf-3a524260d344 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:47:01.820645 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e465fca-a3c0-49b8-abdf-3a524260d344 service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:47:01.840898 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 661/1311] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:47:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:47:04.321563 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e6944-aa13-4468-8e4b-296d30224b3b None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:04.322379 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e6944-aa13-4468-8e4b-296d30224b3b None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:04.322379 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e6944-aa13-4468-8e4b-296d30224b3b None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:04.324479 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 651/1312] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:47:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:47:04.330030 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa689ca-7adb-4895-b2dc-8fc7f10b4fb3 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:04.330473 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa689ca-7adb-4895-b2dc-8fc7f10b4fb3 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:04.330566 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa689ca-7adb-4895-b2dc-8fc7f10b4fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:04.418146 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-0fa689ca-7adb-4895-b2dc-8fc7f10b4fb3 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:47:04.419354 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-0fa689ca-7adb-4895-b2dc-8fc7f10b4fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:47:04.540933 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 662/1313] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:47:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:47:04.833730 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83e6944-aa13-4468-8e4b-296d30224b3b None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:47:04.835306 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f83e6944-aa13-4468-8e4b-296d30224b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:47:04.943636 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83e6944-aa13-4468-8e4b-296d30224b3b None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:47:05.020284 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:05.022948 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7163c96b-4e44-49f2-a2c3-4f2a51dfe3ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:47:05.023806 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7163c96b-4e44-49f2-a2c3-4f2a51dfe3ec service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:05.024085 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7163c96b-4e44-49f2-a2c3-4f2a51dfe3ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:05.024365 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7163c96b-4e44-49f2-a2c3-4f2a51dfe3ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:05.026420 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-7163c96b-4e44-49f2-a2c3-4f2a51dfe3ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:47:05.140036 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7163c96b-4e44-49f2-a2c3-4f2a51dfe3ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:47:05.141710 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7163c96b-4e44-49f2-a2c3-4f2a51dfe3ec service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:47:05.161477 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 652/1314] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:47:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:47:07.626607 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4f18ad-a37e-4239-ba57-cc24efb4de3e None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:07.627180 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4f18ad-a37e-4239-ba57-cc24efb4de3e None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:07.627180 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4f18ad-a37e-4239-ba57-cc24efb4de3e None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:07.628469 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 663/1315] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:47:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:47:07.634979 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2df9574-2456-4602-a9a4-01d2f9ec0fa5 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:07.635702 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2df9574-2456-4602-a9a4-01d2f9ec0fa5 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:07.635898 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2df9574-2456-4602-a9a4-01d2f9ec0fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:07.725395 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-c2df9574-2456-4602-a9a4-01d2f9ec0fa5 None None] MFA Rules not processed for user `5238072e01b240dbb2f0ada386bb22c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:47:07.726658 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-c2df9574-2456-4602-a9a4-01d2f9ec0fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:47:07.782673 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:07.829264 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 653/1316] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:47:07 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:47:08.119208 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4f18ad-a37e-4239-ba57-cc24efb4de3e None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:47:08.121723 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-2b4f18ad-a37e-4239-ba57-cc24efb4de3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:47:08.138005 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:08.242059 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4f18ad-a37e-4239-ba57-cc24efb4de3e None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:47:08.325252 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1627c750-7d34-46ae-8c97-d118d909c1f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:47:08.325766 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1627c750-7d34-46ae-8c97-d118d909c1f6 service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:08.326036 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1627c750-7d34-46ae-8c97-d118d909c1f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:08.326301 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1627c750-7d34-46ae-8c97-d118d909c1f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:08.328052 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-1627c750-7d34-46ae-8c97-d118d909c1f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:47:08.395885 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:08.447520 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1627c750-7d34-46ae-8c97-d118d909c1f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:47:08.448953 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1627c750-7d34-46ae-8c97-d118d909c1f6 service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:47:08.469666 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 664/1317] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:47:08 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:47:11.262842 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095652a5-8c22-4d02-929b-57a7f087f0ad None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:11.263474 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095652a5-8c22-4d02-929b-57a7f087f0ad None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:11.263474 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095652a5-8c22-4d02-929b-57a7f087f0ad None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:11.265298 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 654/1318] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:47:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:47:11.271587 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e9043-ff87-4d89-b81f-16d50d7f13c1 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:11.272358 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e9043-ff87-4d89-b81f-16d50d7f13c1 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:11.272507 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e9043-ff87-4d89-b81f-16d50d7f13c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:11.359275 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-db7e9043-ff87-4d89-b81f-16d50d7f13c1 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:47:11.360477 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-db7e9043-ff87-4d89-b81f-16d50d7f13c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:47:11.475949 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 665/1319] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:47:11 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:47:11.795213 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2721beb-af22-4bdb-9766-b98cdc0649fa None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:11.795717 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2721beb-af22-4bdb-9766-b98cdc0649fa None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:11.796207 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2721beb-af22-4bdb-9766-b98cdc0649fa None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:11.797295 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 655/1320] 10.222.0.26 () {54 vars in 963 bytes} [Mon Sep 19 14:47:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:47:11.803168 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801fb1b1-47b0-47d4-ba1e-61c0ba4bd345 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:11.803456 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801fb1b1-47b0-47d4-ba1e-61c0ba4bd345 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:11.803725 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801fb1b1-47b0-47d4-ba1e-61c0ba4bd345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:11.826734 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:11.883579 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-801fb1b1-47b0-47d4-ba1e-61c0ba4bd345 None None] MFA Rules not processed for user `d20a0d24e7034b6db447ba842ac986dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:47:11.885203 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-801fb1b1-47b0-47d4-ba1e-61c0ba4bd345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:47:11.972185 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 666/1321] 10.222.0.26 () {58 vars in 1060 bytes} [Mon Sep 19 14:47:11 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:47:11.981578 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2721beb-af22-4bdb-9766-b98cdc0649fa None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:47:11.983440 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-c2721beb-af22-4bdb-9766-b98cdc0649fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:47:12.095379 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2721beb-af22-4bdb-9766-b98cdc0649fa None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:47:12.188046 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf790b-c99b-4ba8-b5e2-7fb8337a81bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:47:12.188644 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf790b-c99b-4ba8-b5e2-7fb8337a81bf service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:12.188915 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf790b-c99b-4ba8-b5e2-7fb8337a81bf service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:12.189203 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf790b-c99b-4ba8-b5e2-7fb8337a81bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:12.191297 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ffdf790b-c99b-4ba8-b5e2-7fb8337a81bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:47:12.199252 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:12.312170 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdf790b-c99b-4ba8-b5e2-7fb8337a81bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:47:12.313583 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdf790b-c99b-4ba8-b5e2-7fb8337a81bf service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:47:12.333804 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 656/1322] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:47:11 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:47:15.649771 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c4c5b8-1581-4a3b-bcd2-302a9ea6f404 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:15.650376 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c4c5b8-1581-4a3b-bcd2-302a9ea6f404 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:15.650376 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c4c5b8-1581-4a3b-bcd2-302a9ea6f404 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:15.651653 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 667/1323] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:47:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:47:15.658486 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea70af0-9d9e-42db-aba8-972932e2fc3f None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:15.658984 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea70af0-9d9e-42db-aba8-972932e2fc3f None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:15.659076 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea70af0-9d9e-42db-aba8-972932e2fc3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:15.732419 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-2ea70af0-9d9e-42db-aba8-972932e2fc3f None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:47:15.733975 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2ea70af0-9d9e-42db-aba8-972932e2fc3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:47:15.801355 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:15.847473 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 657/1324] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:47:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:47:16.129543 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c4c5b8-1581-4a3b-bcd2-302a9ea6f404 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:47:16.131083 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-a1c4c5b8-1581-4a3b-bcd2-302a9ea6f404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:47:16.240705 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c4c5b8-1581-4a3b-bcd2-302a9ea6f404 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:47:16.253350 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:16.318662 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a76ecc-f380-4697-b8c2-641ed2151c1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:47:16.319264 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a76ecc-f380-4697-b8c2-641ed2151c1e service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:16.319534 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a76ecc-f380-4697-b8c2-641ed2151c1e service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:16.319798 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a76ecc-f380-4697-b8c2-641ed2151c1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:16.321423 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-d5a76ecc-f380-4697-b8c2-641ed2151c1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:47:16.432791 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a76ecc-f380-4697-b8c2-641ed2151c1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:47:16.434286 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a76ecc-f380-4697-b8c2-641ed2151c1e service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:47:16.454393 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 668/1325] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:47:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:47:18.650767 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6776cd45-d524-4ad0-a236-a544ff0d9662 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:18.651637 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6776cd45-d524-4ad0-a236-a544ff0d9662 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:18.651637 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6776cd45-d524-4ad0-a236-a544ff0d9662 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:18.653047 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 658/1326] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:47:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 14:47:18.659852 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d639249b-c3d1-44e8-a80c-e84eb602bc79 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:18.660661 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d639249b-c3d1-44e8-a80c-e84eb602bc79 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:18.660821 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d639249b-c3d1-44e8-a80c-e84eb602bc79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:18.714900 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:18.733776 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-d639249b-c3d1-44e8-a80c-e84eb602bc79 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:47:18.734959 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-d639249b-c3d1-44e8-a80c-e84eb602bc79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:47:18.846884 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 669/1327] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:47:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:47:19.123295 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6776cd45-d524-4ad0-a236-a544ff0d9662 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:47:19.125016 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-6776cd45-d524-4ad0-a236-a544ff0d9662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:47:19.234010 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6776cd45-d524-4ad0-a236-a544ff0d9662 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:47:19.314775 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76df402d-9bf5-4aee-9ba1-e0b35b7271af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:47:19.315385 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df402d-9bf5-4aee-9ba1-e0b35b7271af service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:19.315656 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df402d-9bf5-4aee-9ba1-e0b35b7271af service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:19.315919 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df402d-9bf5-4aee-9ba1-e0b35b7271af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:19.317512 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-76df402d-9bf5-4aee-9ba1-e0b35b7271af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:47:19.335297 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:19.431221 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76df402d-9bf5-4aee-9ba1-e0b35b7271af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:47:19.432661 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76df402d-9bf5-4aee-9ba1-e0b35b7271af service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:47:19.451095 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 659/1328] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:47:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:47:21.699171 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e554c-e75b-4ef1-ab13-a963386b5c8d None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:21.699745 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e554c-e75b-4ef1-ab13-a963386b5c8d None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:21.699745 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e554c-e75b-4ef1-ab13-a963386b5c8d None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:21.701011 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 670/1329] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:47:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:47:21.707430 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a8a69-8e35-4604-87a5-ff5cc24e437b None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:21.708222 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a8a69-8e35-4604-87a5-ff5cc24e437b None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:21.708324 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a8a69-8e35-4604-87a5-ff5cc24e437b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:21.805654 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-f83a8a69-8e35-4604-87a5-ff5cc24e437b None None] MFA Rules not processed for user `5238072e01b240dbb2f0ada386bb22c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:47:21.806908 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f83a8a69-8e35-4604-87a5-ff5cc24e437b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:47:21.880025 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:21.914499 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 660/1330] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:47:21 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:47:22.197756 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7e554c-e75b-4ef1-ab13-a963386b5c8d None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:47:22.199298 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-ea7e554c-e75b-4ef1-ab13-a963386b5c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:47:22.318195 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7e554c-e75b-4ef1-ab13-a963386b5c8d None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:47:22.343533 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:22.411064 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6c221d-6bcd-41ca-87e1-408bb4c8a480 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:47:22.411838 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c221d-6bcd-41ca-87e1-408bb4c8a480 service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:22.412182 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c221d-6bcd-41ca-87e1-408bb4c8a480 service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:22.412518 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c221d-6bcd-41ca-87e1-408bb4c8a480 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:22.414532 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-cf6c221d-6bcd-41ca-87e1-408bb4c8a480 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:47:22.539176 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6c221d-6bcd-41ca-87e1-408bb4c8a480 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:47:22.540611 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6c221d-6bcd-41ca-87e1-408bb4c8a480 service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:47:22.560428 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 671/1331] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:47:22 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:47:24.924445 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c2e884-b22c-4dba-a66a-9f3e4e4bd6f8 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:24.925406 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c2e884-b22c-4dba-a66a-9f3e4e4bd6f8 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:24.925406 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c2e884-b22c-4dba-a66a-9f3e4e4bd6f8 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:24.927535 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 661/1332] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:47:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:47:24.933915 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa11d5-5700-41a0-afa1-b24d96842505 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:24.934645 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa11d5-5700-41a0-afa1-b24d96842505 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:24.934791 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa11d5-5700-41a0-afa1-b24d96842505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:25.004595 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:25.007790 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-f0fa11d5-5700-41a0-afa1-b24d96842505 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:47:25.009579 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-f0fa11d5-5700-41a0-afa1-b24d96842505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:47:25.109640 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 672/1333] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:47:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:47:25.400692 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c2e884-b22c-4dba-a66a-9f3e4e4bd6f8 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:47:25.403125 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-94c2e884-b22c-4dba-a66a-9f3e4e4bd6f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:47:25.533326 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c2e884-b22c-4dba-a66a-9f3e4e4bd6f8 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:47:25.628138 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c9975-052d-4f03-9058-bb740d53e6e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:47:25.628742 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c9975-052d-4f03-9058-bb740d53e6e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:25.629041 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c9975-052d-4f03-9058-bb740d53e6e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:25.629310 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c9975-052d-4f03-9058-bb740d53e6e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:25.630916 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-425c9975-052d-4f03-9058-bb740d53e6e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:47:25.659495 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:25.752669 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425c9975-052d-4f03-9058-bb740d53e6e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:47:25.754147 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425c9975-052d-4f03-9058-bb740d53e6e7 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:47:25.773997 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 662/1334] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:47:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:47:27.999564 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895bcf88-1ae4-4da1-8d50-dbe6326b7048 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:28.000002 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895bcf88-1ae4-4da1-8d50-dbe6326b7048 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:28.000106 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895bcf88-1ae4-4da1-8d50-dbe6326b7048 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:28.001497 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 673/1335] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:47:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:47:28.007852 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbd28aa-df05-4aab-a7df-36e03f6064f9 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:28.008310 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbd28aa-df05-4aab-a7df-36e03f6064f9 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:28.008404 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbd28aa-df05-4aab-a7df-36e03f6064f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:28.086650 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-9fbd28aa-df05-4aab-a7df-36e03f6064f9 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:47:28.087876 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-9fbd28aa-df05-4aab-a7df-36e03f6064f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:47:28.170855 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:28.193635 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 663/1336] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:47:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:47:28.479502 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895bcf88-1ae4-4da1-8d50-dbe6326b7048 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:47:28.481939 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-895bcf88-1ae4-4da1-8d50-dbe6326b7048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:47:28.590811 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895bcf88-1ae4-4da1-8d50-dbe6326b7048 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:47:28.620160 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:28.674031 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c0018c-3a5a-40cd-9fe4-ae17d1189d04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:47:28.674628 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c0018c-3a5a-40cd-9fe4-ae17d1189d04 service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:28.674900 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c0018c-3a5a-40cd-9fe4-ae17d1189d04 service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:28.675165 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c0018c-3a5a-40cd-9fe4-ae17d1189d04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:28.676741 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-78c0018c-3a5a-40cd-9fe4-ae17d1189d04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:47:28.811063 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c0018c-3a5a-40cd-9fe4-ae17d1189d04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:47:28.812331 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c0018c-3a5a-40cd-9fe4-ae17d1189d04 service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:47:28.831911 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 674/1337] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:47:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:47:31.446066 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8e0eb-76dd-4d7a-af2a-40550ffd6101 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:31.446949 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8e0eb-76dd-4d7a-af2a-40550ffd6101 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:31.446949 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8e0eb-76dd-4d7a-af2a-40550ffd6101 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:31.449226 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 664/1338] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:47:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:47:31.454937 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c88ec91-29a3-4048-a0a9-b00f9d39dbd7 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:31.455395 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c88ec91-29a3-4048-a0a9-b00f9d39dbd7 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:31.455498 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c88ec91-29a3-4048-a0a9-b00f9d39dbd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:31.529351 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-7c88ec91-29a3-4048-a0a9-b00f9d39dbd7 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:47:31.530883 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-7c88ec91-29a3-4048-a0a9-b00f9d39dbd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:47:31.539562 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:31.640736 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 675/1339] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:47:31 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:47:31.925212 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e8e0eb-76dd-4d7a-af2a-40550ffd6101 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:47:31.927736 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-70e8e0eb-76dd-4d7a-af2a-40550ffd6101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:47:32.052200 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e8e0eb-76dd-4d7a-af2a-40550ffd6101 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:47:32.134459 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad8656b-ac31-4ec3-bcd1-96b4c9d29928 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:47:32.135074 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad8656b-ac31-4ec3-bcd1-96b4c9d29928 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:32.135354 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad8656b-ac31-4ec3-bcd1-96b4c9d29928 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:32.135624 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad8656b-ac31-4ec3-bcd1-96b4c9d29928 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:32.137276 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-aad8656b-ac31-4ec3-bcd1-96b4c9d29928 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:47:32.176210 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:32.270133 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad8656b-ac31-4ec3-bcd1-96b4c9d29928 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:47:32.271576 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad8656b-ac31-4ec3-bcd1-96b4c9d29928 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:47:32.292903 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 665/1340] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:47:31 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:47:36.462385 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f8baa7-c5d5-4ccf-82a5-f4495363d190 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:36.463175 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f8baa7-c5d5-4ccf-82a5-f4495363d190 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:36.463175 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f8baa7-c5d5-4ccf-82a5-f4495363d190 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:36.464436 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 676/1341] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:47:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:47:36.471093 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd2f684-badb-422b-a635-eec7f11c72a9 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:36.471816 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd2f684-badb-422b-a635-eec7f11c72a9 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:36.471816 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd2f684-badb-422b-a635-eec7f11c72a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:36.547017 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-ebd2f684-badb-422b-a635-eec7f11c72a9 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:47:36.548247 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ebd2f684-badb-422b-a635-eec7f11c72a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:47:36.654044 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:36.666131 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 666/1342] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:47:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:47:36.944736 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f8baa7-c5d5-4ccf-82a5-f4495363d190 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:47:36.946422 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-82f8baa7-c5d5-4ccf-82a5-f4495363d190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:47:37.060315 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f8baa7-c5d5-4ccf-82a5-f4495363d190 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:47:37.107227 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:37.141829 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9ef782-fb92-4cb9-88d5-38c946b1b264 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:47:37.142541 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ef782-fb92-4cb9-88d5-38c946b1b264 service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:37.142822 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ef782-fb92-4cb9-88d5-38c946b1b264 service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:37.143083 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ef782-fb92-4cb9-88d5-38c946b1b264 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:37.144777 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-1e9ef782-fb92-4cb9-88d5-38c946b1b264 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:47:37.257541 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9ef782-fb92-4cb9-88d5-38c946b1b264 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:47:37.259293 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9ef782-fb92-4cb9-88d5-38c946b1b264 service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:47:37.278375 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 677/1343] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:47:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:47:40.044144 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d7e7c-e2e6-43a5-9dd8-8cdb78d9cc70 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:40.044603 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d7e7c-e2e6-43a5-9dd8-8cdb78d9cc70 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:40.044697 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d7e7c-e2e6-43a5-9dd8-8cdb78d9cc70 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:40.046281 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 667/1344] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:47:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:47:40.051612 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3120f86-6761-4b89-8988-5a71a3bae9f5 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:40.052125 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3120f86-6761-4b89-8988-5a71a3bae9f5 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:40.052125 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3120f86-6761-4b89-8988-5a71a3bae9f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:40.121633 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-a3120f86-6761-4b89-8988-5a71a3bae9f5 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:47:40.122867 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-a3120f86-6761-4b89-8988-5a71a3bae9f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:47:40.141423 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:40.224544 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 678/1345] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:47:40 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:47:40.511588 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902d7e7c-e2e6-43a5-9dd8-8cdb78d9cc70 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:47:40.514065 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-902d7e7c-e2e6-43a5-9dd8-8cdb78d9cc70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:47:40.637871 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902d7e7c-e2e6-43a5-9dd8-8cdb78d9cc70 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:47:40.718867 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1c3063-f390-4984-bc15-079074f5bc04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:47:40.719547 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c3063-f390-4984-bc15-079074f5bc04 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:40.719829 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c3063-f390-4984-bc15-079074f5bc04 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:40.720095 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c3063-f390-4984-bc15-079074f5bc04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:40.721747 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ab1c3063-f390-4984-bc15-079074f5bc04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:47:40.768006 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:40.845428 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1c3063-f390-4984-bc15-079074f5bc04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:47:40.846890 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1c3063-f390-4984-bc15-079074f5bc04 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:47:40.867051 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 668/1346] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:47:40 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:47:45.380884 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fc8df7-3f02-4fe4-9d6d-80a2bf9001c9 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:45.381470 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fc8df7-3f02-4fe4-9d6d-80a2bf9001c9 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:45.381470 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fc8df7-3f02-4fe4-9d6d-80a2bf9001c9 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:45.382807 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 679/1347] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:47:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:47:45.388221 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf02b2-9a90-441a-a333-6e6792f73a02 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:45.388678 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf02b2-9a90-441a-a333-6e6792f73a02 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:45.388860 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf02b2-9a90-441a-a333-6e6792f73a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:45.457466 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-f5bf02b2-9a90-441a-a333-6e6792f73a02 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:47:45.458994 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f5bf02b2-9a90-441a-a333-6e6792f73a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:47:45.564355 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:45.566760 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 669/1348] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:47:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:47:45.864552 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fc8df7-3f02-4fe4-9d6d-80a2bf9001c9 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:47:45.866124 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-57fc8df7-3f02-4fe4-9d6d-80a2bf9001c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:47:45.982318 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fc8df7-3f02-4fe4-9d6d-80a2bf9001c9 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:47:46.044686 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:46.075215 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ae48cf-b183-4950-87b5-c90afc9a5fe4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:47:46.075837 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae48cf-b183-4950-87b5-c90afc9a5fe4 service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:46.076112 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae48cf-b183-4950-87b5-c90afc9a5fe4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:46.076521 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae48cf-b183-4950-87b5-c90afc9a5fe4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:46.078124 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-d6ae48cf-b183-4950-87b5-c90afc9a5fe4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:47:46.193517 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ae48cf-b183-4950-87b5-c90afc9a5fe4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:47:46.194963 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ae48cf-b183-4950-87b5-c90afc9a5fe4 service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:47:46.215795 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 680/1349] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:47:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:47:51.173533 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946d517e-a6fd-4406-8b25-e42e20f7b1c7 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:51.174085 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946d517e-a6fd-4406-8b25-e42e20f7b1c7 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:51.174085 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946d517e-a6fd-4406-8b25-e42e20f7b1c7 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:51.175714 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 670/1350] 10.222.0.26 () {54 vars in 921 bytes} [Mon Sep 19 14:47:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:47:51.181255 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a5d11-c781-452d-82c0-b22c6a9e22da None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:51.181728 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a5d11-c781-452d-82c0-b22c6a9e22da None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:51.181728 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a5d11-c781-452d-82c0-b22c6a9e22da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:51.320265 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-bf0a5d11-c781-452d-82c0-b22c6a9e22da None None] MFA Rules not processed for user `da0a58c526f34afda909e4ede2b1e1c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:47:51.321463 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-bf0a5d11-c781-452d-82c0-b22c6a9e22da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:47:51.348914 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:51.450502 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 681/1351] 10.222.0.26 () {58 vars in 1018 bytes} [Mon Sep 19 14:47:51 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:47:55.761593 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fbc78b-1b3c-4180-a8d8-be435e1c187e None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:55.762146 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fbc78b-1b3c-4180-a8d8-be435e1c187e None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:55.762146 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fbc78b-1b3c-4180-a8d8-be435e1c187e None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:55.763560 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 671/1352] 10.222.0.26 () {54 vars in 921 bytes} [Mon Sep 19 14:47:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:47:55.768403 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ba6a5-ac6a-4775-8f94-e8e5f2650a40 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:55.768820 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ba6a5-ac6a-4775-8f94-e8e5f2650a40 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:55.768926 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ba6a5-ac6a-4775-8f94-e8e5f2650a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:55.856722 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-e23ba6a5-ac6a-4775-8f94-e8e5f2650a40 None None] MFA Rules not processed for user `da0a58c526f34afda909e4ede2b1e1c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:47:55.858233 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-e23ba6a5-ac6a-4775-8f94-e8e5f2650a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:47:55.939764 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:55.981041 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 682/1353] 10.222.0.26 () {58 vars in 1018 bytes} [Mon Sep 19 14:47:55 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:47:57.155028 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8800306a-9767-424b-8bd8-4f666c226f35 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:57.155901 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8800306a-9767-424b-8bd8-4f666c226f35 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:57.156158 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8800306a-9767-424b-8bd8-4f666c226f35 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:57.157583 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 672/1354] 10.222.0.26 () {54 vars in 921 bytes} [Mon Sep 19 14:47:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:47:57.163011 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034e000-1928-4d53-9c51-15559caf6df5 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:47:57.163451 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034e000-1928-4d53-9c51-15559caf6df5 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:47:57.163552 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034e000-1928-4d53-9c51-15559caf6df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:47:57.256299 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-6034e000-1928-4d53-9c51-15559caf6df5 None None] MFA Rules not processed for user `da0a58c526f34afda909e4ede2b1e1c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:47:57.257692 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-6034e000-1928-4d53-9c51-15559caf6df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:47:57.372541 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 683/1355] 10.222.0.26 () {58 vars in 1018 bytes} [Mon Sep 19 14:47:57 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:48:00.942619 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e148f7a9-521a-4fec-918a-b48d82d4be0c None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:00.943629 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e148f7a9-521a-4fec-918a-b48d82d4be0c None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:00.944115 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e148f7a9-521a-4fec-918a-b48d82d4be0c None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:00.947282 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 673/1356] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:48:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:48:00.953858 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67399821-eeae-44f2-9f61-2225e3b976be None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:00.954804 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67399821-eeae-44f2-9f61-2225e3b976be None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:00.955341 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67399821-eeae-44f2-9f61-2225e3b976be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:01.001817 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:01.038003 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-67399821-eeae-44f2-9f61-2225e3b976be None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:48:01.039119 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-67399821-eeae-44f2-9f61-2225e3b976be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:48:01.149210 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 684/1357] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:48:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:48:01.455471 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461ab718-dc02-4914-8278-68b5967fce53 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:01.456192 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461ab718-dc02-4914-8278-68b5967fce53 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:01.456711 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461ab718-dc02-4914-8278-68b5967fce53 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:01.459329 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 674/1358] 10.222.0.26 () {54 vars in 965 bytes} [Mon Sep 19 14:48:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:48:01.469591 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c52bd3-d37f-4b83-b9ac-78ec04935e96 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:01.470159 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c52bd3-d37f-4b83-b9ac-78ec04935e96 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:01.470638 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c52bd3-d37f-4b83-b9ac-78ec04935e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:01.583772 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-40c52bd3-d37f-4b83-b9ac-78ec04935e96 None None] MFA Rules not processed for user `3017e5d92bef4cc2aeae4f28c78ba233`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:48:01.584979 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-40c52bd3-d37f-4b83-b9ac-78ec04935e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:48:01.639017 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:01.715259 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 685/1359] 10.222.0.26 () {58 vars in 1062 bytes} [Mon Sep 19 14:48:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:48:01.724108 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461ab718-dc02-4914-8278-68b5967fce53 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:48:01.725717 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-461ab718-dc02-4914-8278-68b5967fce53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:48:01.884613 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461ab718-dc02-4914-8278-68b5967fce53 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:48:01.964627 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:02.015164 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4eb6e1-4003-444d-b579-d311cc7dbfdd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3017e5d92bef4cc2aeae4f28c78ba233', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:48:02.015791 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4eb6e1-4003-444d-b579-d311cc7dbfdd service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:02.016063 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4eb6e1-4003-444d-b579-d311cc7dbfdd service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:02.016331 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4eb6e1-4003-444d-b579-d311cc7dbfdd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:02.018071 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-9c4eb6e1-4003-444d-b579-d311cc7dbfdd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:48:02.127773 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4eb6e1-4003-444d-b579-d311cc7dbfdd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:48:02.129454 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4eb6e1-4003-444d-b579-d311cc7dbfdd service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:48:02.148564 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 675/1360] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:48:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 14:48:04.575320 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3315d055-6b9d-4460-9df6-3d598eca382c None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:04.576182 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3315d055-6b9d-4460-9df6-3d598eca382c None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:04.576531 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3315d055-6b9d-4460-9df6-3d598eca382c None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:04.578115 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 686/1361] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:48:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:48:04.584079 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf24020-3533-410f-958e-23895047a1bd None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:04.584889 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf24020-3533-410f-958e-23895047a1bd None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:04.585419 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf24020-3533-410f-958e-23895047a1bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:04.655489 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-bdf24020-3533-410f-958e-23895047a1bd None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:48:04.656548 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-bdf24020-3533-410f-958e-23895047a1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:48:04.697422 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:04.761499 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 676/1362] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:48:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:48:05.051785 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3315d055-6b9d-4460-9df6-3d598eca382c None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:48:05.053359 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-3315d055-6b9d-4460-9df6-3d598eca382c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:48:05.258572 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3315d055-6b9d-4460-9df6-3d598eca382c None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:48:05.268485 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:05.378121 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a740f8d-440a-462a-b7c3-a36114ddf751 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3017e5d92bef4cc2aeae4f28c78ba233', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:48:05.378652 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a740f8d-440a-462a-b7c3-a36114ddf751 service nova] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:05.378932 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a740f8d-440a-462a-b7c3-a36114ddf751 service nova] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:05.379201 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a740f8d-440a-462a-b7c3-a36114ddf751 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:05.380955 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-2a740f8d-440a-462a-b7c3-a36114ddf751 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:48:05.475026 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a740f8d-440a-462a-b7c3-a36114ddf751 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:48:05.476634 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a740f8d-440a-462a-b7c3-a36114ddf751 service nova] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:48:05.496442 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 687/1363] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:48:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:48:07.973487 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e3c82-01b9-4505-b18d-0faa410cadcf None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:07.974053 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e3c82-01b9-4505-b18d-0faa410cadcf None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:07.974053 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e3c82-01b9-4505-b18d-0faa410cadcf None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:07.975629 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 677/1364] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:48:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:48:07.981339 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0793495f-a94d-4f22-bd7e-6b17de857839 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:07.982158 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0793495f-a94d-4f22-bd7e-6b17de857839 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:07.982432 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0793495f-a94d-4f22-bd7e-6b17de857839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:08.006043 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:08.072641 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-0793495f-a94d-4f22-bd7e-6b17de857839 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:48:08.073896 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-0793495f-a94d-4f22-bd7e-6b17de857839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:48:08.181277 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 688/1365] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:48:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:48:08.482023 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da92fb-4221-435e-9296-a2b007f6eb86 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:08.482428 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da92fb-4221-435e-9296-a2b007f6eb86 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:08.482914 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da92fb-4221-435e-9296-a2b007f6eb86 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:08.484501 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 678/1366] 10.222.0.26 () {54 vars in 965 bytes} [Mon Sep 19 14:48:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:48:08.489819 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b053ba6a-e4ee-4cee-adcd-0f00e6457814 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:08.490068 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b053ba6a-e4ee-4cee-adcd-0f00e6457814 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:08.490341 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b053ba6a-e4ee-4cee-adcd-0f00e6457814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:08.577605 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-b053ba6a-e4ee-4cee-adcd-0f00e6457814 None None] MFA Rules not processed for user `3017e5d92bef4cc2aeae4f28c78ba233`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:48:08.578840 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-b053ba6a-e4ee-4cee-adcd-0f00e6457814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:48:08.618244 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:08.712773 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 689/1367] 10.222.0.26 () {58 vars in 1062 bytes} [Mon Sep 19 14:48:08 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:48:08.721562 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20da92fb-4221-435e-9296-a2b007f6eb86 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:48:08.722996 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-20da92fb-4221-435e-9296-a2b007f6eb86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:48:08.885143 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20da92fb-4221-435e-9296-a2b007f6eb86 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:48:08.914512 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:09.042509 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ada05ce-19a4-46f1-aded-3935cfe30ab5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3017e5d92bef4cc2aeae4f28c78ba233', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:48:09.043243 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ada05ce-19a4-46f1-aded-3935cfe30ab5 service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:09.043631 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ada05ce-19a4-46f1-aded-3935cfe30ab5 service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:09.043889 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ada05ce-19a4-46f1-aded-3935cfe30ab5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:09.045772 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb0908-18ed-4e9f-b3de-fe4c9a670ea5 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:09.046214 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-1ada05ce-19a4-46f1-aded-3935cfe30ab5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:48:09.046912 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb0908-18ed-4e9f-b3de-fe4c9a670ea5 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:09.047374 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb0908-18ed-4e9f-b3de-fe4c9a670ea5 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:09.050009 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 690/1368] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:48:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:48:09.058383 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ada9128-d435-423a-bac4-b80c07843913 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:09.058661 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ada9128-d435-423a-bac4-b80c07843913 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:09.058929 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ada9128-d435-423a-bac4-b80c07843913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:09.134095 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-6ada9128-d435-423a-bac4-b80c07843913 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:48:09.135615 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-6ada9128-d435-423a-bac4-b80c07843913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:48:09.149577 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ada05ce-19a4-46f1-aded-3935cfe30ab5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:48:09.151295 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ada05ce-19a4-46f1-aded-3935cfe30ab5 service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:48:09.173836 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 679/1369] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:48:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:48:09.249424 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:09.258844 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 691/1370] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:48:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:48:09.605305 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace0a3cd-a748-4cf4-98d0-3afe9afa1747 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:09.605707 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace0a3cd-a748-4cf4-98d0-3afe9afa1747 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:09.606603 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace0a3cd-a748-4cf4-98d0-3afe9afa1747 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:09.611447 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 680/1371] 10.222.0.26 () {54 vars in 962 bytes} [Mon Sep 19 14:48:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:48:09.613494 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d1775-6e9e-4c87-a299-43f2fc156238 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:09.613847 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d1775-6e9e-4c87-a299-43f2fc156238 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:09.614123 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d1775-6e9e-4c87-a299-43f2fc156238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:09.699961 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-5a6d1775-6e9e-4c87-a299-43f2fc156238 None None] MFA Rules not processed for user `df648c909ddb41418128b43f925f5ed4`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:48:09.701213 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-5a6d1775-6e9e-4c87-a299-43f2fc156238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:48:09.787083 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 692/1372] 10.222.0.26 () {58 vars in 1059 bytes} [Mon Sep 19 14:48:09 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:48:09.794878 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace0a3cd-a748-4cf4-98d0-3afe9afa1747 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:48:09.796501 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ace0a3cd-a748-4cf4-98d0-3afe9afa1747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:48:09.828593 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:09.910108 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace0a3cd-a748-4cf4-98d0-3afe9afa1747 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:48:09.993294 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680f94a4-1990-484f-a90b-0df915391fee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df648c909ddb41418128b43f925f5ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:48:10.002482 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680f94a4-1990-484f-a90b-0df915391fee service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:10.002968 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680f94a4-1990-484f-a90b-0df915391fee service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:10.003705 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680f94a4-1990-484f-a90b-0df915391fee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:10.007462 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-680f94a4-1990-484f-a90b-0df915391fee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:48:10.114558 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:10.153020 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680f94a4-1990-484f-a90b-0df915391fee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:48:10.154754 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680f94a4-1990-484f-a90b-0df915391fee service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:48:10.181381 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 681/1373] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:48:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:48:11.502273 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e80de-b1ef-4b41-b15b-b56f48a4e2e8 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:11.502766 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e80de-b1ef-4b41-b15b-b56f48a4e2e8 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:11.502964 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e80de-b1ef-4b41-b15b-b56f48a4e2e8 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:11.504238 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 693/1374] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:48:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:48:11.510616 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5bf669-39ef-4c94-82ff-fcdc57cc459d None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:11.511137 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5bf669-39ef-4c94-82ff-fcdc57cc459d None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:11.511137 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5bf669-39ef-4c94-82ff-fcdc57cc459d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:11.583341 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-ae5bf669-39ef-4c94-82ff-fcdc57cc459d None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:48:11.585023 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ae5bf669-39ef-4c94-82ff-fcdc57cc459d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:48:11.694801 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 682/1375] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:48:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:48:11.983949 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9e80de-b1ef-4b41-b15b-b56f48a4e2e8 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:48:11.985598 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-cc9e80de-b1ef-4b41-b15b-b56f48a4e2e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:48:12.082969 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:12.149537 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9e80de-b1ef-4b41-b15b-b56f48a4e2e8 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:48:12.269475 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30484be4-f12d-4c26-9c40-e702f7267e09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3017e5d92bef4cc2aeae4f28c78ba233', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:48:12.270092 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30484be4-f12d-4c26-9c40-e702f7267e09 service nova] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:12.270367 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30484be4-f12d-4c26-9c40-e702f7267e09 service nova] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:12.270630 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30484be4-f12d-4c26-9c40-e702f7267e09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:12.272213 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-30484be4-f12d-4c26-9c40-e702f7267e09 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:48:12.326532 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:12.371988 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30484be4-f12d-4c26-9c40-e702f7267e09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:48:12.373887 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30484be4-f12d-4c26-9c40-e702f7267e09 service nova] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:48:12.396946 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 694/1376] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:48:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 14:48:14.628448 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1410094-edd4-458c-98aa-c741b4a213ac None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:14.629392 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1410094-edd4-458c-98aa-c741b4a213ac None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:14.629750 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1410094-edd4-458c-98aa-c741b4a213ac None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:14.631304 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 683/1377] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:48:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:48:14.637406 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69d3ed5-7dc8-4027-a0ca-193ef9a66e5d None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:14.637914 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69d3ed5-7dc8-4027-a0ca-193ef9a66e5d None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:14.638002 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69d3ed5-7dc8-4027-a0ca-193ef9a66e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:14.727562 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-c69d3ed5-7dc8-4027-a0ca-193ef9a66e5d None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:48:14.728785 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-c69d3ed5-7dc8-4027-a0ca-193ef9a66e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:48:14.847891 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 695/1378] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:48:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:48:15.158216 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1410094-edd4-458c-98aa-c741b4a213ac None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:48:15.159728 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e1410094-edd4-458c-98aa-c741b4a213ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:48:15.201697 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:15.354289 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1410094-edd4-458c-98aa-c741b4a213ac None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:48:15.511483 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:15.524511 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de87052-1fcd-4db1-b452-884cb33aab6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3017e5d92bef4cc2aeae4f28c78ba233', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:48:15.525128 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de87052-1fcd-4db1-b452-884cb33aab6e service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:15.525757 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de87052-1fcd-4db1-b452-884cb33aab6e service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:15.525757 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de87052-1fcd-4db1-b452-884cb33aab6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:15.527595 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2de87052-1fcd-4db1-b452-884cb33aab6e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:48:15.634459 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de87052-1fcd-4db1-b452-884cb33aab6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:48:15.636095 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de87052-1fcd-4db1-b452-884cb33aab6e service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:48:15.657792 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 684/1379] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:48:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:48:17.899238 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d19bc9-beec-4ddc-97ba-b7dfdb85066f None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:17.899790 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d19bc9-beec-4ddc-97ba-b7dfdb85066f None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:17.899790 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d19bc9-beec-4ddc-97ba-b7dfdb85066f None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:17.901186 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 696/1380] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:48:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:48:17.906905 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcb8efb-92ec-475e-bf1a-b1c0278d1665 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:17.907433 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcb8efb-92ec-475e-bf1a-b1c0278d1665 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:17.907433 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcb8efb-92ec-475e-bf1a-b1c0278d1665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:17.977482 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-5bcb8efb-92ec-475e-bf1a-b1c0278d1665 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:48:17.978952 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-5bcb8efb-92ec-475e-bf1a-b1c0278d1665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:48:18.050488 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:18.085794 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 685/1381] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:48:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:48:18.453214 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d19bc9-beec-4ddc-97ba-b7dfdb85066f None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:48:18.455282 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-06d19bc9-beec-4ddc-97ba-b7dfdb85066f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:48:18.492144 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:18.627087 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d19bc9-beec-4ddc-97ba-b7dfdb85066f None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:48:18.762538 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:18.781809 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cd8afd-1327-4e82-b673-40a20eb7635a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3017e5d92bef4cc2aeae4f28c78ba233', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:48:18.782415 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cd8afd-1327-4e82-b673-40a20eb7635a service nova] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:18.782727 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cd8afd-1327-4e82-b673-40a20eb7635a service nova] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:18.782957 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cd8afd-1327-4e82-b673-40a20eb7635a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:18.784552 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-c9cd8afd-1327-4e82-b673-40a20eb7635a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:48:18.881429 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cd8afd-1327-4e82-b673-40a20eb7635a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:48:18.883052 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cd8afd-1327-4e82-b673-40a20eb7635a service nova] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:48:18.902841 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 697/1382] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:48:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:48:21.127909 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd1fc76-0287-4c63-bece-155ea313c266 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:21.128576 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd1fc76-0287-4c63-bece-155ea313c266 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:21.128576 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd1fc76-0287-4c63-bece-155ea313c266 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:21.129777 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 686/1383] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:48:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:48:21.136304 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc7a70-23a1-4a27-a209-e80305fc5501 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:21.136863 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc7a70-23a1-4a27-a209-e80305fc5501 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:21.136863 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc7a70-23a1-4a27-a209-e80305fc5501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:21.208397 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-d9dc7a70-23a1-4a27-a209-e80305fc5501 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:48:21.209959 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-d9dc7a70-23a1-4a27-a209-e80305fc5501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:48:21.269293 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:21.312045 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 698/1384] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:48:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:48:21.611809 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd1fc76-0287-4c63-bece-155ea313c266 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:48:21.613494 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-efd1fc76-0287-4c63-bece-155ea313c266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:48:21.775275 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd1fc76-0287-4c63-bece-155ea313c266 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:48:21.839045 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:21.905767 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9c5b88-0152-4e5f-967b-514155b222eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3017e5d92bef4cc2aeae4f28c78ba233', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:48:21.906628 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9c5b88-0152-4e5f-967b-514155b222eb service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:21.907017 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9c5b88-0152-4e5f-967b-514155b222eb service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:21.907363 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9c5b88-0152-4e5f-967b-514155b222eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:21.909614 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-6e9c5b88-0152-4e5f-967b-514155b222eb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:48:22.007923 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9c5b88-0152-4e5f-967b-514155b222eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:48:22.009612 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9c5b88-0152-4e5f-967b-514155b222eb service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:48:22.027808 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 687/1385] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:48:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:48:24.220044 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1268d5-ee2a-4544-b049-35d6d54ecceb None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:24.220612 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1268d5-ee2a-4544-b049-35d6d54ecceb None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:24.220612 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1268d5-ee2a-4544-b049-35d6d54ecceb None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:24.225627 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 699/1386] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:48:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:48:24.231128 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ea1c2-8ef9-4550-bcd9-2e9e9a145767 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:24.231586 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ea1c2-8ef9-4550-bcd9-2e9e9a145767 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:24.231700 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ea1c2-8ef9-4550-bcd9-2e9e9a145767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:24.304676 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-0e5ea1c2-8ef9-4550-bcd9-2e9e9a145767 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:48:24.305839 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-0e5ea1c2-8ef9-4550-bcd9-2e9e9a145767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:48:24.316800 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:24.420499 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 688/1387] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:48:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:48:24.724133 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1268d5-ee2a-4544-b049-35d6d54ecceb None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:48:24.725694 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-db1268d5-ee2a-4544-b049-35d6d54ecceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:48:24.878207 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1268d5-ee2a-4544-b049-35d6d54ecceb None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:48:24.926549 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:25.010104 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb84cb0d-eb7d-404c-be95-bc1db61aa0bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3017e5d92bef4cc2aeae4f28c78ba233', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:48:25.010720 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb84cb0d-eb7d-404c-be95-bc1db61aa0bd service nova] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:25.010997 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb84cb0d-eb7d-404c-be95-bc1db61aa0bd service nova] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:25.011267 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb84cb0d-eb7d-404c-be95-bc1db61aa0bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:25.012898 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-cb84cb0d-eb7d-404c-be95-bc1db61aa0bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:48:25.107906 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb84cb0d-eb7d-404c-be95-bc1db61aa0bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:48:25.109684 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb84cb0d-eb7d-404c-be95-bc1db61aa0bd service nova] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:48:25.127946 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 700/1388] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:48:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:48:25.667810 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9975cb-7403-491e-bce6-c0d12ad0bc94 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:25.668349 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9975cb-7403-491e-bce6-c0d12ad0bc94 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:25.668349 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9975cb-7403-491e-bce6-c0d12ad0bc94 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:25.669744 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 689/1389] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:48:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 14:48:25.675626 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d353f-0efc-4c74-baa8-4ab17bcb63b6 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:25.676086 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d353f-0efc-4c74-baa8-4ab17bcb63b6 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:25.676199 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d353f-0efc-4c74-baa8-4ab17bcb63b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:25.744768 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:25.748042 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-6c4d353f-0efc-4c74-baa8-4ab17bcb63b6 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:48:25.749417 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-6c4d353f-0efc-4c74-baa8-4ab17bcb63b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:48:25.860337 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 701/1390] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:48:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:48:26.159854 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea2e71-15da-490d-9cfd-6f50339e4b42 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:26.160236 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea2e71-15da-490d-9cfd-6f50339e4b42 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:26.160558 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea2e71-15da-490d-9cfd-6f50339e4b42 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:26.161964 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 690/1391] 10.222.0.26 () {54 vars in 962 bytes} [Mon Sep 19 14:48:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:48:26.167417 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb712b9-d943-4ae5-b8ab-a3b677c16efb None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:26.167790 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb712b9-d943-4ae5-b8ab-a3b677c16efb None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:26.168141 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb712b9-d943-4ae5-b8ab-a3b677c16efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:26.250492 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-feb712b9-d943-4ae5-b8ab-a3b677c16efb None None] MFA Rules not processed for user `f5d4e9c3da83402dbe7938aaf2dcbb8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:48:26.251612 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-feb712b9-d943-4ae5-b8ab-a3b677c16efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:48:26.323573 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:26.330505 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 702/1392] 10.222.0.26 () {58 vars in 1059 bytes} [Mon Sep 19 14:48:26 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:48:26.339569 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fea2e71-15da-490d-9cfd-6f50339e4b42 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:48:26.341126 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-0fea2e71-15da-490d-9cfd-6f50339e4b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:48:26.459897 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fea2e71-15da-490d-9cfd-6f50339e4b42 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:48:26.499564 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:26.540626 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcecf6f-9b72-4e7f-afdd-16c51c7720cb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d4e9c3da83402dbe7938aaf2dcbb8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:48:26.541194 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcecf6f-9b72-4e7f-afdd-16c51c7720cb service glance] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:26.541479 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcecf6f-9b72-4e7f-afdd-16c51c7720cb service glance] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:26.541751 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcecf6f-9b72-4e7f-afdd-16c51c7720cb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:26.543358 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-3fcecf6f-9b72-4e7f-afdd-16c51c7720cb service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:48:26.654695 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcecf6f-9b72-4e7f-afdd-16c51c7720cb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:48:26.656164 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcecf6f-9b72-4e7f-afdd-16c51c7720cb service glance] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:48:26.674541 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 691/1393] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:48:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:48:27.341254 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b84433-3281-4ba7-a774-cd8bf65bf82c None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:27.341806 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b84433-3281-4ba7-a774-cd8bf65bf82c None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:27.341806 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b84433-3281-4ba7-a774-cd8bf65bf82c None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:27.343242 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 703/1394] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:48:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:48:27.348888 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b0ad2-3d3b-4d68-85b8-ac8218580210 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:27.349218 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b0ad2-3d3b-4d68-85b8-ac8218580210 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:27.349484 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b0ad2-3d3b-4d68-85b8-ac8218580210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:27.425912 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-326b0ad2-3d3b-4d68-85b8-ac8218580210 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:48:27.427253 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-326b0ad2-3d3b-4d68-85b8-ac8218580210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:48:27.448259 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:27.452617 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f3d14a-9f98-4253-86b4-0c958f88dc1a None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:27.453004 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f3d14a-9f98-4253-86b4-0c958f88dc1a None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:27.453357 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f3d14a-9f98-4253-86b4-0c958f88dc1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:27.524589 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-e7f3d14a-9f98-4253-86b4-0c958f88dc1a None None] MFA Rules not processed for user `2c2b1ac1a17c43d28da8f7e9a199dea4`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:48:27.525886 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-e7f3d14a-9f98-4253-86b4-0c958f88dc1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:48:27.532719 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 692/1395] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:48:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:48:27.617654 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 704/1396] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Sep 19 14:48:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:48:27.663540 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fce789a-c8ed-4ddb-98fa-ef3f266f55ad None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:27.663841 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fce789a-c8ed-4ddb-98fa-ef3f266f55ad None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:27.664197 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fce789a-c8ed-4ddb-98fa-ef3f266f55ad None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:27.665762 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 693/1397] 10.222.0.26 () {54 vars in 943 bytes} [Mon Sep 19 14:48:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:48:27.672470 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9432ff-1ca2-463e-b284-acd169714cd8 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:27.672744 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9432ff-1ca2-463e-b284-acd169714cd8 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:27.673039 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9432ff-1ca2-463e-b284-acd169714cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:27.754633 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-cd9432ff-1ca2-463e-b284-acd169714cd8 None None] MFA Rules not processed for user `76cb60a5e90343e69a38db4356cb3a90`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:48:27.755873 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-cd9432ff-1ca2-463e-b284-acd169714cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:48:27.785203 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:27.823533 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fce789a-c8ed-4ddb-98fa-ef3f266f55ad None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:48:27.825358 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-5fce789a-c8ed-4ddb-98fa-ef3f266f55ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:48:27.867832 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 705/1398] 10.222.0.26 () {58 vars in 1040 bytes} [Mon Sep 19 14:48:27 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:48:27.877587 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9432ff-1ca2-463e-b284-acd169714cd8 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:48:27.886877 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9432ff-1ca2-463e-b284-acd169714cd8 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:48:27.981823 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fce789a-c8ed-4ddb-98fa-ef3f266f55ad None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:48:27.989656 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:28.000014 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f9311c-25c8-4531-9b8f-141414c83d8d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cb60a5e90343e69a38db4356cb3a90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:48:28.000171 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f9311c-25c8-4531-9b8f-141414c83d8d service swift] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:28.000442 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f9311c-25c8-4531-9b8f-141414c83d8d service swift] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:28.000706 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f9311c-25c8-4531-9b8f-141414c83d8d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:28.002418 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-73f9311c-25c8-4531-9b8f-141414c83d8d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:48:28.036675 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:28.089711 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f9311c-25c8-4531-9b8f-141414c83d8d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:48:28.091321 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f9311c-25c8-4531-9b8f-141414c83d8d service swift] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:48:28.100340 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 706/1399] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Sep 19 14:48:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 19 14:48:28.102920 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba855e0-d865-4daa-8f99-605e3afdec34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3017e5d92bef4cc2aeae4f28c78ba233', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:48:28.103525 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba855e0-d865-4daa-8f99-605e3afdec34 service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:28.103802 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba855e0-d865-4daa-8f99-605e3afdec34 service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:28.104066 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba855e0-d865-4daa-8f99-605e3afdec34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:28.105713 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-4ba855e0-d865-4daa-8f99-605e3afdec34 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:48:28.232268 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba855e0-d865-4daa-8f99-605e3afdec34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:48:28.234542 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba855e0-d865-4daa-8f99-605e3afdec34 service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:48:28.253603 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 694/1400] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:48:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 14:48:30.470200 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f439d027-3f36-40fe-bae8-79dfe9481f16 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:30.472502 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f439d027-3f36-40fe-bae8-79dfe9481f16 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:30.473053 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f439d027-3f36-40fe-bae8-79dfe9481f16 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:30.474646 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 707/1401] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:48:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 14:48:30.480295 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21685e9-9a19-46f4-bdcb-16750f3a3162 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:30.480720 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21685e9-9a19-46f4-bdcb-16750f3a3162 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:30.480909 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21685e9-9a19-46f4-bdcb-16750f3a3162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:30.490964 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:30.607139 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-e21685e9-9a19-46f4-bdcb-16750f3a3162 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:48:30.608724 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e21685e9-9a19-46f4-bdcb-16750f3a3162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:48:30.720918 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 695/1402] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:48:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:48:31.015062 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f439d027-3f36-40fe-bae8-79dfe9481f16 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:48:31.016596 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-f439d027-3f36-40fe-bae8-79dfe9481f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:48:31.192521 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f439d027-3f36-40fe-bae8-79dfe9481f16 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:48:31.220952 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:31.323299 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b01de4-63f5-42b5-a2b5-713392a33be2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3017e5d92bef4cc2aeae4f28c78ba233', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:48:31.323814 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b01de4-63f5-42b5-a2b5-713392a33be2 service nova] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:31.324084 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b01de4-63f5-42b5-a2b5-713392a33be2 service nova] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:31.324342 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b01de4-63f5-42b5-a2b5-713392a33be2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:31.325967 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-87b01de4-63f5-42b5-a2b5-713392a33be2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:48:31.433579 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b01de4-63f5-42b5-a2b5-713392a33be2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:48:31.435189 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b01de4-63f5-42b5-a2b5-713392a33be2 service nova] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:48:31.457766 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 708/1403] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:48:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:48:33.694600 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5fcdfa-6ddd-4ace-8c8f-7ab0a428af90 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:33.695247 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5fcdfa-6ddd-4ace-8c8f-7ab0a428af90 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:33.695247 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5fcdfa-6ddd-4ace-8c8f-7ab0a428af90 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:33.696510 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 696/1404] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:48:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:48:33.703345 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b10bef0-e0bd-44d2-a498-f8af79f188f7 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:33.703345 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b10bef0-e0bd-44d2-a498-f8af79f188f7 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:33.703345 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b10bef0-e0bd-44d2-a498-f8af79f188f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:33.751224 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:33.778406 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-7b10bef0-e0bd-44d2-a498-f8af79f188f7 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:48:33.779665 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-7b10bef0-e0bd-44d2-a498-f8af79f188f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:48:33.888258 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 709/1405] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:48:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:48:34.173583 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5fcdfa-6ddd-4ace-8c8f-7ab0a428af90 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:48:34.175579 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ee5fcdfa-6ddd-4ace-8c8f-7ab0a428af90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:48:34.264700 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:34.336533 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5fcdfa-6ddd-4ace-8c8f-7ab0a428af90 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:48:34.462989 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e353fa-316d-4bbd-b9e1-79fafb638db5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3017e5d92bef4cc2aeae4f28c78ba233', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:48:34.463635 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e353fa-316d-4bbd-b9e1-79fafb638db5 service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:34.463912 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e353fa-316d-4bbd-b9e1-79fafb638db5 service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:34.464179 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e353fa-316d-4bbd-b9e1-79fafb638db5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:34.465885 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-37e353fa-316d-4bbd-b9e1-79fafb638db5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:48:34.518033 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:34.645643 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e353fa-316d-4bbd-b9e1-79fafb638db5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:48:34.645643 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e353fa-316d-4bbd-b9e1-79fafb638db5 service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:48:34.665522 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 697/1406] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:48:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:48:36.899384 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3debbedb-0511-4296-8869-025f0e6b62e7 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:36.899977 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3debbedb-0511-4296-8869-025f0e6b62e7 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:36.899977 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3debbedb-0511-4296-8869-025f0e6b62e7 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:36.901437 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 710/1407] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:48:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:48:36.906849 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13baea2d-0d3a-4b67-ad82-7a4ea31d8c43 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:36.907329 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13baea2d-0d3a-4b67-ad82-7a4ea31d8c43 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:36.907438 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13baea2d-0d3a-4b67-ad82-7a4ea31d8c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:36.988533 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-13baea2d-0d3a-4b67-ad82-7a4ea31d8c43 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:48:36.990198 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-13baea2d-0d3a-4b67-ad82-7a4ea31d8c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:48:37.117165 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 698/1408] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:48:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 14:48:37.412574 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3debbedb-0511-4296-8869-025f0e6b62e7 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:48:37.414235 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-3debbedb-0511-4296-8869-025f0e6b62e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:48:37.536311 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:37.588437 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3debbedb-0511-4296-8869-025f0e6b62e7 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:48:37.725651 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adac054-7217-4fa3-a3ca-bb68b8ab01e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3017e5d92bef4cc2aeae4f28c78ba233', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:48:37.726679 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adac054-7217-4fa3-a3ca-bb68b8ab01e1 service nova] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:37.726954 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adac054-7217-4fa3-a3ca-bb68b8ab01e1 service nova] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:37.727216 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adac054-7217-4fa3-a3ca-bb68b8ab01e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:37.728876 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-1adac054-7217-4fa3-a3ca-bb68b8ab01e1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:48:37.814695 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:37.832595 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adac054-7217-4fa3-a3ca-bb68b8ab01e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:48:37.834538 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adac054-7217-4fa3-a3ca-bb68b8ab01e1 service nova] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:48:37.854461 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 711/1409] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:48:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:48:47.107619 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:47.851802 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=13 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:50.901021 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555468c7-ddfb-4591-9f12-4f95914a9bcd None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:50.901622 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555468c7-ddfb-4591-9f12-4f95914a9bcd None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:50.901622 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555468c7-ddfb-4591-9f12-4f95914a9bcd None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:50.902895 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 699/1410] 10.222.0.26 () {54 vars in 918 bytes} [Mon Sep 19 14:48:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:48:50.908601 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5167b94f-9dc4-41af-be57-c842ff0f9bb6 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:50.909129 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5167b94f-9dc4-41af-be57-c842ff0f9bb6 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:50.909129 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5167b94f-9dc4-41af-be57-c842ff0f9bb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:51.004204 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-5167b94f-9dc4-41af-be57-c842ff0f9bb6 None None] MFA Rules not processed for user `da0a58c526f34afda909e4ede2b1e1c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:48:51.005588 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-5167b94f-9dc4-41af-be57-c842ff0f9bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:48:51.123612 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 712/1411] 10.222.0.26 () {58 vars in 1015 bytes} [Mon Sep 19 14:48:50 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:48:51.138608 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7382d546-e54e-4c7f-b175-66115ad336de None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:51.138915 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7382d546-e54e-4c7f-b175-66115ad336de None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:51.139178 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7382d546-e54e-4c7f-b175-66115ad336de None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:51.140519 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 700/1412] 10.222.0.26 () {54 vars in 918 bytes} [Mon Sep 19 14:48:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:48:51.145479 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be9ffd-e8fd-428f-899d-e9955db960f6 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:51.145772 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be9ffd-e8fd-428f-899d-e9955db960f6 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:51.146043 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be9ffd-e8fd-428f-899d-e9955db960f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:51.224210 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:51.227695 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-23be9ffd-e8fd-428f-899d-e9955db960f6 None None] MFA Rules not processed for user `3017e5d92bef4cc2aeae4f28c78ba233`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:48:51.229626 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-23be9ffd-e8fd-428f-899d-e9955db960f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:48:51.363369 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 713/1413] 10.222.0.26 () {58 vars in 1015 bytes} [Mon Sep 19 14:48:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:48:53.960566 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e70289-0899-491a-9917-43ca5a48c964 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:53.961158 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e70289-0899-491a-9917-43ca5a48c964 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:53.961158 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e70289-0899-491a-9917-43ca5a48c964 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:53.963197 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 701/1414] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 14:48:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:48:53.971331 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35081540-eabf-4978-a1a3-f73e837b8d0b None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:53.971843 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35081540-eabf-4978-a1a3-f73e837b8d0b None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:53.971843 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35081540-eabf-4978-a1a3-f73e837b8d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:54.043048 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-35081540-eabf-4978-a1a3-f73e837b8d0b None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:48:54.044264 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-35081540-eabf-4978-a1a3-f73e837b8d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:48:54.107695 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:54.162507 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 714/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 14:48:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:48:54.452851 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e70289-0899-491a-9917-43ca5a48c964 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:48:54.455594 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e3e70289-0899-491a-9917-43ca5a48c964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:48:54.613862 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e70289-0899-491a-9917-43ca5a48c964 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:48:54.696888 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:54.739935 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa923ae-e25a-4291-ba32-3225f9bf3ada service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3017e5d92bef4cc2aeae4f28c78ba233', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:48:54.740528 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa923ae-e25a-4291-ba32-3225f9bf3ada service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:54.740806 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa923ae-e25a-4291-ba32-3225f9bf3ada service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:54.741094 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa923ae-e25a-4291-ba32-3225f9bf3ada service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:54.742691 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-4aa923ae-e25a-4291-ba32-3225f9bf3ada service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:48:54.851495 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa923ae-e25a-4291-ba32-3225f9bf3ada service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:48:54.853116 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa923ae-e25a-4291-ba32-3225f9bf3ada service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:48:54.872211 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 702/1416] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:48:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:48:56.044042 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a956b8a-a723-4a08-83a8-4e2e73bbbc34 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:56.044576 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a956b8a-a723-4a08-83a8-4e2e73bbbc34 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:56.044576 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a956b8a-a723-4a08-83a8-4e2e73bbbc34 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:56.046734 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 715/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 14:48:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:48:56.055800 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e88884-3f7e-4ed0-a39c-f0b15f6e566a None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:56.056323 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e88884-3f7e-4ed0-a39c-f0b15f6e566a None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:56.056323 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e88884-3f7e-4ed0-a39c-f0b15f6e566a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:56.154517 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-71e88884-3f7e-4ed0-a39c-f0b15f6e566a None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:48:56.155744 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-71e88884-3f7e-4ed0-a39c-f0b15f6e566a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:48:56.188839 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:56.267857 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 703/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 14:48:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:48:56.431617 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a956b8a-a723-4a08-83a8-4e2e73bbbc34 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:48:56.435844 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-1a956b8a-a723-4a08-83a8-4e2e73bbbc34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:48:56.595969 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a956b8a-a723-4a08-83a8-4e2e73bbbc34 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:48:56.639313 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:56.715411 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d4a46-32e0-4403-ae00-a22ca5432b0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3017e5d92bef4cc2aeae4f28c78ba233', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:48:56.716023 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d4a46-32e0-4403-ae00-a22ca5432b0b service nova] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:56.716298 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d4a46-32e0-4403-ae00-a22ca5432b0b service nova] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:56.716565 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d4a46-32e0-4403-ae00-a22ca5432b0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:56.718198 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-d32d4a46-32e0-4403-ae00-a22ca5432b0b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:48:56.818147 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32d4a46-32e0-4403-ae00-a22ca5432b0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:48:56.819840 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32d4a46-32e0-4403-ae00-a22ca5432b0b service nova] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:48:56.839135 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 716/1419] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:48:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:48:58.053536 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1627d4ee-ee22-46e9-bca2-82f89795ab0f None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:58.054359 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1627d4ee-ee22-46e9-bca2-82f89795ab0f None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:58.054359 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1627d4ee-ee22-46e9-bca2-82f89795ab0f None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:58.056502 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 704/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 14:48:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:48:58.062791 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2949973b-f184-4d18-a365-f1640784853e None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:58.063226 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2949973b-f184-4d18-a365-f1640784853e None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:58.063317 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2949973b-f184-4d18-a365-f1640784853e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:58.118914 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:58.144790 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-2949973b-f184-4d18-a365-f1640784853e None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:48:58.146141 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-2949973b-f184-4d18-a365-f1640784853e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:48:58.252686 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 717/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 14:48:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:48:58.409064 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1627d4ee-ee22-46e9-bca2-82f89795ab0f None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:48:58.411548 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-1627d4ee-ee22-46e9-bca2-82f89795ab0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:48:58.577031 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1627d4ee-ee22-46e9-bca2-82f89795ab0f None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:48:58.589819 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:48:58.695261 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90912e6f-15d5-4edd-8b80-72012e2ef671 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3017e5d92bef4cc2aeae4f28c78ba233', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:48:58.695831 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90912e6f-15d5-4edd-8b80-72012e2ef671 service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:58.696069 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90912e6f-15d5-4edd-8b80-72012e2ef671 service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:58.696361 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90912e6f-15d5-4edd-8b80-72012e2ef671 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:58.697995 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-90912e6f-15d5-4edd-8b80-72012e2ef671 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:48:58.793635 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90912e6f-15d5-4edd-8b80-72012e2ef671 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:48:58.795245 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90912e6f-15d5-4edd-8b80-72012e2ef671 service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:48:58.815513 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 705/1422] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:48:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:48:59.933465 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1779d2a5-fbf4-45d7-acc6-77c86e3ea8d4 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:59.934075 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1779d2a5-fbf4-45d7-acc6-77c86e3ea8d4 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:59.934075 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1779d2a5-fbf4-45d7-acc6-77c86e3ea8d4 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:59.935369 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 718/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 14:48:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:48:59.943093 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31163c60-e752-4f67-91c5-cb7772854482 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:48:59.943853 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31163c60-e752-4f67-91c5-cb7772854482 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:48:59.944021 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31163c60-e752-4f67-91c5-cb7772854482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:48:59.968879 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:00.037566 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-31163c60-e752-4f67-91c5-cb7772854482 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:49:00.038789 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-31163c60-e752-4f67-91c5-cb7772854482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:00.142459 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 706/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 14:48:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:49:00.295875 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1779d2a5-fbf4-45d7-acc6-77c86e3ea8d4 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:00.297341 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-1779d2a5-fbf4-45d7-acc6-77c86e3ea8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:00.428781 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:00.468465 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1779d2a5-fbf4-45d7-acc6-77c86e3ea8d4 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:00.590181 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933385d6-fdb7-4ab0-a155-2ee18e3873ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3017e5d92bef4cc2aeae4f28c78ba233', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:00.590888 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933385d6-fdb7-4ab0-a155-2ee18e3873ad service nova] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:00.591260 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933385d6-fdb7-4ab0-a155-2ee18e3873ad service nova] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:00.591626 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933385d6-fdb7-4ab0-a155-2ee18e3873ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:00.593379 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-933385d6-fdb7-4ab0-a155-2ee18e3873ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:00.675225 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:00.689755 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933385d6-fdb7-4ab0-a155-2ee18e3873ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:00.691539 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933385d6-fdb7-4ab0-a155-2ee18e3873ad service nova] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:00.711931 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 719/1425] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:49:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:49:01.850028 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9bd7bf-902d-417a-b232-00134370c0e0 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:01.850727 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9bd7bf-902d-417a-b232-00134370c0e0 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:01.850727 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9bd7bf-902d-417a-b232-00134370c0e0 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:01.852583 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 707/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 14:49:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:49:01.862962 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75177768-c24b-4a90-9f7c-098c6727d3b6 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:01.863427 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75177768-c24b-4a90-9f7c-098c6727d3b6 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:01.863531 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75177768-c24b-4a90-9f7c-098c6727d3b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:01.954328 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-75177768-c24b-4a90-9f7c-098c6727d3b6 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:49:01.955552 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-75177768-c24b-4a90-9f7c-098c6727d3b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:02.060810 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 720/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 14:49:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:49:02.212618 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9bd7bf-902d-417a-b232-00134370c0e0 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:02.215042 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-3e9bd7bf-902d-417a-b232-00134370c0e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:02.320850 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:02.386261 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9bd7bf-902d-417a-b232-00134370c0e0 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:02.511140 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e81c8fd-1290-45d4-86be-691cb72b60f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3017e5d92bef4cc2aeae4f28c78ba233', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:02.511756 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e81c8fd-1290-45d4-86be-691cb72b60f2 service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:02.512038 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e81c8fd-1290-45d4-86be-691cb72b60f2 service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:02.512288 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e81c8fd-1290-45d4-86be-691cb72b60f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:02.513914 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-4e81c8fd-1290-45d4-86be-691cb72b60f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:02.565589 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:02.618117 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e81c8fd-1290-45d4-86be-691cb72b60f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:02.619753 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e81c8fd-1290-45d4-86be-691cb72b60f2 service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:02.640717 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 708/1428] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:49:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:49:03.725484 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895503c6-70df-4e7c-a92b-7c46a2fd7f6a None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:03.726070 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895503c6-70df-4e7c-a92b-7c46a2fd7f6a None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:03.726070 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895503c6-70df-4e7c-a92b-7c46a2fd7f6a None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:03.727379 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 721/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 14:49:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:49:03.737907 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5995f4b-2727-498a-a77f-654584233e08 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:03.738418 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5995f4b-2727-498a-a77f-654584233e08 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:03.738529 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5995f4b-2727-498a-a77f-654584233e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:03.840719 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-f5995f4b-2727-498a-a77f-654584233e08 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:49:03.842523 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f5995f4b-2727-498a-a77f-654584233e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:03.945593 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 709/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 14:49:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:49:04.103349 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895503c6-70df-4e7c-a92b-7c46a2fd7f6a None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:04.105781 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-895503c6-70df-4e7c-a92b-7c46a2fd7f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:04.163699 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:04.282885 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895503c6-70df-4e7c-a92b-7c46a2fd7f6a None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:04.410902 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb4c9fc-7524-46f1-b7b2-8a3acf6f1b44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3017e5d92bef4cc2aeae4f28c78ba233', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:04.411510 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb4c9fc-7524-46f1-b7b2-8a3acf6f1b44 service nova] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:04.411790 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb4c9fc-7524-46f1-b7b2-8a3acf6f1b44 service nova] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:04.412060 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb4c9fc-7524-46f1-b7b2-8a3acf6f1b44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:04.413689 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-9fb4c9fc-7524-46f1-b7b2-8a3acf6f1b44 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:04.420833 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:04.509485 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb4c9fc-7524-46f1-b7b2-8a3acf6f1b44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:04.511087 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb4c9fc-7524-46f1-b7b2-8a3acf6f1b44 service nova] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:04.530196 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 722/1431] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:49:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:49:05.593231 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885811cf-b77a-415e-802c-18ea94eb5951 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:05.594161 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885811cf-b77a-415e-802c-18ea94eb5951 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:05.594161 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885811cf-b77a-415e-802c-18ea94eb5951 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:05.595900 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 710/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 14:49:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:49:05.603286 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a84cd-cdf7-460d-917a-e91298749aa0 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:05.604070 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a84cd-cdf7-460d-917a-e91298749aa0 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:05.604070 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a84cd-cdf7-460d-917a-e91298749aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:05.702898 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-a84a84cd-cdf7-460d-917a-e91298749aa0 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:49:05.704591 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-a84a84cd-cdf7-460d-917a-e91298749aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:05.778358 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:05.807670 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 723/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 14:49:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:49:05.958630 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885811cf-b77a-415e-802c-18ea94eb5951 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:05.960492 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-885811cf-b77a-415e-802c-18ea94eb5951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:05.979192 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:06.120083 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885811cf-b77a-415e-802c-18ea94eb5951 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:06.216851 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:06.244287 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10121c48-b03e-4632-8184-50623f2cefe9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3017e5d92bef4cc2aeae4f28c78ba233', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:06.244888 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10121c48-b03e-4632-8184-50623f2cefe9 service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:06.245192 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10121c48-b03e-4632-8184-50623f2cefe9 service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:06.245457 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10121c48-b03e-4632-8184-50623f2cefe9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:06.247045 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-10121c48-b03e-4632-8184-50623f2cefe9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:06.351111 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10121c48-b03e-4632-8184-50623f2cefe9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:06.352708 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10121c48-b03e-4632-8184-50623f2cefe9 service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:06.372008 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 711/1434] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:49:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:49:07.434310 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddec9a2d-70e1-42fa-a3b8-ecb82943a188 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:07.434941 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddec9a2d-70e1-42fa-a3b8-ecb82943a188 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:07.434941 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddec9a2d-70e1-42fa-a3b8-ecb82943a188 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:07.436210 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 724/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 14:49:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:49:07.443669 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec6f044-bc03-4c81-a191-2769dcd8cf7f None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:07.444462 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec6f044-bc03-4c81-a191-2769dcd8cf7f None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:07.444594 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec6f044-bc03-4c81-a191-2769dcd8cf7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:07.538769 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-aec6f044-bc03-4c81-a191-2769dcd8cf7f None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:49:07.540070 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-aec6f044-bc03-4c81-a191-2769dcd8cf7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:07.584602 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:07.646192 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 712/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 14:49:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:49:07.800700 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddec9a2d-70e1-42fa-a3b8-ecb82943a188 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:07.802973 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-ddec9a2d-70e1-42fa-a3b8-ecb82943a188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:07.959258 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddec9a2d-70e1-42fa-a3b8-ecb82943a188 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:08.017500 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:08.077926 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c614ec27-cbcb-4e0f-892a-bc39655cb601 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3017e5d92bef4cc2aeae4f28c78ba233', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:08.078449 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c614ec27-cbcb-4e0f-892a-bc39655cb601 service nova] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:08.078722 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c614ec27-cbcb-4e0f-892a-bc39655cb601 service nova] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:08.079082 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c614ec27-cbcb-4e0f-892a-bc39655cb601 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:08.080740 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-c614ec27-cbcb-4e0f-892a-bc39655cb601 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:08.189157 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c614ec27-cbcb-4e0f-892a-bc39655cb601 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:08.190771 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c614ec27-cbcb-4e0f-892a-bc39655cb601 service nova] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:08.211347 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 725/1437] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:49:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:49:09.275225 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124810a1-c5b1-45c1-ac75-36ad3c7e4e47 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:09.276115 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124810a1-c5b1-45c1-ac75-36ad3c7e4e47 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:09.276115 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124810a1-c5b1-45c1-ac75-36ad3c7e4e47 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:09.278336 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 713/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 14:49:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:49:09.286405 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da44da90-b7a4-4de7-a5ad-bf4387339c34 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:09.286874 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da44da90-b7a4-4de7-a5ad-bf4387339c34 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:09.286995 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da44da90-b7a4-4de7-a5ad-bf4387339c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:09.370020 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-da44da90-b7a4-4de7-a5ad-bf4387339c34 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:49:09.371239 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-da44da90-b7a4-4de7-a5ad-bf4387339c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:09.373331 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:09.471319 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 726/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 14:49:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 14:49:09.621557 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124810a1-c5b1-45c1-ac75-36ad3c7e4e47 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:09.623016 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-124810a1-c5b1-45c1-ac75-36ad3c7e4e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:09.782775 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124810a1-c5b1-45c1-ac75-36ad3c7e4e47 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:09.815674 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:09.914728 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc601f4b-5a10-4731-9546-a485dc9aa2d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3017e5d92bef4cc2aeae4f28c78ba233', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:09.915601 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc601f4b-5a10-4731-9546-a485dc9aa2d2 service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:09.916039 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc601f4b-5a10-4731-9546-a485dc9aa2d2 service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:09.916475 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc601f4b-5a10-4731-9546-a485dc9aa2d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:09.919119 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-bc601f4b-5a10-4731-9546-a485dc9aa2d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:10.023060 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc601f4b-5a10-4731-9546-a485dc9aa2d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:10.025639 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc601f4b-5a10-4731-9546-a485dc9aa2d2 service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:10.047060 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 714/1440] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:49:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:49:12.118167 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1bb6e-121d-4a23-9367-2f4328754a39 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:12.118633 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1bb6e-121d-4a23-9367-2f4328754a39 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:12.118749 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1bb6e-121d-4a23-9367-2f4328754a39 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:12.120072 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 727/1441] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 14:49:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:49:12.126639 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675fe8a2-52b4-4be4-a36c-e0dd4456610a None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:12.127247 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675fe8a2-52b4-4be4-a36c-e0dd4456610a None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:12.127373 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675fe8a2-52b4-4be4-a36c-e0dd4456610a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:12.182187 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:12.219089 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-675fe8a2-52b4-4be4-a36c-e0dd4456610a None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:49:12.220359 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-675fe8a2-52b4-4be4-a36c-e0dd4456610a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:12.330554 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 715/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 14:49:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:49:12.614631 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc1bb6e-121d-4a23-9367-2f4328754a39 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:12.616187 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-dcc1bb6e-121d-4a23-9367-2f4328754a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:12.725260 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc1bb6e-121d-4a23-9367-2f4328754a39 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:12.762538 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:12.807365 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e73f92-975d-4bd8-8513-39bccffeb9fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:12.807981 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e73f92-975d-4bd8-8513-39bccffeb9fc service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:12.808259 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e73f92-975d-4bd8-8513-39bccffeb9fc service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:12.808528 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e73f92-975d-4bd8-8513-39bccffeb9fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:12.810276 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-40e73f92-975d-4bd8-8513-39bccffeb9fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:13.053378 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e73f92-975d-4bd8-8513-39bccffeb9fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:13.054834 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e73f92-975d-4bd8-8513-39bccffeb9fc service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:13.073111 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 728/1443] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:49:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:49:15.457816 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a14c63-d36d-403d-8600-a694a3fa4f3d None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:15.458394 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a14c63-d36d-403d-8600-a694a3fa4f3d None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:15.458394 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a14c63-d36d-403d-8600-a694a3fa4f3d None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:15.459937 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 716/1444] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 14:49:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:49:15.466600 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a8d9f-d477-42d4-a709-3bf357d15455 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:15.467068 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a8d9f-d477-42d4-a709-3bf357d15455 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:15.467181 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a8d9f-d477-42d4-a709-3bf357d15455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:15.541875 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-205a8d9f-d477-42d4-a709-3bf357d15455 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:49:15.543111 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-205a8d9f-d477-42d4-a709-3bf357d15455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:15.556082 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:15.664025 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 729/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 14:49:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:49:15.960378 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a14c63-d36d-403d-8600-a694a3fa4f3d None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:15.962945 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-c0a14c63-d36d-403d-8600-a694a3fa4f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:16.075323 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a14c63-d36d-403d-8600-a694a3fa4f3d None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:16.089747 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:16.155167 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22127302-c1a6-42f7-a974-d76eb4e663a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:16.155767 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22127302-c1a6-42f7-a974-d76eb4e663a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:16.156038 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22127302-c1a6-42f7-a974-d76eb4e663a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:16.156304 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22127302-c1a6-42f7-a974-d76eb4e663a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:16.157920 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-22127302-c1a6-42f7-a974-d76eb4e663a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:16.278484 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22127302-c1a6-42f7-a974-d76eb4e663a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:16.279865 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22127302-c1a6-42f7-a974-d76eb4e663a4 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:16.298329 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 717/1446] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:49:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:49:18.780710 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac8747b-599d-4dd4-901a-2508f0a50600 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:18.781674 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac8747b-599d-4dd4-901a-2508f0a50600 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:18.781674 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac8747b-599d-4dd4-901a-2508f0a50600 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:18.783870 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 730/1447] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 14:49:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:49:18.789731 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef11f098-ca22-48e1-8860-37310255a8dd None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:18.790207 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef11f098-ca22-48e1-8860-37310255a8dd None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:18.790303 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef11f098-ca22-48e1-8860-37310255a8dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:18.846885 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:18.866798 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-ef11f098-ca22-48e1-8860-37310255a8dd None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:49:18.868007 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ef11f098-ca22-48e1-8860-37310255a8dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:18.970020 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 718/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 14:49:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 14:49:19.252902 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac8747b-599d-4dd4-901a-2508f0a50600 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:19.255306 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-aac8747b-599d-4dd4-901a-2508f0a50600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:19.367526 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac8747b-599d-4dd4-901a-2508f0a50600 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:19.417543 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:19.457612 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0f4f72-18c1-4884-adde-e2515c93ea7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:19.458187 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0f4f72-18c1-4884-adde-e2515c93ea7a service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:19.458452 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0f4f72-18c1-4884-adde-e2515c93ea7a service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:19.458727 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0f4f72-18c1-4884-adde-e2515c93ea7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:19.460653 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-db0f4f72-18c1-4884-adde-e2515c93ea7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:19.574952 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0f4f72-18c1-4884-adde-e2515c93ea7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:19.576283 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0f4f72-18c1-4884-adde-e2515c93ea7a service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:19.595174 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 731/1449] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:49:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:49:21.949662 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dcb5ff-9e20-4a1d-b2ef-3b2dc36c4acd None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:21.950270 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dcb5ff-9e20-4a1d-b2ef-3b2dc36c4acd None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:21.950270 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dcb5ff-9e20-4a1d-b2ef-3b2dc36c4acd None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:21.951567 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 719/1450] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 14:49:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:49:21.957339 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00697400-1270-48fc-90bd-36cfc066b56b None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:21.957807 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00697400-1270-48fc-90bd-36cfc066b56b None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:21.957910 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00697400-1270-48fc-90bd-36cfc066b56b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:22.034943 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-00697400-1270-48fc-90bd-36cfc066b56b None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:49:22.036177 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-00697400-1270-48fc-90bd-36cfc066b56b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:22.058977 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:22.145744 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 732/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 14:49:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:49:22.451364 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dcb5ff-9e20-4a1d-b2ef-3b2dc36c4acd None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:22.453860 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-c7dcb5ff-9e20-4a1d-b2ef-3b2dc36c4acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:22.567269 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dcb5ff-9e20-4a1d-b2ef-3b2dc36c4acd None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:22.589816 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:22.645678 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4ec56a-cc85-4a69-b109-63cb140fca09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:22.646283 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ec56a-cc85-4a69-b109-63cb140fca09 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:22.646551 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ec56a-cc85-4a69-b109-63cb140fca09 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:22.646815 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ec56a-cc85-4a69-b109-63cb140fca09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:22.648425 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-5a4ec56a-cc85-4a69-b109-63cb140fca09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:22.783021 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4ec56a-cc85-4a69-b109-63cb140fca09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:22.784729 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4ec56a-cc85-4a69-b109-63cb140fca09 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:22.803554 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 720/1452] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:49:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:49:25.073323 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79db60c-964e-4ccc-b2e6-ef8e099026e4 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:25.074239 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79db60c-964e-4ccc-b2e6-ef8e099026e4 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:25.074239 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79db60c-964e-4ccc-b2e6-ef8e099026e4 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:25.076342 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 733/1453] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 14:49:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:49:25.086144 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb1d1a-a04b-4e4e-bd30-0ad2232f4758 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:25.086858 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb1d1a-a04b-4e4e-bd30-0ad2232f4758 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:25.087036 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb1d1a-a04b-4e4e-bd30-0ad2232f4758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:25.157063 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:25.161985 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-79bb1d1a-a04b-4e4e-bd30-0ad2232f4758 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:49:25.164800 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-79bb1d1a-a04b-4e4e-bd30-0ad2232f4758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:25.272423 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 721/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 14:49:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:49:25.560196 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79db60c-964e-4ccc-b2e6-ef8e099026e4 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:25.562674 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-d79db60c-964e-4ccc-b2e6-ef8e099026e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:25.691245 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79db60c-964e-4ccc-b2e6-ef8e099026e4 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:25.747004 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:25.774322 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7bf06b-c196-42db-8284-192363979924 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:25.775279 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7bf06b-c196-42db-8284-192363979924 service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:25.775594 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7bf06b-c196-42db-8284-192363979924 service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:25.775863 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7bf06b-c196-42db-8284-192363979924 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:25.777588 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-af7bf06b-c196-42db-8284-192363979924 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:25.894327 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7bf06b-c196-42db-8284-192363979924 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:25.895753 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7bf06b-c196-42db-8284-192363979924 service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:25.914486 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 734/1455] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:49:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:49:28.268671 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44756301-8e76-4472-a193-deb45497c86f None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:28.269250 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44756301-8e76-4472-a193-deb45497c86f None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:28.269250 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44756301-8e76-4472-a193-deb45497c86f None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:28.270494 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 722/1456] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 14:49:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:49:28.276227 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c6953-684a-4c6d-b99c-af544e9a325f None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:28.276660 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c6953-684a-4c6d-b99c-af544e9a325f None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:28.276754 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c6953-684a-4c6d-b99c-af544e9a325f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:28.344686 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-ca5c6953-684a-4c6d-b99c-af544e9a325f None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:49:28.345982 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-ca5c6953-684a-4c6d-b99c-af544e9a325f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:28.375570 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:28.446976 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 735/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 14:49:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:49:28.733825 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44756301-8e76-4472-a193-deb45497c86f None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:28.736263 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-44756301-8e76-4472-a193-deb45497c86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:28.858113 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44756301-8e76-4472-a193-deb45497c86f None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:28.887685 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:28.936697 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e56861d-b615-4132-ad87-d3d0d977755f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:28.937331 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e56861d-b615-4132-ad87-d3d0d977755f service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:28.937615 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e56861d-b615-4132-ad87-d3d0d977755f service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:28.937877 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e56861d-b615-4132-ad87-d3d0d977755f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:28.939461 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2e56861d-b615-4132-ad87-d3d0d977755f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:29.060641 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e56861d-b615-4132-ad87-d3d0d977755f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:29.062119 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e56861d-b615-4132-ad87-d3d0d977755f service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:29.081052 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 723/1458] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:49:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:49:31.266207 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e376c8c5-3f33-48d6-b96b-c9db16d8a9de None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:31.266799 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e376c8c5-3f33-48d6-b96b-c9db16d8a9de None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:31.266799 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e376c8c5-3f33-48d6-b96b-c9db16d8a9de None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:31.268307 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 736/1459] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 14:49:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 14:49:31.274951 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7700f0-e137-4256-af6b-0ab1c58e7077 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:31.275712 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7700f0-e137-4256-af6b-0ab1c58e7077 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:31.275851 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7700f0-e137-4256-af6b-0ab1c58e7077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:31.365597 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-2b7700f0-e137-4256-af6b-0ab1c58e7077 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:49:31.366817 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2b7700f0-e137-4256-af6b-0ab1c58e7077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:31.375290 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:31.473317 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 724/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 14:49:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:49:31.767237 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e376c8c5-3f33-48d6-b96b-c9db16d8a9de None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:31.768827 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-e376c8c5-3f33-48d6-b96b-c9db16d8a9de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:31.880832 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e376c8c5-3f33-48d6-b96b-c9db16d8a9de None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:31.942972 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:31.967858 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af871eb-5b8e-44a1-9f58-671d384ddaea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:31.968635 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af871eb-5b8e-44a1-9f58-671d384ddaea service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:31.968916 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af871eb-5b8e-44a1-9f58-671d384ddaea service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:31.969351 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af871eb-5b8e-44a1-9f58-671d384ddaea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:31.971883 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-1af871eb-5b8e-44a1-9f58-671d384ddaea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:32.095293 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af871eb-5b8e-44a1-9f58-671d384ddaea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:32.096939 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af871eb-5b8e-44a1-9f58-671d384ddaea service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:32.116754 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 737/1461] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:49:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:49:34.307111 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04c9461-a826-43f0-b4e5-16952726f32e None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:34.307679 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04c9461-a826-43f0-b4e5-16952726f32e None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:34.307679 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04c9461-a826-43f0-b4e5-16952726f32e None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:34.308877 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 725/1462] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 14:49:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 14:49:34.314503 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c454c4f-b87f-40f9-9578-8fc71688cc27 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:34.315056 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c454c4f-b87f-40f9-9578-8fc71688cc27 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:34.315056 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c454c4f-b87f-40f9-9578-8fc71688cc27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:34.383059 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-2c454c4f-b87f-40f9-9578-8fc71688cc27 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:49:34.384264 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-2c454c4f-b87f-40f9-9578-8fc71688cc27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:34.423204 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:34.484914 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 738/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 14:49:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:49:34.767949 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04c9461-a826-43f0-b4e5-16952726f32e None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:34.769545 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b04c9461-a826-43f0-b4e5-16952726f32e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:34.880585 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04c9461-a826-43f0-b4e5-16952726f32e None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:34.920227 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:34.959732 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020fde04-1241-424c-8296-fba904931df4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:34.960648 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020fde04-1241-424c-8296-fba904931df4 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:34.960923 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020fde04-1241-424c-8296-fba904931df4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:34.961221 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020fde04-1241-424c-8296-fba904931df4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:34.962835 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-020fde04-1241-424c-8296-fba904931df4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:35.083595 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020fde04-1241-424c-8296-fba904931df4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:35.084950 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020fde04-1241-424c-8296-fba904931df4 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:35.103430 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 726/1464] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:49:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:49:37.285846 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0342aa-074f-4d98-8346-d97e4ffb3060 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:37.286404 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0342aa-074f-4d98-8346-d97e4ffb3060 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:37.286404 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0342aa-074f-4d98-8346-d97e4ffb3060 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:37.288039 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 739/1465] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 14:49:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:49:37.294653 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f973c-7b81-45c4-9b60-36d660c83690 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:37.295463 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f973c-7b81-45c4-9b60-36d660c83690 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:37.295633 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f973c-7b81-45c4-9b60-36d660c83690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:37.377056 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-561f973c-7b81-45c4-9b60-36d660c83690 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:49:37.378254 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-561f973c-7b81-45c4-9b60-36d660c83690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:37.397404 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:37.482650 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 727/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 14:49:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:49:37.767399 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0342aa-074f-4d98-8346-d97e4ffb3060 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:37.770671 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-5b0342aa-074f-4d98-8346-d97e4ffb3060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:37.888284 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0342aa-074f-4d98-8346-d97e4ffb3060 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:37.966434 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:37.974155 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79685d3-81ee-4fae-a785-d77f763ff1d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:37.974766 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79685d3-81ee-4fae-a785-d77f763ff1d0 service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:37.975040 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79685d3-81ee-4fae-a785-d77f763ff1d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:37.975311 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79685d3-81ee-4fae-a785-d77f763ff1d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:37.976937 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-d79685d3-81ee-4fae-a785-d77f763ff1d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:38.091603 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79685d3-81ee-4fae-a785-d77f763ff1d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:38.092973 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79685d3-81ee-4fae-a785-d77f763ff1d0 service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:38.114963 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 740/1467] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:49:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:49:40.320859 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646a39b3-fed6-4601-a33f-b89a5e07273f None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:40.321485 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646a39b3-fed6-4601-a33f-b89a5e07273f None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:40.321485 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646a39b3-fed6-4601-a33f-b89a5e07273f None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:40.322787 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 728/1468] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 14:49:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:49:40.330069 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8921ad2-8f45-4f15-92c3-06b414a9b694 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:40.330515 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8921ad2-8f45-4f15-92c3-06b414a9b694 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:40.330811 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8921ad2-8f45-4f15-92c3-06b414a9b694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:40.404585 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-b8921ad2-8f45-4f15-92c3-06b414a9b694 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:49:40.405826 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-b8921ad2-8f45-4f15-92c3-06b414a9b694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:40.458471 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:40.510803 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 741/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 14:49:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:49:40.808145 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646a39b3-fed6-4601-a33f-b89a5e07273f None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:49:40.809769 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-646a39b3-fed6-4601-a33f-b89a5e07273f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:40.936177 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646a39b3-fed6-4601-a33f-b89a5e07273f None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:49:40.987891 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:41.018329 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1607954c-2214-43ac-90ea-7053f830a0fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:49:41.023588 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1607954c-2214-43ac-90ea-7053f830a0fe service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:49:41.023588 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1607954c-2214-43ac-90ea-7053f830a0fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:49:41.023588 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1607954c-2214-43ac-90ea-7053f830a0fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:49:41.023588 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-1607954c-2214-43ac-90ea-7053f830a0fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:49:41.144957 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1607954c-2214-43ac-90ea-7053f830a0fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:49:41.146522 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1607954c-2214-43ac-90ea-7053f830a0fe service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:49:41.165547 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 729/1470] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:49:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:49:50.509010 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=22 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:49:51.163200 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=66 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:01.213045 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c3b7b9-f44f-4b52-b159-233fb3c26c89 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:01.213942 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c3b7b9-f44f-4b52-b159-233fb3c26c89 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:01.214046 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c3b7b9-f44f-4b52-b159-233fb3c26c89 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:01.216104 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 742/1471] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:50:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:50:01.224821 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a5fe2-8ea5-43aa-bdb3-b0db72ce2cc4 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:01.225594 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a5fe2-8ea5-43aa-bdb3-b0db72ce2cc4 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:01.225754 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a5fe2-8ea5-43aa-bdb3-b0db72ce2cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:01.302082 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-be5a5fe2-8ea5-43aa-bdb3-b0db72ce2cc4 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:50:01.303295 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-be5a5fe2-8ea5-43aa-bdb3-b0db72ce2cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:01.403696 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 730/1472] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:50:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:50:01.701384 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed41ba5-df92-4fea-954a-4fa34132ce27 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:01.701659 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed41ba5-df92-4fea-954a-4fa34132ce27 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:01.701925 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed41ba5-df92-4fea-954a-4fa34132ce27 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:01.703271 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 743/1473] 10.222.0.26 () {54 vars in 962 bytes} [Mon Sep 19 14:50:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:50:01.709590 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeed6e4-08d8-41f7-ba65-cbb3c0725f92 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:01.710227 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeed6e4-08d8-41f7-ba65-cbb3c0725f92 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:01.711071 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeed6e4-08d8-41f7-ba65-cbb3c0725f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:01.807924 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-adeed6e4-08d8-41f7-ba65-cbb3c0725f92 None None] MFA Rules not processed for user `f5d4e9c3da83402dbe7938aaf2dcbb8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:50:01.809207 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-adeed6e4-08d8-41f7-ba65-cbb3c0725f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:01.830859 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:01.887367 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 731/1474] 10.222.0.26 () {58 vars in 1059 bytes} [Mon Sep 19 14:50:01 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:50:01.895249 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed41ba5-df92-4fea-954a-4fa34132ce27 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:01.896746 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-fed41ba5-df92-4fea-954a-4fa34132ce27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:02.012462 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed41ba5-df92-4fea-954a-4fa34132ce27 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:02.092654 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5031aab1-9072-4772-a2d8-8ffc9e0471fe service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d4e9c3da83402dbe7938aaf2dcbb8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:02.093286 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031aab1-9072-4772-a2d8-8ffc9e0471fe service glance] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:02.093563 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031aab1-9072-4772-a2d8-8ffc9e0471fe service glance] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:02.093788 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031aab1-9072-4772-a2d8-8ffc9e0471fe service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:02.095584 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-5031aab1-9072-4772-a2d8-8ffc9e0471fe service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:02.154370 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:02.211233 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5031aab1-9072-4772-a2d8-8ffc9e0471fe service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:02.212668 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5031aab1-9072-4772-a2d8-8ffc9e0471fe service glance] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:02.234237 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 744/1475] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:50:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:50:04.482439 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beffbdb1-70bd-434e-96bd-4a527d707995 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:04.483380 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beffbdb1-70bd-434e-96bd-4a527d707995 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:04.483380 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beffbdb1-70bd-434e-96bd-4a527d707995 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:04.485328 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 732/1476] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:50:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:50:04.490998 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c977f09c-0a67-4708-85b0-075873fc08dc None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:04.491492 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c977f09c-0a67-4708-85b0-075873fc08dc None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:04.491492 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c977f09c-0a67-4708-85b0-075873fc08dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:04.565315 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-c977f09c-0a67-4708-85b0-075873fc08dc None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:50:04.566518 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-c977f09c-0a67-4708-85b0-075873fc08dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:04.674365 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 745/1477] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:50:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:50:04.955475 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beffbdb1-70bd-434e-96bd-4a527d707995 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:04.958018 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-beffbdb1-70bd-434e-96bd-4a527d707995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:05.106783 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beffbdb1-70bd-434e-96bd-4a527d707995 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:05.163771 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:05.212320 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1010f7-cfe2-4607-a5c5-ee6adb626195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:05.212842 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1010f7-cfe2-4607-a5c5-ee6adb626195 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:05.213161 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1010f7-cfe2-4607-a5c5-ee6adb626195 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:05.213424 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1010f7-cfe2-4607-a5c5-ee6adb626195 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:05.214065 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1010f7-cfe2-4607-a5c5-ee6adb626195 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:05.215866 dv-cinder-756709-7-smb devstack@keystone.service[81472]: WARNING py.warnings [None req-ac1010f7-cfe2-4607-a5c5-ee6adb626195 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 14:50:05.215866 dv-cinder-756709-7-smb devstack@keystone.service[81472]: warnings.warn(msg) Sep 19 14:50:05.215866 dv-cinder-756709-7-smb devstack@keystone.service[81472]: Sep 19 14:50:05.217024 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1010f7-cfe2-4607-a5c5-ee6adb626195 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:05.238182 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 733/1478] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Sep 19 14:50:04 2022] GET /identity/v3/projects => generated 2553 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:50:07.391497 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6aa675-000a-48a9-ad02-3edf03565d6a None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:07.391497 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6aa675-000a-48a9-ad02-3edf03565d6a None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:07.391497 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6aa675-000a-48a9-ad02-3edf03565d6a None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:07.394417 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 746/1479] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:50:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:50:07.401345 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da506f95-832b-44c5-979c-2abf7b8d1176 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:07.401808 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da506f95-832b-44c5-979c-2abf7b8d1176 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:07.401912 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da506f95-832b-44c5-979c-2abf7b8d1176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:07.472385 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-da506f95-832b-44c5-979c-2abf7b8d1176 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:50:07.473758 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-da506f95-832b-44c5-979c-2abf7b8d1176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:07.581608 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 734/1480] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:50:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:50:07.884297 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6aa675-000a-48a9-ad02-3edf03565d6a None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:07.886032 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-3f6aa675-000a-48a9-ad02-3edf03565d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:07.897533 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:08.054764 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6aa675-000a-48a9-ad02-3edf03565d6a None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:08.139253 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:08.173369 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ac995e-c16f-4108-887c-76f427759328 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3017e5d92bef4cc2aeae4f28c78ba233', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:08.174021 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ac995e-c16f-4108-887c-76f427759328 service nova] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:08.174304 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ac995e-c16f-4108-887c-76f427759328 service nova] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:08.174578 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ac995e-c16f-4108-887c-76f427759328 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:08.176193 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-98ac995e-c16f-4108-887c-76f427759328 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:08.281193 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ac995e-c16f-4108-887c-76f427759328 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:08.282853 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ac995e-c16f-4108-887c-76f427759328 service nova] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:08.302609 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 747/1481] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:50:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:50:10.642921 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f4376f-10a8-460a-acad-2f18432a7c52 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:10.643507 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f4376f-10a8-460a-acad-2f18432a7c52 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:10.643507 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f4376f-10a8-460a-acad-2f18432a7c52 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:10.645646 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 735/1482] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:50:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:50:10.654751 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feeb85d-049d-40d8-b268-9a5943d67c70 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:10.655168 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feeb85d-049d-40d8-b268-9a5943d67c70 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:10.655317 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feeb85d-049d-40d8-b268-9a5943d67c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:10.726421 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-4feeb85d-049d-40d8-b268-9a5943d67c70 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:50:10.727634 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-4feeb85d-049d-40d8-b268-9a5943d67c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:10.779723 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:10.835071 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 748/1483] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:50:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:50:11.124386 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f4376f-10a8-460a-acad-2f18432a7c52 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:11.126007 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-78f4376f-10a8-460a-acad-2f18432a7c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:11.152972 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:11.249447 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f4376f-10a8-460a-acad-2f18432a7c52 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:11.331142 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb00c20-fa11-4cb1-b258-c8dbff2b7840 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:11.331787 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb00c20-fa11-4cb1-b258-c8dbff2b7840 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:11.332068 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb00c20-fa11-4cb1-b258-c8dbff2b7840 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:11.332333 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb00c20-fa11-4cb1-b258-c8dbff2b7840 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:11.334018 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-0eb00c20-fa11-4cb1-b258-c8dbff2b7840 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:11.415846 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:11.453272 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb00c20-fa11-4cb1-b258-c8dbff2b7840 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:11.455201 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb00c20-fa11-4cb1-b258-c8dbff2b7840 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:11.474330 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 736/1484] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:50:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:50:13.686060 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd4e7e3-4e1a-4519-9fd3-2da33010dc34 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:13.686694 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd4e7e3-4e1a-4519-9fd3-2da33010dc34 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:13.686694 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd4e7e3-4e1a-4519-9fd3-2da33010dc34 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:13.687992 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 749/1485] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:50:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:50:13.694781 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04524c65-3e68-4ccb-aee8-f10ec327128a None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:13.695239 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04524c65-3e68-4ccb-aee8-f10ec327128a None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:13.695343 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04524c65-3e68-4ccb-aee8-f10ec327128a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:13.776710 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-04524c65-3e68-4ccb-aee8-f10ec327128a None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:50:13.777966 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-04524c65-3e68-4ccb-aee8-f10ec327128a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:13.894274 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 737/1486] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:50:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:50:14.182233 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd4e7e3-4e1a-4519-9fd3-2da33010dc34 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:14.183765 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-6dd4e7e3-4e1a-4519-9fd3-2da33010dc34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:14.300616 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd4e7e3-4e1a-4519-9fd3-2da33010dc34 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:14.387553 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:14.389404 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfbb54f-8d6e-46ce-b906-b5b6ad41b5b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:14.389991 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfbb54f-8d6e-46ce-b906-b5b6ad41b5b1 service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:14.390256 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfbb54f-8d6e-46ce-b906-b5b6ad41b5b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:14.390528 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfbb54f-8d6e-46ce-b906-b5b6ad41b5b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:14.393123 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-1cfbb54f-8d6e-46ce-b906-b5b6ad41b5b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:14.535119 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfbb54f-8d6e-46ce-b906-b5b6ad41b5b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:14.536566 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfbb54f-8d6e-46ce-b906-b5b6ad41b5b1 service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:14.555926 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 750/1487] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:50:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:50:16.892121 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf62f41-ce37-45d1-805d-9e5b5e406590 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:16.892753 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf62f41-ce37-45d1-805d-9e5b5e406590 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:16.892753 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf62f41-ce37-45d1-805d-9e5b5e406590 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:16.894043 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 738/1488] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:50:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:50:16.900338 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0435f57-6865-4cd8-8be0-beb9971b8fce None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:16.900791 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0435f57-6865-4cd8-8be0-beb9971b8fce None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:16.900900 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0435f57-6865-4cd8-8be0-beb9971b8fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:16.981636 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-c0435f57-6865-4cd8-8be0-beb9971b8fce None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:50:16.982848 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-c0435f57-6865-4cd8-8be0-beb9971b8fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:17.047024 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:17.096012 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 751/1489] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:50:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:50:17.397053 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf62f41-ce37-45d1-805d-9e5b5e406590 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:17.399564 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-dbf62f41-ce37-45d1-805d-9e5b5e406590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:17.440781 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:17.518962 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf62f41-ce37-45d1-805d-9e5b5e406590 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:17.605281 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e13602-636b-4baf-bd17-a477fe6e5287 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:17.605883 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e13602-636b-4baf-bd17-a477fe6e5287 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:17.606156 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e13602-636b-4baf-bd17-a477fe6e5287 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:17.606423 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e13602-636b-4baf-bd17-a477fe6e5287 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:17.608037 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-15e13602-636b-4baf-bd17-a477fe6e5287 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:17.698109 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:17.728289 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e13602-636b-4baf-bd17-a477fe6e5287 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:17.729758 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e13602-636b-4baf-bd17-a477fe6e5287 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:17.748158 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 739/1490] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:50:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:50:20.143160 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4728e46-ced0-4105-ad83-d908c5715ddb None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:20.144098 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4728e46-ced0-4105-ad83-d908c5715ddb None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:20.144098 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4728e46-ced0-4105-ad83-d908c5715ddb None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:20.146396 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 752/1491] 10.222.0.26 () {54 vars in 927 bytes} [Mon Sep 19 14:50:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:50:20.152885 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c3047-3787-426d-83f6-3e218e248ec3 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:20.153670 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c3047-3787-426d-83f6-3e218e248ec3 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:20.153767 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c3047-3787-426d-83f6-3e218e248ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:20.238909 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-a19c3047-3787-426d-83f6-3e218e248ec3 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:50:20.240133 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a19c3047-3787-426d-83f6-3e218e248ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:20.344257 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 740/1492] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Sep 19 14:50:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:50:20.649853 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4728e46-ced0-4105-ad83-d908c5715ddb None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:50:20.652330 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-a4728e46-ced0-4105-ad83-d908c5715ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:20.780398 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4728e46-ced0-4105-ad83-d908c5715ddb None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:50:20.863420 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a917a0-4569-48c2-a2f8-cf5978a23ecf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:50:20.864029 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a917a0-4569-48c2-a2f8-cf5978a23ecf service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:50:20.864301 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a917a0-4569-48c2-a2f8-cf5978a23ecf service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:50:20.864571 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a917a0-4569-48c2-a2f8-cf5978a23ecf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:50:20.866230 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-10a917a0-4569-48c2-a2f8-cf5978a23ecf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:50:20.875186 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:21.007828 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a917a0-4569-48c2-a2f8-cf5978a23ecf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:50:21.009308 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a917a0-4569-48c2-a2f8-cf5978a23ecf service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:50:21.028705 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 753/1493] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:50:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:50:30.342645 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=82 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:31.026139 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=50 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:34.953945 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23420980-a0d0-4f21-886f-599a40ee0641 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:34.954633 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23420980-a0d0-4f21-886f-599a40ee0641 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:34.954633 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23420980-a0d0-4f21-886f-599a40ee0641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:35.036315 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-23420980-a0d0-4f21-886f-599a40ee0641 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:51:35.037559 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-23420980-a0d0-4f21-886f-599a40ee0641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:51:35.139482 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 741/1494] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:51:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:51:35.148327 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94defe7d-2dbd-4692-a7ab-6597032cd7c0 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:35.148956 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94defe7d-2dbd-4692-a7ab-6597032cd7c0 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:35.148956 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94defe7d-2dbd-4692-a7ab-6597032cd7c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:35.233020 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-94defe7d-2dbd-4692-a7ab-6597032cd7c0 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:51:35.234206 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-94defe7d-2dbd-4692-a7ab-6597032cd7c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:51:35.339602 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 754/1495] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:51:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:51:35.344511 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23420980-a0d0-4f21-886f-599a40ee0641 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:35.345765 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-23420980-a0d0-4f21-886f-599a40ee0641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:51:35.357692 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23420980-a0d0-4f21-886f-599a40ee0641 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:35.423472 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:35.459877 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51e1d8f-fa53-4fce-9ea1-6a0484f1a14e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:35.460492 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e1d8f-fa53-4fce-9ea1-6a0484f1a14e admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:35.460766 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e1d8f-fa53-4fce-9ea1-6a0484f1a14e admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:35.461059 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e1d8f-fa53-4fce-9ea1-6a0484f1a14e admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:35.462013 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51e1d8f-fa53-4fce-9ea1-6a0484f1a14e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:51:35.462312 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51e1d8f-fa53-4fce-9ea1-6a0484f1a14e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:35.463332 dv-cinder-756709-7-smb devstack@keystone.service[81472]: WARNING py.warnings [None req-c51e1d8f-fa53-4fce-9ea1-6a0484f1a14e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 19 14:51:35.463332 dv-cinder-756709-7-smb devstack@keystone.service[81472]: warnings.warn(msg) Sep 19 14:51:35.463332 dv-cinder-756709-7-smb devstack@keystone.service[81472]: Sep 19 14:51:35.464216 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51e1d8f-fa53-4fce-9ea1-6a0484f1a14e admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:35.475923 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 742/1496] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 19 14:51:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:51:35.484915 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94defe7d-2dbd-4692-a7ab-6597032cd7c0 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:35.494746 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94defe7d-2dbd-4692-a7ab-6597032cd7c0 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:35.570877 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:35.611295 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8666359c-225a-41e0-8e51-9b1825dd9408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:35.612027 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8666359c-225a-41e0-8e51-9b1825dd9408 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:35.612295 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8666359c-225a-41e0-8e51-9b1825dd9408 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:35.612561 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8666359c-225a-41e0-8e51-9b1825dd9408 admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:35.613228 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8666359c-225a-41e0-8e51-9b1825dd9408 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:35.614989 dv-cinder-756709-7-smb devstack@keystone.service[81471]: WARNING py.warnings [None req-8666359c-225a-41e0-8e51-9b1825dd9408 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 14:51:35.614989 dv-cinder-756709-7-smb devstack@keystone.service[81471]: warnings.warn(msg) Sep 19 14:51:35.614989 dv-cinder-756709-7-smb devstack@keystone.service[81471]: Sep 19 14:51:35.616189 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8666359c-225a-41e0-8e51-9b1825dd9408 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:35.678223 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 755/1497] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 14:51:35 2022] POST /identity/v3/projects => generated 379 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:51:35.682652 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51e1d8f-fa53-4fce-9ea1-6a0484f1a14e admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:35.684333 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-c51e1d8f-fa53-4fce-9ea1-6a0484f1a14e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:51:35.718433 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51e1d8f-fa53-4fce-9ea1-6a0484f1a14e admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:35.821808 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e74081-9387-485a-a4d2-ca5f947ebd80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:35.822330 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e74081-9387-485a-a4d2-ca5f947ebd80 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:35.822612 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e74081-9387-485a-a4d2-ca5f947ebd80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:35.822882 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e74081-9387-485a-a4d2-ca5f947ebd80 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:35.823518 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e74081-9387-485a-a4d2-ca5f947ebd80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:35.824549 dv-cinder-756709-7-smb devstack@keystone.service[81472]: WARNING py.warnings [None req-b0e74081-9387-485a-a4d2-ca5f947ebd80 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 14:51:35.824549 dv-cinder-756709-7-smb devstack@keystone.service[81472]: warnings.warn(msg) Sep 19 14:51:35.824549 dv-cinder-756709-7-smb devstack@keystone.service[81472]: Sep 19 14:51:35.825786 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e74081-9387-485a-a4d2-ca5f947ebd80 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:35.880539 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 743/1498] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 14:51:35 2022] POST /identity/v3/users => generated 290 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:51:35.885238 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8666359c-225a-41e0-8e51-9b1825dd9408 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:35.886748 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-8666359c-225a-41e0-8e51-9b1825dd9408 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:51:35.955662 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8666359c-225a-41e0-8e51-9b1825dd9408 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:36.048367 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:36.059714 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91915801-3677-429c-930e-e4ab56016477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:36.060315 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91915801-3677-429c-930e-e4ab56016477 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:36.060593 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91915801-3677-429c-930e-e4ab56016477 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:36.060857 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91915801-3677-429c-930e-e4ab56016477 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:36.061598 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91915801-3677-429c-930e-e4ab56016477 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:36.063281 dv-cinder-756709-7-smb devstack@keystone.service[81471]: WARNING py.warnings [None req-91915801-3677-429c-930e-e4ab56016477 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 19 14:51:36.063281 dv-cinder-756709-7-smb devstack@keystone.service[81471]: warnings.warn(msg) Sep 19 14:51:36.063281 dv-cinder-756709-7-smb devstack@keystone.service[81471]: Sep 19 14:51:36.064167 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91915801-3677-429c-930e-e4ab56016477 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:36.077456 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 756/1499] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:51:35 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:51:36.083468 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e74081-9387-485a-a4d2-ca5f947ebd80 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:36.085564 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b0e74081-9387-485a-a4d2-ca5f947ebd80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:51:36.098357 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e74081-9387-485a-a4d2-ca5f947ebd80 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:36.124780 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:36.204206 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60d3b22-ae24-424f-b21c-c806744b5466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:36.204844 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60d3b22-ae24-424f-b21c-c806744b5466 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:36.205162 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60d3b22-ae24-424f-b21c-c806744b5466 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:36.205428 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60d3b22-ae24-424f-b21c-c806744b5466 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:36.206099 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60d3b22-ae24-424f-b21c-c806744b5466 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:36.215203 dv-cinder-756709-7-smb devstack@keystone.service[81472]: WARNING py.warnings [None req-d60d3b22-ae24-424f-b21c-c806744b5466 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 19 14:51:36.215203 dv-cinder-756709-7-smb devstack@keystone.service[81472]: warnings.warn(msg) Sep 19 14:51:36.215203 dv-cinder-756709-7-smb devstack@keystone.service[81472]: Sep 19 14:51:36.215203 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60d3b22-ae24-424f-b21c-c806744b5466 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:36.222114 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 744/1500] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:51:36 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:51:36.226628 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91915801-3677-429c-930e-e4ab56016477 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:36.228154 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-91915801-3677-429c-930e-e4ab56016477 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:51:36.263531 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91915801-3677-429c-930e-e4ab56016477 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:36.375634 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17e1781-7235-4e97-ab52-5df78e83cd45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:36.376208 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e1781-7235-4e97-ab52-5df78e83cd45 admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:36.376484 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e1781-7235-4e97-ab52-5df78e83cd45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:36.376750 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e1781-7235-4e97-ab52-5df78e83cd45 admin admin] PATH_INFO: `/v3/projects/33a8a1453d10430c900edf18f64ec7a8/users/e3284a45e9444c80b7336abeca1d77e6/roles/74de6794e3b3422b93d26f993d260c35` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:36.399223 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17e1781-7235-4e97-ab52-5df78e83cd45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33a8a1453d10430c900edf18f64ec7a8, user_id=e3284a45e9444c80b7336abeca1d77e6, role_id=74de6794e3b3422b93d26f993d260c35)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:36.400246 dv-cinder-756709-7-smb devstack@keystone.service[81471]: WARNING py.warnings [None req-a17e1781-7235-4e97-ab52-5df78e83cd45 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 14:51:36.400246 dv-cinder-756709-7-smb devstack@keystone.service[81471]: warnings.warn(msg) Sep 19 14:51:36.400246 dv-cinder-756709-7-smb devstack@keystone.service[81471]: Sep 19 14:51:36.402194 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17e1781-7235-4e97-ab52-5df78e83cd45 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:36.428525 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 757/1501] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 14:51:36 2022] PUT /identity/v3/projects/33a8a1453d10430c900edf18f64ec7a8/users/e3284a45e9444c80b7336abeca1d77e6/roles/74de6794e3b3422b93d26f993d260c35 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:51:36.441456 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c0355-cfe1-45b3-8ea9-b1b573f22bd8 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:36.441750 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c0355-cfe1-45b3-8ea9-b1b573f22bd8 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:36.442020 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c0355-cfe1-45b3-8ea9-b1b573f22bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:36.505878 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-0a7c0355-cfe1-45b3-8ea9-b1b573f22bd8 None None] MFA Rules not processed for user `e3284a45e9444c80b7336abeca1d77e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:51:36.507228 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-0a7c0355-cfe1-45b3-8ea9-b1b573f22bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:51:36.716340 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 745/1502] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:51:36 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:51:36.731072 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3391cf55-1e7d-4a04-9312-536303f18c09 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:36.731406 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3391cf55-1e7d-4a04-9312-536303f18c09 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:36.731812 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3391cf55-1e7d-4a04-9312-536303f18c09 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:36.733883 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 758/1503] 10.222.0.26 () {54 vars in 962 bytes} [Mon Sep 19 14:51:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:51:36.739467 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca0d4c2-26ea-4156-ba9d-a18c9e647747 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:36.739838 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca0d4c2-26ea-4156-ba9d-a18c9e647747 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:36.740147 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca0d4c2-26ea-4156-ba9d-a18c9e647747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:36.775159 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:36.823566 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-eca0d4c2-26ea-4156-ba9d-a18c9e647747 None None] MFA Rules not processed for user `df648c909ddb41418128b43f925f5ed4`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:51:36.824776 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-eca0d4c2-26ea-4156-ba9d-a18c9e647747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:51:36.906555 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 746/1504] 10.222.0.26 () {58 vars in 1059 bytes} [Mon Sep 19 14:51:36 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:51:36.914797 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3391cf55-1e7d-4a04-9312-536303f18c09 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:36.916341 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-3391cf55-1e7d-4a04-9312-536303f18c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:51:36.972593 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:37.047537 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3391cf55-1e7d-4a04-9312-536303f18c09 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:37.132436 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3422e6-ceed-4ed4-adb1-518a466be8e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df648c909ddb41418128b43f925f5ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:37.133065 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3422e6-ceed-4ed4-adb1-518a466be8e4 service cinder] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:37.133334 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3422e6-ceed-4ed4-adb1-518a466be8e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:37.133599 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3422e6-ceed-4ed4-adb1-518a466be8e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:37.135183 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-6f3422e6-ceed-4ed4-adb1-518a466be8e4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:51:37.233907 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3422e6-ceed-4ed4-adb1-518a466be8e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:37.235324 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3422e6-ceed-4ed4-adb1-518a466be8e4 service cinder] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:37.238824 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:37.253303 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 759/1505] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:51:36 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:51:37.302477 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870fd5a5-0dec-4b04-9889-9d299171ce40 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:37.302924 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870fd5a5-0dec-4b04-9889-9d299171ce40 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:37.303094 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870fd5a5-0dec-4b04-9889-9d299171ce40 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:37.304395 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 747/1506] 10.222.0.26 () {52 vars in 830 bytes} [Mon Sep 19 14:51:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:51:37.310287 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3422e6-ceed-4ed4-adb1-518a466be8e4 service cinder] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:37.312110 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-6f3422e6-ceed-4ed4-adb1-518a466be8e4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:51:37.421916 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3422e6-ceed-4ed4-adb1-518a466be8e4 service cinder] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:37.526369 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7744984f-e02e-4f6f-9c81-a48f54959181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:37.526909 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7744984f-e02e-4f6f-9c81-a48f54959181 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:37.527180 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7744984f-e02e-4f6f-9c81-a48f54959181 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:37.527444 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7744984f-e02e-4f6f-9c81-a48f54959181 admin admin] PATH_INFO: `/v3/users/e3284a45e9444c80b7336abeca1d77e6` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:37.542592 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7744984f-e02e-4f6f-9c81-a48f54959181 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3284a45e9444c80b7336abeca1d77e6)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:37.543618 dv-cinder-756709-7-smb devstack@keystone.service[81471]: WARNING py.warnings [None req-7744984f-e02e-4f6f-9c81-a48f54959181 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 14:51:37.543618 dv-cinder-756709-7-smb devstack@keystone.service[81471]: warnings.warn(msg) Sep 19 14:51:37.543618 dv-cinder-756709-7-smb devstack@keystone.service[81471]: Sep 19 14:51:37.545435 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7744984f-e02e-4f6f-9c81-a48f54959181 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:37.562036 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:37.631664 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-7744984f-e02e-4f6f-9c81-a48f54959181 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3284a45e9444c80b7336abeca1d77e6'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:51:37.644243 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-7744984f-e02e-4f6f-9c81-a48f54959181 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3284a45e9444c80b7336abeca1d77e6'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:51:37.645107 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-7744984f-e02e-4f6f-9c81-a48f54959181 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3284a45e9444c80b7336abeca1d77e6'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:51:37.645818 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-7744984f-e02e-4f6f-9c81-a48f54959181 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3284a45e9444c80b7336abeca1d77e6'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:51:37.674016 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-7744984f-e02e-4f6f-9c81-a48f54959181 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3284a45e9444c80b7336abeca1d77e6'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:51:37.694662 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 760/1507] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 14:51:37 2022] DELETE /identity/v3/users/e3284a45e9444c80b7336abeca1d77e6 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:51:37.699304 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c068d03-5b28-4943-98a1-e87e6582c461 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:37.699578 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c068d03-5b28-4943-98a1-e87e6582c461 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:37.699871 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c068d03-5b28-4943-98a1-e87e6582c461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:37.769960 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-9c068d03-5b28-4943-98a1-e87e6582c461 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:51:37.771156 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-9c068d03-5b28-4943-98a1-e87e6582c461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:51:37.853443 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:37.872944 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 748/1508] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:51:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:51:37.883016 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7744984f-e02e-4f6f-9c81-a48f54959181 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:37.884287 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-7744984f-e02e-4f6f-9c81-a48f54959181 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:51:37.997571 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7744984f-e02e-4f6f-9c81-a48f54959181 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:38.057304 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:38.079837 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec97d1e5-46b6-4de2-97e6-3cea4efdc52c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:38.080445 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec97d1e5-46b6-4de2-97e6-3cea4efdc52c service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:38.080728 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec97d1e5-46b6-4de2-97e6-3cea4efdc52c service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:38.081103 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec97d1e5-46b6-4de2-97e6-3cea4efdc52c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:38.082726 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-ec97d1e5-46b6-4de2-97e6-3cea4efdc52c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:51:38.201081 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec97d1e5-46b6-4de2-97e6-3cea4efdc52c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:38.202515 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec97d1e5-46b6-4de2-97e6-3cea4efdc52c service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:38.222952 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 761/1509] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:51:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:51:38.575335 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c068d03-5b28-4943-98a1-e87e6582c461 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:51:38.576574 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-9c068d03-5b28-4943-98a1-e87e6582c461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:51:38.588951 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c068d03-5b28-4943-98a1-e87e6582c461 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:51:38.705193 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b8d604-3452-4561-a266-c8b6971d30f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:51:38.705725 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b8d604-3452-4561-a266-c8b6971d30f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:51:38.706001 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b8d604-3452-4561-a266-c8b6971d30f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:51:38.706266 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b8d604-3452-4561-a266-c8b6971d30f0 admin admin] PATH_INFO: `/v3/projects/33a8a1453d10430c900edf18f64ec7a8` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:51:38.718148 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b8d604-3452-4561-a266-c8b6971d30f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33a8a1453d10430c900edf18f64ec7a8)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:51:38.719392 dv-cinder-756709-7-smb devstack@keystone.service[81472]: WARNING py.warnings [None req-97b8d604-3452-4561-a266-c8b6971d30f0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 14:51:38.719392 dv-cinder-756709-7-smb devstack@keystone.service[81472]: warnings.warn(msg) Sep 19 14:51:38.719392 dv-cinder-756709-7-smb devstack@keystone.service[81472]: Sep 19 14:51:38.720582 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b8d604-3452-4561-a266-c8b6971d30f0 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:51:38.785372 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-97b8d604-3452-4561-a266-c8b6971d30f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33a8a1453d10430c900edf18f64ec7a8', 'request_id': 'req-97b8d604-3452-4561-a266-c8b6971d30f0'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:51:38.799104 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-97b8d604-3452-4561-a266-c8b6971d30f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33a8a1453d10430c900edf18f64ec7a8', 'request_id': 'req-97b8d604-3452-4561-a266-c8b6971d30f0'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:51:38.809629 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-97b8d604-3452-4561-a266-c8b6971d30f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33a8a1453d10430c900edf18f64ec7a8', 'request_id': 'req-97b8d604-3452-4561-a266-c8b6971d30f0'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:51:38.833534 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-97b8d604-3452-4561-a266-c8b6971d30f0 admin admin] The token cache is being invalidate because project 33a8a1453d10430c900edf18f64ec7a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:51:38.833825 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-97b8d604-3452-4561-a266-c8b6971d30f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:51:38.834376 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-97b8d604-3452-4561-a266-c8b6971d30f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:51:38.835698 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 749/1510] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 14:51:38 2022] DELETE /identity/v3/projects/33a8a1453d10430c900edf18f64ec7a8 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:51:48.220293 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=62 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:48.831663 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:53:15.465158 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a198e0-baa3-40c9-80ce-2e16407b7c0e None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:53:15.465808 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a198e0-baa3-40c9-80ce-2e16407b7c0e None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:53:15.465808 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a198e0-baa3-40c9-80ce-2e16407b7c0e None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:53:15.467035 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 762/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 14:53:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:53:15.474062 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368fba69-14a8-46a5-920c-9e5ab1268613 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:53:15.474556 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368fba69-14a8-46a5-920c-9e5ab1268613 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:53:15.474921 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368fba69-14a8-46a5-920c-9e5ab1268613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:53:15.565237 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-368fba69-14a8-46a5-920c-9e5ab1268613 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:53:15.566527 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-368fba69-14a8-46a5-920c-9e5ab1268613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:53:15.684781 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 750/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 14:53:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:53:15.839232 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a198e0-baa3-40c9-80ce-2e16407b7c0e None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:53:15.843378 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-38a198e0-baa3-40c9-80ce-2e16407b7c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:53:15.981144 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a198e0-baa3-40c9-80ce-2e16407b7c0e None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:53:15.987576 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba4152f-d0d0-4a15-8546-ee29ba08c70e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3017e5d92bef4cc2aeae4f28c78ba233', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:53:15.988194 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba4152f-d0d0-4a15-8546-ee29ba08c70e service nova] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:53:15.988473 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba4152f-d0d0-4a15-8546-ee29ba08c70e service nova] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:53:15.988729 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba4152f-d0d0-4a15-8546-ee29ba08c70e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:53:15.998195 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba4152f-d0d0-4a15-8546-ee29ba08c70e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:53:15.999790 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba4152f-d0d0-4a15-8546-ee29ba08c70e service nova] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:53:16.010051 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 763/1513] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:53:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:53:17.108207 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f9b3e9-7dc7-4dde-83a2-572b233cd104 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:53:17.108764 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f9b3e9-7dc7-4dde-83a2-572b233cd104 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:53:17.108764 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f9b3e9-7dc7-4dde-83a2-572b233cd104 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:53:17.110074 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 751/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 14:53:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:53:17.116845 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7726e4-247b-4ed4-96c2-98eaed54546a None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:53:17.117341 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7726e4-247b-4ed4-96c2-98eaed54546a None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:53:17.117605 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7726e4-247b-4ed4-96c2-98eaed54546a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:53:17.144351 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-cc7726e4-247b-4ed4-96c2-98eaed54546a None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:53:17.146105 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-cc7726e4-247b-4ed4-96c2-98eaed54546a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:53:17.157702 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 764/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 14:53:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:53:17.313785 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f9b3e9-7dc7-4dde-83a2-572b233cd104 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:53:17.330517 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f9b3e9-7dc7-4dde-83a2-572b233cd104 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:53:17.336766 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d2c67f-1696-4c68-8af5-762d0af953fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3017e5d92bef4cc2aeae4f28c78ba233', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:53:17.337391 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d2c67f-1696-4c68-8af5-762d0af953fd service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:53:17.337665 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d2c67f-1696-4c68-8af5-762d0af953fd service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:53:17.337928 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d2c67f-1696-4c68-8af5-762d0af953fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:53:17.346807 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d2c67f-1696-4c68-8af5-762d0af953fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:53:17.348402 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d2c67f-1696-4c68-8af5-762d0af953fd service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:53:17.357584 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 752/1516] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:53:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:53:17.709659 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f0e1c-d13b-45bf-a9c9-0638a46511dd None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:53:17.709947 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f0e1c-d13b-45bf-a9c9-0638a46511dd None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:53:17.710196 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f0e1c-d13b-45bf-a9c9-0638a46511dd None None] PATH_INFO: `/v3` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:53:17.711879 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 765/1517] 10.222.0.67 () {54 vars in 925 bytes} [Mon Sep 19 14:53:17 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:53:17.718929 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba932c-38d2-441d-a85c-c3e4984b36df None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:53:17.719215 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba932c-38d2-441d-a85c-c3e4984b36df None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:53:17.719485 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba932c-38d2-441d-a85c-c3e4984b36df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:53:17.782759 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-c9ba932c-38d2-441d-a85c-c3e4984b36df None None] MFA Rules not processed for user `da0a58c526f34afda909e4ede2b1e1c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:53:17.784070 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-c9ba932c-38d2-441d-a85c-c3e4984b36df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:53:17.801972 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:53:17.859922 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 753/1518] 10.222.0.67 () {58 vars in 1015 bytes} [Mon Sep 19 14:53:17 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:53:21.528347 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a9047-c6df-4d4f-b8d7-04c845e9ddf8 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:53:21.528873 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a9047-c6df-4d4f-b8d7-04c845e9ddf8 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:53:21.528873 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a9047-c6df-4d4f-b8d7-04c845e9ddf8 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:53:21.530259 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 766/1519] 10.222.0.26 () {54 vars in 961 bytes} [Mon Sep 19 14:53:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 14:53:21.535637 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b29f896-7976-44c7-b861-6a7de20984b4 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:53:21.536081 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b29f896-7976-44c7-b861-6a7de20984b4 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:53:21.536190 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b29f896-7976-44c7-b861-6a7de20984b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:53:21.557032 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-8b29f896-7976-44c7-b861-6a7de20984b4 None None] MFA Rules not processed for user `da0a58c526f34afda909e4ede2b1e1c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:53:21.558231 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-8b29f896-7976-44c7-b861-6a7de20984b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:53:21.569463 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 754/1520] 10.222.0.26 () {58 vars in 1058 bytes} [Mon Sep 19 14:53:21 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:53:21.577748 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a9047-c6df-4d4f-b8d7-04c845e9ddf8 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:53:21.592828 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a9047-c6df-4d4f-b8d7-04c845e9ddf8 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:53:21.598881 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50786643-c5e2-4297-9332-aafef17aa197 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da0a58c526f34afda909e4ede2b1e1c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:53:21.599478 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50786643-c5e2-4297-9332-aafef17aa197 service placement] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:53:21.599795 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50786643-c5e2-4297-9332-aafef17aa197 service placement] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:53:21.600049 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50786643-c5e2-4297-9332-aafef17aa197 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:53:21.608984 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50786643-c5e2-4297-9332-aafef17aa197 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:53:21.610604 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50786643-c5e2-4297-9332-aafef17aa197 service placement] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:53:21.620656 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 767/1521] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:53:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:53:28.897486 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ed3a7-84f0-40be-9319-21df6eeefeed None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:53:28.898408 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ed3a7-84f0-40be-9319-21df6eeefeed None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:53:28.898408 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ed3a7-84f0-40be-9319-21df6eeefeed None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:53:28.900395 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 755/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 14:53:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:53:28.910413 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbebc8ad-80d2-4023-a93d-afa0a7c7a56e None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:53:28.910886 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbebc8ad-80d2-4023-a93d-afa0a7c7a56e None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:53:28.911091 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbebc8ad-80d2-4023-a93d-afa0a7c7a56e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:53:28.932069 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-dbebc8ad-80d2-4023-a93d-afa0a7c7a56e None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:53:28.933341 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-dbebc8ad-80d2-4023-a93d-afa0a7c7a56e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:53:28.943476 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 768/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 14:53:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:53:29.102349 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784ed3a7-84f0-40be-9319-21df6eeefeed None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:53:29.126544 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784ed3a7-84f0-40be-9319-21df6eeefeed None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:53:29.134071 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c104bc-2574-4fed-9efc-fafb245fbddb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3017e5d92bef4cc2aeae4f28c78ba233', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:53:29.134673 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c104bc-2574-4fed-9efc-fafb245fbddb service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:53:29.134942 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c104bc-2574-4fed-9efc-fafb245fbddb service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:53:29.135201 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c104bc-2574-4fed-9efc-fafb245fbddb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:53:29.144121 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c104bc-2574-4fed-9efc-fafb245fbddb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:53:29.145932 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c104bc-2574-4fed-9efc-fafb245fbddb service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:53:29.156124 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 756/1524] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:53:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:53:30.223785 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a87c5c2-7955-4538-80fe-e54a5dcb6632 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:53:30.224689 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a87c5c2-7955-4538-80fe-e54a5dcb6632 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:53:30.224689 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a87c5c2-7955-4538-80fe-e54a5dcb6632 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:53:30.226993 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 769/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 14:53:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:53:30.237368 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95bba94-73c4-4d51-b98c-9f5e7dbe8faf None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:53:30.238071 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95bba94-73c4-4d51-b98c-9f5e7dbe8faf None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:53:30.238739 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95bba94-73c4-4d51-b98c-9f5e7dbe8faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:53:30.259682 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-b95bba94-73c4-4d51-b98c-9f5e7dbe8faf None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:53:30.260795 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b95bba94-73c4-4d51-b98c-9f5e7dbe8faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:53:30.269423 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 757/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 14:53:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:53:30.424619 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a87c5c2-7955-4538-80fe-e54a5dcb6632 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:53:30.447172 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a87c5c2-7955-4538-80fe-e54a5dcb6632 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:53:30.453668 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb6c433-4a95-412d-80c6-38bdd69ac256 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3017e5d92bef4cc2aeae4f28c78ba233', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:53:30.454265 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb6c433-4a95-412d-80c6-38bdd69ac256 service nova] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:53:30.454535 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb6c433-4a95-412d-80c6-38bdd69ac256 service nova] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:53:30.454796 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb6c433-4a95-412d-80c6-38bdd69ac256 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:53:30.463402 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb6c433-4a95-412d-80c6-38bdd69ac256 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:53:30.464978 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb6c433-4a95-412d-80c6-38bdd69ac256 service nova] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:53:30.474589 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 770/1527] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:53:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:53:34.500174 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95460367-8d71-4378-8f76-1f5d7f41c41d None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:53:34.501114 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95460367-8d71-4378-8f76-1f5d7f41c41d None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:53:34.501114 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95460367-8d71-4378-8f76-1f5d7f41c41d None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:53:34.503329 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 758/1528] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 14:53:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:53:34.510317 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fd4a58-a89a-457d-9ba4-c3d5bcf5835e None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:53:34.511070 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fd4a58-a89a-457d-9ba4-c3d5bcf5835e None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:53:34.511252 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fd4a58-a89a-457d-9ba4-c3d5bcf5835e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:53:34.535700 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-b7fd4a58-a89a-457d-9ba4-c3d5bcf5835e None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:53:34.536823 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-b7fd4a58-a89a-457d-9ba4-c3d5bcf5835e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:53:34.548785 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 771/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 14:53:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:53:34.845753 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95460367-8d71-4378-8f76-1f5d7f41c41d None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:53:34.849231 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-95460367-8d71-4378-8f76-1f5d7f41c41d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:53:34.950775 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95460367-8d71-4378-8f76-1f5d7f41c41d None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:53:34.955221 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6d1233-a70f-42c9-b78d-8373d53bf875 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:53:34.955829 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d1233-a70f-42c9-b78d-8373d53bf875 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:53:34.956105 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d1233-a70f-42c9-b78d-8373d53bf875 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:53:34.956398 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d1233-a70f-42c9-b78d-8373d53bf875 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:53:34.967911 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6d1233-a70f-42c9-b78d-8373d53bf875 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:53:34.969377 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6d1233-a70f-42c9-b78d-8373d53bf875 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:53:34.979749 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 759/1530] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:53:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:53:37.128602 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4603a66-551c-4864-a575-a629e740ae8f None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:53:37.129358 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4603a66-551c-4864-a575-a629e740ae8f None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:53:37.129358 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4603a66-551c-4864-a575-a629e740ae8f None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:53:37.130642 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 772/1531] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 14:53:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:53:37.138465 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fbbddd-3dc3-47d4-8b40-810ac6e358d9 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:53:37.138942 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fbbddd-3dc3-47d4-8b40-810ac6e358d9 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:53:37.139050 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fbbddd-3dc3-47d4-8b40-810ac6e358d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:53:37.164243 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-20fbbddd-3dc3-47d4-8b40-810ac6e358d9 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:53:37.165478 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-20fbbddd-3dc3-47d4-8b40-810ac6e358d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:53:37.174742 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 760/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 14:53:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 14:53:37.464617 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4603a66-551c-4864-a575-a629e740ae8f None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:53:37.481682 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4603a66-551c-4864-a575-a629e740ae8f None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:53:37.487969 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e85b42f-a69e-45eb-8864-48aed208ed30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:53:37.488598 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e85b42f-a69e-45eb-8864-48aed208ed30 service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:53:37.488875 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e85b42f-a69e-45eb-8864-48aed208ed30 service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:53:37.489169 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e85b42f-a69e-45eb-8864-48aed208ed30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:53:37.498934 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e85b42f-a69e-45eb-8864-48aed208ed30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:53:37.500353 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e85b42f-a69e-45eb-8864-48aed208ed30 service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:53:37.510187 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 773/1533] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:53:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:53:41.105373 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd713fe-a8d7-41f2-8918-258210bf74de None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:53:41.106306 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd713fe-a8d7-41f2-8918-258210bf74de None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:53:41.106306 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd713fe-a8d7-41f2-8918-258210bf74de None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:53:41.108431 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 761/1534] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 14:53:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:53:41.113993 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc60fa33-b655-464c-a698-f866c3c6f338 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:53:41.114479 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc60fa33-b655-464c-a698-f866c3c6f338 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:53:41.114479 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc60fa33-b655-464c-a698-f866c3c6f338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:53:41.122975 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=81 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:53:41.136842 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-cc60fa33-b655-464c-a698-f866c3c6f338 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:53:41.138066 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-cc60fa33-b655-464c-a698-f866c3c6f338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:53:41.146502 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 774/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 14:53:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:53:41.472572 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd713fe-a8d7-41f2-8918-258210bf74de None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:53:41.475993 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-3bd713fe-a8d7-41f2-8918-258210bf74de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:53:41.549312 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:53:41.564010 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd713fe-a8d7-41f2-8918-258210bf74de None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:53:41.568114 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ce19c8-882e-4f8b-befa-9531790861c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df648c909ddb41418128b43f925f5ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:53:41.568815 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce19c8-882e-4f8b-befa-9531790861c1 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:53:41.569136 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce19c8-882e-4f8b-befa-9531790861c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:53:41.569398 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce19c8-882e-4f8b-befa-9531790861c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:53:41.578693 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ce19c8-882e-4f8b-befa-9531790861c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:53:41.580119 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ce19c8-882e-4f8b-befa-9531790861c1 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:53:41.589907 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 762/1536] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:53:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:53:43.748404 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1736c3-ab4c-476f-b6b8-3514a7adfb13 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:53:43.749355 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1736c3-ab4c-476f-b6b8-3514a7adfb13 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:53:43.749355 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1736c3-ab4c-476f-b6b8-3514a7adfb13 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:53:43.751552 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 775/1537] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 14:53:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:53:43.760923 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb82234-ba87-4308-8b0e-d0bd3ba12d1f None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:53:43.761403 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb82234-ba87-4308-8b0e-d0bd3ba12d1f None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:53:43.761511 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb82234-ba87-4308-8b0e-d0bd3ba12d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:53:43.784969 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-9cb82234-ba87-4308-8b0e-d0bd3ba12d1f None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:53:43.786197 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-9cb82234-ba87-4308-8b0e-d0bd3ba12d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:53:43.795385 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 763/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 14:53:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:53:44.101933 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1736c3-ab4c-476f-b6b8-3514a7adfb13 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:53:44.104914 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-3a1736c3-ab4c-476f-b6b8-3514a7adfb13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:53:44.127858 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1736c3-ab4c-476f-b6b8-3514a7adfb13 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:53:44.133011 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3828442e-2757-4e7b-88c7-d83d0803c96e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df648c909ddb41418128b43f925f5ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:53:44.133621 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3828442e-2757-4e7b-88c7-d83d0803c96e service cinder] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:53:44.133896 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3828442e-2757-4e7b-88c7-d83d0803c96e service cinder] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:53:44.134167 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3828442e-2757-4e7b-88c7-d83d0803c96e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:53:44.146231 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3828442e-2757-4e7b-88c7-d83d0803c96e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:53:44.148368 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3828442e-2757-4e7b-88c7-d83d0803c96e service cinder] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:53:44.158584 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 776/1539] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:53:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:53:53.779750 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=11 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:53:54.154399 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=8 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:55:20.864346 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d947e-eb07-433c-865f-a0d2daae3206 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:20.868434 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d947e-eb07-433c-865f-a0d2daae3206 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:20.868434 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d947e-eb07-433c-865f-a0d2daae3206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:20.898317 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-061d947e-eb07-433c-865f-a0d2daae3206 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:55:20.900139 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-061d947e-eb07-433c-865f-a0d2daae3206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:20.913910 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 764/1540] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:55:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 14:55:20.924882 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5093da44-df12-456b-953d-f94e69bce9a2 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:20.926023 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5093da44-df12-456b-953d-f94e69bce9a2 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:20.926506 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5093da44-df12-456b-953d-f94e69bce9a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:20.959070 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-5093da44-df12-456b-953d-f94e69bce9a2 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:55:20.961237 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-5093da44-df12-456b-953d-f94e69bce9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:20.974742 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 777/1541] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:55:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:55:20.980967 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061d947e-eb07-433c-865f-a0d2daae3206 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:21.007915 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061d947e-eb07-433c-865f-a0d2daae3206 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:21.014138 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e743cce-fc16-4b19-a3d6-2ff97622e0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:21.014770 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e743cce-fc16-4b19-a3d6-2ff97622e0e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:21.015046 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e743cce-fc16-4b19-a3d6-2ff97622e0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:21.015314 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e743cce-fc16-4b19-a3d6-2ff97622e0e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:21.015967 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e743cce-fc16-4b19-a3d6-2ff97622e0e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:55:21.016261 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e743cce-fc16-4b19-a3d6-2ff97622e0e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:21.017912 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e743cce-fc16-4b19-a3d6-2ff97622e0e5 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:21.036930 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 765/1542] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 19 14:55:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:55:21.047092 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5093da44-df12-456b-953d-f94e69bce9a2 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:21.059931 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5093da44-df12-456b-953d-f94e69bce9a2 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:21.073423 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d6796-2380-44eb-a9f3-b15f6c48d5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:21.074050 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d6796-2380-44eb-a9f3-b15f6c48d5ce admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:21.074390 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d6796-2380-44eb-a9f3-b15f6c48d5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:21.074654 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d6796-2380-44eb-a9f3-b15f6c48d5ce admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:21.076003 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6d6796-2380-44eb-a9f3-b15f6c48d5ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:21.077985 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6d6796-2380-44eb-a9f3-b15f6c48d5ce admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:21.163984 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 778/1543] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 14:55:21 2022] POST /identity/v3/projects => generated 365 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:55:21.170136 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e743cce-fc16-4b19-a3d6-2ff97622e0e5 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:21.190201 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e743cce-fc16-4b19-a3d6-2ff97622e0e5 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:21.220504 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7d6874-a847-4150-ae67-eda7f35baf4f None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:21.220861 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7d6874-a847-4150-ae67-eda7f35baf4f None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:21.221096 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7d6874-a847-4150-ae67-eda7f35baf4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:21.250986 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-ca7d6874-a847-4150-ae67-eda7f35baf4f None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:55:21.252436 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-ca7d6874-a847-4150-ae67-eda7f35baf4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:21.305380 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449b9d69-2dab-4028-881c-bd222c126491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:21.306466 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b9d69-2dab-4028-881c-bd222c126491 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:21.307028 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b9d69-2dab-4028-881c-bd222c126491 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:21.307311 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b9d69-2dab-4028-881c-bd222c126491 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:21.307962 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449b9d69-2dab-4028-881c-bd222c126491 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:21.312480 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449b9d69-2dab-4028-881c-bd222c126491 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:21.372870 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 766/1544] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 14:55:21 2022] POST /identity/v3/users => generated 283 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:55:21.374842 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393337e2-8e47-41d0-a778-6981e6a4eeeb None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:21.375129 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393337e2-8e47-41d0-a778-6981e6a4eeeb None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:21.375387 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393337e2-8e47-41d0-a778-6981e6a4eeeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:21.418713 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-393337e2-8e47-41d0-a778-6981e6a4eeeb None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:55:21.419899 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-393337e2-8e47-41d0-a778-6981e6a4eeeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:21.427829 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 779/1545] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:55:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:55:21.429768 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b3b4c-d6c6-47d3-b08a-d912132cff0a None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:21.432204 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b3b4c-d6c6-47d3-b08a-d912132cff0a None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:21.432897 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b3b4c-d6c6-47d3-b08a-d912132cff0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:21.442675 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 767/1546] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:55:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:55:21.443294 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393337e2-8e47-41d0-a778-6981e6a4eeeb None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:21.491115 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393337e2-8e47-41d0-a778-6981e6a4eeeb None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:21.509292 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-c68b3b4c-d6c6-47d3-b08a-d912132cff0a None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:55:21.511380 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-c68b3b4c-d6c6-47d3-b08a-d912132cff0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:21.514640 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e766b88-49b1-43f1-b4b1-b8b240794c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:21.515583 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e766b88-49b1-43f1-b4b1-b8b240794c70 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:21.516024 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e766b88-49b1-43f1-b4b1-b8b240794c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:21.516464 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e766b88-49b1-43f1-b4b1-b8b240794c70 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:21.517583 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e766b88-49b1-43f1-b4b1-b8b240794c70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:21.519542 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e766b88-49b1-43f1-b4b1-b8b240794c70 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:21.525665 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 780/1547] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:55:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:55:21.527589 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe620da8-027b-4128-be0a-147d8ee54742 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:21.533383 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe620da8-027b-4128-be0a-147d8ee54742 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:21.534132 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe620da8-027b-4128-be0a-147d8ee54742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:21.537497 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 768/1548] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:55:21 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:55:21.540019 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b64280-7221-4748-b878-2d21d7b44417 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:21.540311 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b64280-7221-4748-b878-2d21d7b44417 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:21.540621 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b64280-7221-4748-b878-2d21d7b44417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:21.564242 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-c1b64280-7221-4748-b878-2d21d7b44417 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:55:21.565473 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-c1b64280-7221-4748-b878-2d21d7b44417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:21.571142 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-fe620da8-027b-4128-be0a-147d8ee54742 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:55:21.573413 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-fe620da8-027b-4128-be0a-147d8ee54742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:21.579383 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 769/1549] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:55:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:55:21.580813 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066ecf9-00ad-49c3-84e1-0dfc920f782a None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:21.581118 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066ecf9-00ad-49c3-84e1-0dfc920f782a None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:21.581386 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066ecf9-00ad-49c3-84e1-0dfc920f782a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:21.590812 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 781/1550] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:55:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:55:21.592112 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4470b889-cd30-4c45-8b7d-2bd11f4284da None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:21.592396 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4470b889-cd30-4c45-8b7d-2bd11f4284da None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:21.592668 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4470b889-cd30-4c45-8b7d-2bd11f4284da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:21.603515 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-b066ecf9-00ad-49c3-84e1-0dfc920f782a None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:55:21.604787 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b066ecf9-00ad-49c3-84e1-0dfc920f782a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:21.614169 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 770/1551] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:55:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:55:21.615270 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-4470b889-cd30-4c45-8b7d-2bd11f4284da None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:55:21.616235 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f51c2c-0057-4046-8e10-d107906b8223 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:21.616608 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f51c2c-0057-4046-8e10-d107906b8223 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:21.617145 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f51c2c-0057-4046-8e10-d107906b8223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:21.617365 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-4470b889-cd30-4c45-8b7d-2bd11f4284da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:21.632751 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 782/1552] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:55:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:55:21.634362 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f088a-3e51-47cc-8d4f-50598c0d7935 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:21.634644 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f088a-3e51-47cc-8d4f-50598c0d7935 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:21.635015 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f088a-3e51-47cc-8d4f-50598c0d7935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:21.647617 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-31f51c2c-0057-4046-8e10-d107906b8223 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:55:21.650950 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-31f51c2c-0057-4046-8e10-d107906b8223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:21.656162 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-fe3f088a-3e51-47cc-8d4f-50598c0d7935 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:55:21.657417 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-fe3f088a-3e51-47cc-8d4f-50598c0d7935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:21.661106 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 771/1553] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:55:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:55:21.662107 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f51c2c-0057-4046-8e10-d107906b8223 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:21.677535 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 783/1554] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:55:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:55:21.677535 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8a6241-7eb9-497a-ac87-14239c96161b None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:21.677535 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8a6241-7eb9-497a-ac87-14239c96161b None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:21.677535 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8a6241-7eb9-497a-ac87-14239c96161b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:21.678266 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f51c2c-0057-4046-8e10-d107906b8223 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:21.683646 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dc3dca-d18e-4e5a-9282-6c7112ee70ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:21.684268 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc3dca-d18e-4e5a-9282-6c7112ee70ac admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:21.684766 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc3dca-d18e-4e5a-9282-6c7112ee70ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:21.685039 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc3dca-d18e-4e5a-9282-6c7112ee70ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:21.685700 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dc3dca-d18e-4e5a-9282-6c7112ee70ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:21.687924 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dc3dca-d18e-4e5a-9282-6c7112ee70ac admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:21.698362 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-ff8a6241-7eb9-497a-ac87-14239c96161b None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:55:21.699597 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-ff8a6241-7eb9-497a-ac87-14239c96161b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:21.700706 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 772/1555] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:55:21 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:55:21.702270 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a43dc1-f3eb-4af8-8125-4523928a38e5 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:21.702697 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a43dc1-f3eb-4af8-8125-4523928a38e5 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:21.703186 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a43dc1-f3eb-4af8-8125-4523928a38e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:21.710250 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 784/1556] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:55:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:55:21.711171 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8a6241-7eb9-497a-ac87-14239c96161b None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:21.724051 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8a6241-7eb9-497a-ac87-14239c96161b None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:21.725899 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-52a43dc1-f3eb-4af8-8125-4523928a38e5 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:55:21.727402 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-52a43dc1-f3eb-4af8-8125-4523928a38e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:21.729939 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f898bd-41ce-4cae-a61d-af98e1cd0225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:21.730962 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f898bd-41ce-4cae-a61d-af98e1cd0225 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:21.731468 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f898bd-41ce-4cae-a61d-af98e1cd0225 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:21.731961 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f898bd-41ce-4cae-a61d-af98e1cd0225 admin admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:21.733015 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f898bd-41ce-4cae-a61d-af98e1cd0225 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:55:21.733503 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f898bd-41ce-4cae-a61d-af98e1cd0225 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:21.734694 dv-cinder-756709-7-smb devstack@keystone.service[81471]: WARNING py.warnings [None req-05f898bd-41ce-4cae-a61d-af98e1cd0225 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 19 14:55:21.734694 dv-cinder-756709-7-smb devstack@keystone.service[81471]: warnings.warn(msg) Sep 19 14:55:21.734694 dv-cinder-756709-7-smb devstack@keystone.service[81471]: Sep 19 14:55:21.735629 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f898bd-41ce-4cae-a61d-af98e1cd0225 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:21.737061 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 773/1557] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:55:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:55:21.738501 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a43dc1-f3eb-4af8-8125-4523928a38e5 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:21.750641 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a43dc1-f3eb-4af8-8125-4523928a38e5 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:21.754432 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 785/1558] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 19 14:55:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:55:21.756008 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfcff41-1efb-43bb-a05f-909845d3d273 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:21.756298 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfcff41-1efb-43bb-a05f-909845d3d273 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:21.756599 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfcff41-1efb-43bb-a05f-909845d3d273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:21.763103 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda0bb93-c59e-4ef9-afda-f9aed117d0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:21.764115 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda0bb93-c59e-4ef9-afda-f9aed117d0f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:21.764501 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda0bb93-c59e-4ef9-afda-f9aed117d0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:21.765073 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda0bb93-c59e-4ef9-afda-f9aed117d0f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:21.765872 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda0bb93-c59e-4ef9-afda-f9aed117d0f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:55:21.766280 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda0bb93-c59e-4ef9-afda-f9aed117d0f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:21.768834 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda0bb93-c59e-4ef9-afda-f9aed117d0f3 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:21.785307 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-1bfcff41-1efb-43bb-a05f-909845d3d273 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:55:21.787129 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-1bfcff41-1efb-43bb-a05f-909845d3d273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:21.797780 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 774/1559] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 19 14:55:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:55:21.797780 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61423a45-0321-4c6a-8e24-9fdffcdb0188 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:21.797780 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61423a45-0321-4c6a-8e24-9fdffcdb0188 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:21.797780 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61423a45-0321-4c6a-8e24-9fdffcdb0188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:21.799717 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 786/1560] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:55:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:55:21.802371 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7610c142-b833-4161-83e0-632fe52496e3 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:21.802813 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7610c142-b833-4161-83e0-632fe52496e3 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:21.803239 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7610c142-b833-4161-83e0-632fe52496e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:21.824110 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-61423a45-0321-4c6a-8e24-9fdffcdb0188 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:55:21.826437 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-61423a45-0321-4c6a-8e24-9fdffcdb0188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:21.834461 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-7610c142-b833-4161-83e0-632fe52496e3 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:55:21.835305 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 775/1561] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:55:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:55:21.835983 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-7610c142-b833-4161-83e0-632fe52496e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:21.836164 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61423a45-0321-4c6a-8e24-9fdffcdb0188 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:21.846426 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61423a45-0321-4c6a-8e24-9fdffcdb0188 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:21.850846 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 787/1562] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:55:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:55:21.851577 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2944d4c-c477-4d79-975c-c52398eddb27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:21.851816 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7610c142-b833-4161-83e0-632fe52496e3 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:21.851935 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2944d4c-c477-4d79-975c-c52398eddb27 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:21.852118 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2944d4c-c477-4d79-975c-c52398eddb27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:21.852461 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2944d4c-c477-4d79-975c-c52398eddb27 admin admin] PATH_INFO: `/v3/projects/b39001af10bd401d939dad33af8da45d/users/6de02da8424b46019a3ea0e73e8e0937/roles/74de6794e3b3422b93d26f993d260c35` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:21.864817 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7610c142-b833-4161-83e0-632fe52496e3 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:21.869898 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2944d4c-c477-4d79-975c-c52398eddb27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b39001af10bd401d939dad33af8da45d, user_id=6de02da8424b46019a3ea0e73e8e0937, role_id=74de6794e3b3422b93d26f993d260c35)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:21.870469 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34f0199-2ef7-4928-a823-90251b430063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:21.870659 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f0199-2ef7-4928-a823-90251b430063 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:21.870943 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f0199-2ef7-4928-a823-90251b430063 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:21.871043 dv-cinder-756709-7-smb devstack@keystone.service[81472]: WARNING py.warnings [None req-e2944d4c-c477-4d79-975c-c52398eddb27 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 14:55:21.871043 dv-cinder-756709-7-smb devstack@keystone.service[81472]: warnings.warn(msg) Sep 19 14:55:21.871043 dv-cinder-756709-7-smb devstack@keystone.service[81472]: Sep 19 14:55:21.871311 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f0199-2ef7-4928-a823-90251b430063 admin admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:21.871844 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34f0199-2ef7-4928-a823-90251b430063 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:55:21.872146 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34f0199-2ef7-4928-a823-90251b430063 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:21.873396 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2944d4c-c477-4d79-975c-c52398eddb27 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:21.873787 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34f0199-2ef7-4928-a823-90251b430063 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:21.890314 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 776/1563] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 14:55:21 2022] PUT /identity/v3/projects/b39001af10bd401d939dad33af8da45d/users/6de02da8424b46019a3ea0e73e8e0937/roles/74de6794e3b3422b93d26f993d260c35 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:55:21.901302 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2944d4c-c477-4d79-975c-c52398eddb27 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:21.901451 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 788/1564] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 19 14:55:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:55:21.901451 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34f0199-2ef7-4928-a823-90251b430063 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:21.910077 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34f0199-2ef7-4928-a823-90251b430063 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:21.934929 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:55:21.971522 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:55:21.975061 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2944d4c-c477-4d79-975c-c52398eddb27 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:21.980766 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03619c73-cbfc-482a-a566-e71ced558f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:21.981415 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03619c73-cbfc-482a-a566-e71ced558f27 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:21.981693 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03619c73-cbfc-482a-a566-e71ced558f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:21.981990 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03619c73-cbfc-482a-a566-e71ced558f27 admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:21.982604 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03619c73-cbfc-482a-a566-e71ced558f27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:55:21.982897 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03619c73-cbfc-482a-a566-e71ced558f27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:21.984526 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03619c73-cbfc-482a-a566-e71ced558f27 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:21.990586 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86f33c8-025d-4c7d-b116-190a0f6188b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:21.990586 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f33c8-025d-4c7d-b116-190a0f6188b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:21.990586 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f33c8-025d-4c7d-b116-190a0f6188b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:21.990586 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f33c8-025d-4c7d-b116-190a0f6188b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:21.991028 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86f33c8-025d-4c7d-b116-190a0f6188b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:21.991028 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86f33c8-025d-4c7d-b116-190a0f6188b9 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:22.012831 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 777/1565] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 19 14:55:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:55:22.014150 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03619c73-cbfc-482a-a566-e71ced558f27 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:22.026659 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 789/1566] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 14:55:21 2022] POST /identity/v3/projects => generated 389 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:55:22.027643 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86f33c8-025d-4c7d-b116-190a0f6188b9 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:22.027925 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03619c73-cbfc-482a-a566-e71ced558f27 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:22.091021 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5664d20b-6935-4263-9fd6-108f91b84171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:22.091624 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5664d20b-6935-4263-9fd6-108f91b84171 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:22.091906 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5664d20b-6935-4263-9fd6-108f91b84171 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:22.092186 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5664d20b-6935-4263-9fd6-108f91b84171 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:22.092806 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5664d20b-6935-4263-9fd6-108f91b84171 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:22.093884 dv-cinder-756709-7-smb devstack@keystone.service[81472]: WARNING py.warnings [None req-5664d20b-6935-4263-9fd6-108f91b84171 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 14:55:22.093884 dv-cinder-756709-7-smb devstack@keystone.service[81472]: warnings.warn(msg) Sep 19 14:55:22.093884 dv-cinder-756709-7-smb devstack@keystone.service[81472]: Sep 19 14:55:22.095397 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5664d20b-6935-4263-9fd6-108f91b84171 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:22.100587 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86f33c8-025d-4c7d-b116-190a0f6188b9 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:22.107091 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35e4449-4fa3-4c11-a401-c35d0b165cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:22.107774 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35e4449-4fa3-4c11-a401-c35d0b165cc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:22.108103 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35e4449-4fa3-4c11-a401-c35d0b165cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:22.108413 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35e4449-4fa3-4c11-a401-c35d0b165cc3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:22.109241 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35e4449-4fa3-4c11-a401-c35d0b165cc3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:55:22.109565 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35e4449-4fa3-4c11-a401-c35d0b165cc3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:22.111401 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35e4449-4fa3-4c11-a401-c35d0b165cc3 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:22.128299 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 790/1567] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 19 14:55:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:55:22.131091 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 778/1568] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 14:55:22 2022] POST /identity/v3/projects => generated 373 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:55:22.132232 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5664d20b-6935-4263-9fd6-108f91b84171 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:22.138373 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35e4449-4fa3-4c11-a401-c35d0b165cc3 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:22.150527 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35e4449-4fa3-4c11-a401-c35d0b165cc3 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:22.204841 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5664d20b-6935-4263-9fd6-108f91b84171 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:22.210439 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7e1cd6-7efd-48f1-83da-f4dcb29416a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:22.211092 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e1cd6-7efd-48f1-83da-f4dcb29416a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:22.211374 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e1cd6-7efd-48f1-83da-f4dcb29416a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:22.211640 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e1cd6-7efd-48f1-83da-f4dcb29416a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:22.212539 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7e1cd6-7efd-48f1-83da-f4dcb29416a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:55:22.212842 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7e1cd6-7efd-48f1-83da-f4dcb29416a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:22.214650 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7e1cd6-7efd-48f1-83da-f4dcb29416a0 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:22.219588 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a55524-5765-4fbd-9e9b-7795aa064bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:22.220218 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a55524-5765-4fbd-9e9b-7795aa064bb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:22.220471 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a55524-5765-4fbd-9e9b-7795aa064bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:22.220737 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a55524-5765-4fbd-9e9b-7795aa064bb8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:22.221414 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a55524-5765-4fbd-9e9b-7795aa064bb8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:55:22.221714 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a55524-5765-4fbd-9e9b-7795aa064bb8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:22.223799 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a55524-5765-4fbd-9e9b-7795aa064bb8 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:22.227481 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 779/1569] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 19 14:55:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:55:22.228750 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d05a8b-3f95-4428-822b-110e5bf5df16 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:22.229067 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d05a8b-3f95-4428-822b-110e5bf5df16 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:22.229346 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d05a8b-3f95-4428-822b-110e5bf5df16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:22.237197 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 791/1570] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 19 14:55:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:55:22.238336 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a55524-5765-4fbd-9e9b-7795aa064bb8 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:22.248112 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a55524-5765-4fbd-9e9b-7795aa064bb8 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:22.252827 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dd28cc-47d6-4366-a7e3-9cf1c7a0a116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:22.253466 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd28cc-47d6-4366-a7e3-9cf1c7a0a116 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:22.253743 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd28cc-47d6-4366-a7e3-9cf1c7a0a116 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:22.254009 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd28cc-47d6-4366-a7e3-9cf1c7a0a116 admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:22.254636 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dd28cc-47d6-4366-a7e3-9cf1c7a0a116 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:22.256683 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dd28cc-47d6-4366-a7e3-9cf1c7a0a116 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:22.260713 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-34d05a8b-3f95-4428-822b-110e5bf5df16 None None] MFA Rules not processed for user `6de02da8424b46019a3ea0e73e8e0937`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:55:22.262265 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-34d05a8b-3f95-4428-822b-110e5bf5df16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:22.286436 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 792/1571] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 14:55:22 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:55:22.287244 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dd28cc-47d6-4366-a7e3-9cf1c7a0a116 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:22.299273 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:55:22.332547 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 780/1572] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:55:22 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:55:22.333479 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d05a8b-3f95-4428-822b-110e5bf5df16 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:22.341872 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:55:22.345254 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d05a8b-3f95-4428-822b-110e5bf5df16 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:22.363060 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dd28cc-47d6-4366-a7e3-9cf1c7a0a116 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:22.373518 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c642ca4f-0f0b-4121-b145-8f1e4d501ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:22.374193 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c642ca4f-0f0b-4121-b145-8f1e4d501ee2 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:22.374470 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c642ca4f-0f0b-4121-b145-8f1e4d501ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:22.374735 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c642ca4f-0f0b-4121-b145-8f1e4d501ee2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:22.375452 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c642ca4f-0f0b-4121-b145-8f1e4d501ee2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:22.377404 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c642ca4f-0f0b-4121-b145-8f1e4d501ee2 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:22.406733 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bff494-da1b-423e-9f2f-d91eee4184bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:22.407345 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bff494-da1b-423e-9f2f-d91eee4184bb admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:22.407618 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bff494-da1b-423e-9f2f-d91eee4184bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:22.407890 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bff494-da1b-423e-9f2f-d91eee4184bb admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:22.408187 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 793/1573] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 14:55:22 2022] POST /identity/v3/projects => generated 385 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:55:22.408512 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bff494-da1b-423e-9f2f-d91eee4184bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:22.409916 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c642ca4f-0f0b-4121-b145-8f1e4d501ee2 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:22.410673 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bff494-da1b-423e-9f2f-d91eee4184bb admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:22.434302 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 781/1574] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 14:55:22 2022] POST /identity/v3/users => generated 295 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:55:22.435125 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bff494-da1b-423e-9f2f-d91eee4184bb admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:22.444596 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bff494-da1b-423e-9f2f-d91eee4184bb admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:22.490468 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c642ca4f-0f0b-4121-b145-8f1e4d501ee2 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:22.495869 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73366a38-4e7a-4ea8-8dc2-9ae2bae62a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:22.496560 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73366a38-4e7a-4ea8-8dc2-9ae2bae62a0a admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:22.496844 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73366a38-4e7a-4ea8-8dc2-9ae2bae62a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:22.497223 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73366a38-4e7a-4ea8-8dc2-9ae2bae62a0a admin admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:22.506210 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73366a38-4e7a-4ea8-8dc2-9ae2bae62a0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:22.506210 dv-cinder-756709-7-smb devstack@keystone.service[81471]: WARNING py.warnings [None req-73366a38-4e7a-4ea8-8dc2-9ae2bae62a0a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 14:55:22.506210 dv-cinder-756709-7-smb devstack@keystone.service[81471]: warnings.warn(msg) Sep 19 14:55:22.506210 dv-cinder-756709-7-smb devstack@keystone.service[81471]: Sep 19 14:55:22.506210 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73366a38-4e7a-4ea8-8dc2-9ae2bae62a0a admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:22.515687 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd2e01-bb60-4140-bec4-e70c2f6f71d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:22.516404 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd2e01-bb60-4140-bec4-e70c2f6f71d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:22.517288 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd2e01-bb60-4140-bec4-e70c2f6f71d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:22.517288 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd2e01-bb60-4140-bec4-e70c2f6f71d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:22.517740 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dd2e01-bb60-4140-bec4-e70c2f6f71d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:22.519709 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dd2e01-bb60-4140-bec4-e70c2f6f71d5 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:22.526366 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 794/1575] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 14:55:22 2022] POST /identity/v3/users => generated 287 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:55:22.527659 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73366a38-4e7a-4ea8-8dc2-9ae2bae62a0a admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:22.540449 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73366a38-4e7a-4ea8-8dc2-9ae2bae62a0a admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:22.545705 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adb8428-1e8a-4702-ad99-52e479446d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:22.546471 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb8428-1e8a-4702-ad99-52e479446d5d admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:22.546746 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb8428-1e8a-4702-ad99-52e479446d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:22.547012 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb8428-1e8a-4702-ad99-52e479446d5d admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:22.548067 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adb8428-1e8a-4702-ad99-52e479446d5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:22.549562 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adb8428-1e8a-4702-ad99-52e479446d5d admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:22.553238 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 782/1576] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 14:55:22 2022] POST /identity/v3/projects => generated 391 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:55:22.554075 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd2e01-bb60-4140-bec4-e70c2f6f71d5 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:22.582932 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 795/1577] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 14:55:22 2022] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:55:22.582932 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adb8428-1e8a-4702-ad99-52e479446d5d admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:22.607359 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:55:22.621318 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd2e01-bb60-4140-bec4-e70c2f6f71d5 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:22.644813 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adb8428-1e8a-4702-ad99-52e479446d5d admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:22.649479 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d5c403-3bbc-43cd-8cbe-7f89c776390b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:22.650075 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5c403-3bbc-43cd-8cbe-7f89c776390b admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:22.650353 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5c403-3bbc-43cd-8cbe-7f89c776390b admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:22.650616 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5c403-3bbc-43cd-8cbe-7f89c776390b admin admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:22.651888 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d5c403-3bbc-43cd-8cbe-7f89c776390b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:22.653874 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d5c403-3bbc-43cd-8cbe-7f89c776390b admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:22.680513 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 796/1578] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 14:55:22 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:55:22.680513 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d5c403-3bbc-43cd-8cbe-7f89c776390b admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:22.680823 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ee390f-faa5-4966-ba6b-3dba57a1c140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:22.680823 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee390f-faa5-4966-ba6b-3dba57a1c140 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:22.680823 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee390f-faa5-4966-ba6b-3dba57a1c140 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:22.680823 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee390f-faa5-4966-ba6b-3dba57a1c140 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:22.681414 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ee390f-faa5-4966-ba6b-3dba57a1c140 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:22.683385 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ee390f-faa5-4966-ba6b-3dba57a1c140 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:22.688940 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d5c403-3bbc-43cd-8cbe-7f89c776390b admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:22.694481 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad6ec05-b7b5-4759-9d04-5c9dc1b7797a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:22.695108 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad6ec05-b7b5-4759-9d04-5c9dc1b7797a admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:22.695382 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad6ec05-b7b5-4759-9d04-5c9dc1b7797a admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:22.695646 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad6ec05-b7b5-4759-9d04-5c9dc1b7797a admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:22.696301 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad6ec05-b7b5-4759-9d04-5c9dc1b7797a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:22.698332 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad6ec05-b7b5-4759-9d04-5c9dc1b7797a admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:22.711916 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 783/1579] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 14:55:22 2022] POST /identity/v3/projects => generated 379 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:55:22.712802 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ee390f-faa5-4966-ba6b-3dba57a1c140 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:22.733635 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 797/1580] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 14:55:22 2022] POST /identity/v3/projects => generated 365 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:55:22.733635 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad6ec05-b7b5-4759-9d04-5c9dc1b7797a admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:22.736603 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:55:22.775315 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ee390f-faa5-4966-ba6b-3dba57a1c140 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:22.799701 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad6ec05-b7b5-4759-9d04-5c9dc1b7797a admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:22.804753 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e9b4eb-67b2-4203-b0b1-3ccde3038758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:22.805724 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e9b4eb-67b2-4203-b0b1-3ccde3038758 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:22.806970 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e9b4eb-67b2-4203-b0b1-3ccde3038758 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:22.806970 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e9b4eb-67b2-4203-b0b1-3ccde3038758 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:22.807821 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e9b4eb-67b2-4203-b0b1-3ccde3038758 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:22.809776 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e9b4eb-67b2-4203-b0b1-3ccde3038758 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:22.826388 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 798/1581] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:55:22 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:55:22.826388 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e9b4eb-67b2-4203-b0b1-3ccde3038758 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:22.837344 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e9b4eb-67b2-4203-b0b1-3ccde3038758 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:22.842813 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5c4930-a0df-42ab-a26e-343a5f7d6084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:22.843422 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c4930-a0df-42ab-a26e-343a5f7d6084 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:22.843697 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c4930-a0df-42ab-a26e-343a5f7d6084 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:22.843967 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c4930-a0df-42ab-a26e-343a5f7d6084 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:22.844619 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5c4930-a0df-42ab-a26e-343a5f7d6084 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:22.844978 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149cde7f-90fd-433d-abe5-5c35ee11146a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:22.845618 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149cde7f-90fd-433d-abe5-5c35ee11146a admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:22.845889 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149cde7f-90fd-433d-abe5-5c35ee11146a admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:22.846264 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5c4930-a0df-42ab-a26e-343a5f7d6084 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:22.849504 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149cde7f-90fd-433d-abe5-5c35ee11146a admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:22.850169 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149cde7f-90fd-433d-abe5-5c35ee11146a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:22.852122 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149cde7f-90fd-433d-abe5-5c35ee11146a admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:22.857885 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 799/1582] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:55:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:55:22.858910 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5c4930-a0df-42ab-a26e-343a5f7d6084 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:22.871277 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5c4930-a0df-42ab-a26e-343a5f7d6084 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:22.876345 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e544c9-b826-4d55-9f69-0c68699602a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:22.876961 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e544c9-b826-4d55-9f69-0c68699602a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:22.877346 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e544c9-b826-4d55-9f69-0c68699602a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:22.877635 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e544c9-b826-4d55-9f69-0c68699602a1 admin admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:22.878266 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e544c9-b826-4d55-9f69-0c68699602a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:22.879083 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 784/1583] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 14:55:22 2022] POST /identity/v3/users => generated 293 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:55:22.880044 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149cde7f-90fd-433d-abe5-5c35ee11146a admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:22.880411 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e544c9-b826-4d55-9f69-0c68699602a1 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:22.895818 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149cde7f-90fd-433d-abe5-5c35ee11146a admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:22.902249 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c884d7fe-3b1b-4b54-8a4f-3bbabef28184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:22.902860 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c884d7fe-3b1b-4b54-8a4f-3bbabef28184 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:22.903141 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c884d7fe-3b1b-4b54-8a4f-3bbabef28184 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:22.903412 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c884d7fe-3b1b-4b54-8a4f-3bbabef28184 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:22.904043 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c884d7fe-3b1b-4b54-8a4f-3bbabef28184 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:22.906031 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c884d7fe-3b1b-4b54-8a4f-3bbabef28184 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:22.906688 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 800/1584] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 14:55:22 2022] POST /identity/v3/users => generated 296 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:55:22.907623 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e544c9-b826-4d55-9f69-0c68699602a1 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:22.917988 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e544c9-b826-4d55-9f69-0c68699602a1 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:22.923008 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e9fa5-d4f4-4226-bd53-5110d328f474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:22.923770 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e9fa5-d4f4-4226-bd53-5110d328f474 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:22.924186 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:55:22.924340 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e9fa5-d4f4-4226-bd53-5110d328f474 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:22.924590 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e9fa5-d4f4-4226-bd53-5110d328f474 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:22.925254 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991e9fa5-d4f4-4226-bd53-5110d328f474 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:22.927184 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991e9fa5-d4f4-4226-bd53-5110d328f474 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:22.932728 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 785/1585] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 14:55:22 2022] POST /identity/v3/users => generated 289 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:55:22.932728 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c884d7fe-3b1b-4b54-8a4f-3bbabef28184 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:22.941621 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c884d7fe-3b1b-4b54-8a4f-3bbabef28184 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:22.942085 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 801/1586] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:55:22 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:55:22.942950 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e9fa5-d4f4-4226-bd53-5110d328f474 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:22.946996 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2997fe05-7113-4939-ad2c-a40b9119846f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:22.947603 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2997fe05-7113-4939-ad2c-a40b9119846f admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:22.947877 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2997fe05-7113-4939-ad2c-a40b9119846f admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:22.948149 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2997fe05-7113-4939-ad2c-a40b9119846f admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:22.948804 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2997fe05-7113-4939-ad2c-a40b9119846f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:22.950916 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2997fe05-7113-4939-ad2c-a40b9119846f admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:22.952800 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e9fa5-d4f4-4226-bd53-5110d328f474 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:22.957603 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8870ed8e-1bc6-4464-ae8d-0afdf65ea9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:22.958199 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8870ed8e-1bc6-4464-ae8d-0afdf65ea9e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:22.958488 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8870ed8e-1bc6-4464-ae8d-0afdf65ea9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:22.958754 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8870ed8e-1bc6-4464-ae8d-0afdf65ea9e6 admin admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:22.959556 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8870ed8e-1bc6-4464-ae8d-0afdf65ea9e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:22.961863 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8870ed8e-1bc6-4464-ae8d-0afdf65ea9e6 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:22.977373 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 786/1587] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 14:55:22 2022] POST /identity/v3/users => generated 290 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:55:22.978622 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2997fe05-7113-4939-ad2c-a40b9119846f admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:22.983831 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 802/1588] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 14:55:22 2022] POST /identity/v3/users => generated 289 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:55:22.984653 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8870ed8e-1bc6-4464-ae8d-0afdf65ea9e6 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:22.994277 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8870ed8e-1bc6-4464-ae8d-0afdf65ea9e6 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:22.996143 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2997fe05-7113-4939-ad2c-a40b9119846f admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:23.000081 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4a9b6b-65be-45e2-9fe1-108c07fa0c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:23.000740 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a9b6b-65be-45e2-9fe1-108c07fa0c2d admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:23.001059 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a9b6b-65be-45e2-9fe1-108c07fa0c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:23.001475 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a9b6b-65be-45e2-9fe1-108c07fa0c2d admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:23.002127 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4a9b6b-65be-45e2-9fe1-108c07fa0c2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:23.002245 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf9c1d7-43b7-4050-b5e6-b136af6e307f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:23.002738 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf9c1d7-43b7-4050-b5e6-b136af6e307f admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:23.003009 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf9c1d7-43b7-4050-b5e6-b136af6e307f admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:23.003270 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf9c1d7-43b7-4050-b5e6-b136af6e307f admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:23.003728 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4a9b6b-65be-45e2-9fe1-108c07fa0c2d admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:23.003904 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf9c1d7-43b7-4050-b5e6-b136af6e307f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:23.005755 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf9c1d7-43b7-4050-b5e6-b136af6e307f admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:23.015385 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 803/1589] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:55:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:55:23.016311 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4a9b6b-65be-45e2-9fe1-108c07fa0c2d admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:23.019222 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 787/1590] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:55:22 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:55:23.019222 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf9c1d7-43b7-4050-b5e6-b136af6e307f admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:23.026897 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4a9b6b-65be-45e2-9fe1-108c07fa0c2d admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:23.029535 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf9c1d7-43b7-4050-b5e6-b136af6e307f admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:23.031602 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a09b02-edae-4a85-9566-d5034d86fc05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:23.032194 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a09b02-edae-4a85-9566-d5034d86fc05 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:23.032584 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a09b02-edae-4a85-9566-d5034d86fc05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:23.032865 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a09b02-edae-4a85-9566-d5034d86fc05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:23.033583 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a09b02-edae-4a85-9566-d5034d86fc05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:23.034493 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593db016-a470-4306-9971-93ec772aad45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:23.035164 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593db016-a470-4306-9971-93ec772aad45 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:23.035308 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a09b02-edae-4a85-9566-d5034d86fc05 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:23.035584 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593db016-a470-4306-9971-93ec772aad45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:23.035897 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593db016-a470-4306-9971-93ec772aad45 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:23.036525 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593db016-a470-4306-9971-93ec772aad45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:23.038114 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593db016-a470-4306-9971-93ec772aad45 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:23.045859 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 804/1591] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:55:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:55:23.045859 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a09b02-edae-4a85-9566-d5034d86fc05 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:23.049267 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 788/1592] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:55:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:55:23.049402 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593db016-a470-4306-9971-93ec772aad45 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:23.058975 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593db016-a470-4306-9971-93ec772aad45 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:23.059145 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a09b02-edae-4a85-9566-d5034d86fc05 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:23.063697 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa47c1d-227b-4e90-bacc-cfe06d71c55f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:23.063855 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a87997-d748-448b-9f13-6841947a37c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:23.064285 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa47c1d-227b-4e90-bacc-cfe06d71c55f admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:23.064392 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a87997-d748-448b-9f13-6841947a37c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:23.064557 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa47c1d-227b-4e90-bacc-cfe06d71c55f admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:23.064663 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a87997-d748-448b-9f13-6841947a37c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:23.064821 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa47c1d-227b-4e90-bacc-cfe06d71c55f admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:23.064922 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a87997-d748-448b-9f13-6841947a37c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:23.065503 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa47c1d-227b-4e90-bacc-cfe06d71c55f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:23.065646 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a87997-d748-448b-9f13-6841947a37c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:23.067104 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a87997-d748-448b-9f13-6841947a37c0 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:23.067211 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa47c1d-227b-4e90-bacc-cfe06d71c55f admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:23.077493 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 805/1593] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:55:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:55:23.078303 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 789/1594] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:55:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:55:23.078417 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a87997-d748-448b-9f13-6841947a37c0 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:23.081956 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa47c1d-227b-4e90-bacc-cfe06d71c55f admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:23.088793 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a87997-d748-448b-9f13-6841947a37c0 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:23.091696 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa47c1d-227b-4e90-bacc-cfe06d71c55f admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:23.093746 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d75f64-3098-4e4b-9294-9fadcb676df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:23.094347 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d75f64-3098-4e4b-9294-9fadcb676df3 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:23.094626 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d75f64-3098-4e4b-9294-9fadcb676df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:23.094899 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d75f64-3098-4e4b-9294-9fadcb676df3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:23.095539 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d75f64-3098-4e4b-9294-9fadcb676df3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:23.096295 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eca6c7f-4827-4113-873f-e59bdb4ea444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:23.096868 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eca6c7f-4827-4113-873f-e59bdb4ea444 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:23.097168 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d75f64-3098-4e4b-9294-9fadcb676df3 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:23.097265 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eca6c7f-4827-4113-873f-e59bdb4ea444 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:23.097433 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eca6c7f-4827-4113-873f-e59bdb4ea444 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:23.098055 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eca6c7f-4827-4113-873f-e59bdb4ea444 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:23.099629 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eca6c7f-4827-4113-873f-e59bdb4ea444 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:23.107717 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 806/1595] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:55:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:55:23.109343 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d75f64-3098-4e4b-9294-9fadcb676df3 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:23.110169 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 790/1596] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:55:23 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:55:23.110773 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eca6c7f-4827-4113-873f-e59bdb4ea444 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:23.120546 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d75f64-3098-4e4b-9294-9fadcb676df3 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:23.120710 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eca6c7f-4827-4113-873f-e59bdb4ea444 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:23.125322 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25408465-4f7d-4b78-aa12-ccfe538238de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:23.125770 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0141ed86-487c-4f67-ad5b-538db7e453bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:23.125946 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25408465-4f7d-4b78-aa12-ccfe538238de admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:23.126220 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25408465-4f7d-4b78-aa12-ccfe538238de admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:23.126419 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141ed86-487c-4f67-ad5b-538db7e453bf admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:23.126541 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25408465-4f7d-4b78-aa12-ccfe538238de admin admin] PATH_INFO: `/v3/projects/e15ebf1df15b47e8b3c03fda475540a6/users/ab3ebacb745f4074bb708d9a40c9161d/roles/74de6794e3b3422b93d26f993d260c35` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:23.126698 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141ed86-487c-4f67-ad5b-538db7e453bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:23.126964 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141ed86-487c-4f67-ad5b-538db7e453bf admin admin] PATH_INFO: `/v3/projects/768c757de3db4eccb491b71ec25a0a8f/users/2ec08b0857b847379074dbf1950e0114/roles/74de6794e3b3422b93d26f993d260c35` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:23.141229 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25408465-4f7d-4b78-aa12-ccfe538238de admin admin] RBAC: Authorizing `identity:create_grant(project_id=e15ebf1df15b47e8b3c03fda475540a6, user_id=ab3ebacb745f4074bb708d9a40c9161d, role_id=74de6794e3b3422b93d26f993d260c35)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:23.143851 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25408465-4f7d-4b78-aa12-ccfe538238de admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:23.144086 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0141ed86-487c-4f67-ad5b-538db7e453bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=768c757de3db4eccb491b71ec25a0a8f, user_id=2ec08b0857b847379074dbf1950e0114, role_id=74de6794e3b3422b93d26f993d260c35)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:23.146840 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0141ed86-487c-4f67-ad5b-538db7e453bf admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:23.161308 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 791/1597] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 14:55:23 2022] PUT /identity/v3/projects/e15ebf1df15b47e8b3c03fda475540a6/users/ab3ebacb745f4074bb708d9a40c9161d/roles/74de6794e3b3422b93d26f993d260c35 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:55:23.165476 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25408465-4f7d-4b78-aa12-ccfe538238de admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:23.165599 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 807/1598] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 14:55:23 2022] PUT /identity/v3/projects/768c757de3db4eccb491b71ec25a0a8f/users/2ec08b0857b847379074dbf1950e0114/roles/74de6794e3b3422b93d26f993d260c35 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:55:23.165599 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0141ed86-487c-4f67-ad5b-538db7e453bf admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:23.205765 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:55:23.236211 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0141ed86-487c-4f67-ad5b-538db7e453bf admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:23.236667 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25408465-4f7d-4b78-aa12-ccfe538238de admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:23.241314 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0b1ff1-a6ad-4146-9e63-9916cd191db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:23.241449 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b894d347-c784-4465-812e-44297edd8a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:23.241915 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b894d347-c784-4465-812e-44297edd8a22 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:23.242041 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0b1ff1-a6ad-4146-9e63-9916cd191db4 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:23.242189 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b894d347-c784-4465-812e-44297edd8a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:23.242293 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0b1ff1-a6ad-4146-9e63-9916cd191db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:23.242456 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b894d347-c784-4465-812e-44297edd8a22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:23.242552 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0b1ff1-a6ad-4146-9e63-9916cd191db4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:23.243100 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0b1ff1-a6ad-4146-9e63-9916cd191db4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:23.243201 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b894d347-c784-4465-812e-44297edd8a22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:23.244734 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b894d347-c784-4465-812e-44297edd8a22 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:23.244858 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0b1ff1-a6ad-4146-9e63-9916cd191db4 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:23.254742 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 792/1599] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:55:23 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:55:23.255073 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 808/1600] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:55:23 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:55:23.255860 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0b1ff1-a6ad-4146-9e63-9916cd191db4 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:23.257907 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b894d347-c784-4465-812e-44297edd8a22 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:23.265819 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0b1ff1-a6ad-4146-9e63-9916cd191db4 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:23.268229 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b894d347-c784-4465-812e-44297edd8a22 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:23.270440 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a78436-0251-4e1b-97b9-1342c0cd7de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:23.271090 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a78436-0251-4e1b-97b9-1342c0cd7de8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:23.271368 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a78436-0251-4e1b-97b9-1342c0cd7de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:23.271641 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a78436-0251-4e1b-97b9-1342c0cd7de8 admin admin] PATH_INFO: `/v3/projects/545bb63f05564531a5a0cba573041f9c/users/53fe9d2b2e8b4d22acb170b18f697515/roles/74de6794e3b3422b93d26f993d260c35` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:23.273083 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f8daaa-26d8-4193-8d86-df169bb988a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:23.273922 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f8daaa-26d8-4193-8d86-df169bb988a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:23.274310 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f8daaa-26d8-4193-8d86-df169bb988a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:23.274590 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f8daaa-26d8-4193-8d86-df169bb988a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:23.276223 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f8daaa-26d8-4193-8d86-df169bb988a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:23.277925 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f8daaa-26d8-4193-8d86-df169bb988a6 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:23.286986 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a78436-0251-4e1b-97b9-1342c0cd7de8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=545bb63f05564531a5a0cba573041f9c, user_id=53fe9d2b2e8b4d22acb170b18f697515, role_id=74de6794e3b3422b93d26f993d260c35)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:23.288349 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 793/1601] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:55:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:55:23.289285 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f8daaa-26d8-4193-8d86-df169bb988a6 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:23.290118 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a78436-0251-4e1b-97b9-1342c0cd7de8 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:23.299253 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f8daaa-26d8-4193-8d86-df169bb988a6 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:23.303989 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 809/1602] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 14:55:23 2022] PUT /identity/v3/projects/545bb63f05564531a5a0cba573041f9c/users/53fe9d2b2e8b4d22acb170b18f697515/roles/74de6794e3b3422b93d26f993d260c35 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:55:23.304779 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a78436-0251-4e1b-97b9-1342c0cd7de8 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:23.359529 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b4a510-56b6-4acd-8777-cb480e1ca6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:23.360143 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b4a510-56b6-4acd-8777-cb480e1ca6d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:23.360421 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b4a510-56b6-4acd-8777-cb480e1ca6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:23.360690 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b4a510-56b6-4acd-8777-cb480e1ca6d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:23.361360 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b4a510-56b6-4acd-8777-cb480e1ca6d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:23.362969 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b4a510-56b6-4acd-8777-cb480e1ca6d3 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:23.364204 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:55:23.366868 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a78436-0251-4e1b-97b9-1342c0cd7de8 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:23.372027 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24375546-da2c-4196-a556-2da5a41e5944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:23.372686 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24375546-da2c-4196-a556-2da5a41e5944 admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:23.372958 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24375546-da2c-4196-a556-2da5a41e5944 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:23.373259 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24375546-da2c-4196-a556-2da5a41e5944 admin admin] PATH_INFO: `/v3/projects/928a02bfd26d4caf8e7fd3313273c852/users/2efb97c678fa4b55979d8f942b3361db/roles/019bde1756cb40de8ce06cef6b261f79` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:23.375376 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 794/1603] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:55:23 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:55:23.376837 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a836a788-97f2-4638-8629-3a7f7dee0884 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:23.377322 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a836a788-97f2-4638-8629-3a7f7dee0884 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:23.377761 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a836a788-97f2-4638-8629-3a7f7dee0884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:23.389099 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24375546-da2c-4196-a556-2da5a41e5944 admin admin] RBAC: Authorizing `identity:create_grant(project_id=928a02bfd26d4caf8e7fd3313273c852, user_id=2efb97c678fa4b55979d8f942b3361db, role_id=019bde1756cb40de8ce06cef6b261f79)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:23.391905 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24375546-da2c-4196-a556-2da5a41e5944 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:23.399995 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-a836a788-97f2-4638-8629-3a7f7dee0884 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:55:23.401443 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a836a788-97f2-4638-8629-3a7f7dee0884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:23.405735 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 810/1604] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 14:55:23 2022] PUT /identity/v3/projects/928a02bfd26d4caf8e7fd3313273c852/users/2efb97c678fa4b55979d8f942b3361db/roles/019bde1756cb40de8ce06cef6b261f79 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:55:23.407144 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0122de7c-6f68-4a3e-8bfb-c15844c0f724 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:23.407421 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0122de7c-6f68-4a3e-8bfb-c15844c0f724 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:23.407688 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0122de7c-6f68-4a3e-8bfb-c15844c0f724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:23.435895 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-0122de7c-6f68-4a3e-8bfb-c15844c0f724 None None] MFA Rules not processed for user `2ec08b0857b847379074dbf1950e0114`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:55:23.437121 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-0122de7c-6f68-4a3e-8bfb-c15844c0f724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:23.461613 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 795/1605] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:55:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:55:23.462575 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a836a788-97f2-4638-8629-3a7f7dee0884 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:23.479492 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a836a788-97f2-4638-8629-3a7f7dee0884 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:23.484352 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cac2ad-cc7b-4253-a98a-31216162bd05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:23.485159 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cac2ad-cc7b-4253-a98a-31216162bd05 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:23.485432 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cac2ad-cc7b-4253-a98a-31216162bd05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:23.485720 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cac2ad-cc7b-4253-a98a-31216162bd05 admin admin] PATH_INFO: `/v3/projects/895a41db8112420ebd5acb8e0b72b8f2/users/0849c164d4644da39055dfac64af06d4/roles/74de6794e3b3422b93d26f993d260c35` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:23.501729 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cac2ad-cc7b-4253-a98a-31216162bd05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=895a41db8112420ebd5acb8e0b72b8f2, user_id=0849c164d4644da39055dfac64af06d4, role_id=74de6794e3b3422b93d26f993d260c35)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:23.504364 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cac2ad-cc7b-4253-a98a-31216162bd05 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:23.512964 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 811/1606] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:55:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:55:23.517822 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0122de7c-6f68-4a3e-8bfb-c15844c0f724 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:23.523006 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 796/1607] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 14:55:23 2022] PUT /identity/v3/projects/895a41db8112420ebd5acb8e0b72b8f2/users/0849c164d4644da39055dfac64af06d4/roles/74de6794e3b3422b93d26f993d260c35 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:55:23.523824 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cac2ad-cc7b-4253-a98a-31216162bd05 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:23.533316 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0122de7c-6f68-4a3e-8bfb-c15844c0f724 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:23.549975 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:55:23.594970 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cac2ad-cc7b-4253-a98a-31216162bd05 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:23.602170 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a00f760-bf7b-4604-9a00-8cbd88582f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:23.602170 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a00f760-bf7b-4604-9a00-8cbd88582f55 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:23.602170 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a00f760-bf7b-4604-9a00-8cbd88582f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:23.602170 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a00f760-bf7b-4604-9a00-8cbd88582f55 admin admin] PATH_INFO: `/v3/projects/ee9b210f840e485fb5cd1a0dd0e0fa52/users/f1c836a721f54178a02d864ce57c776e/roles/74de6794e3b3422b93d26f993d260c35` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:23.606382 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036a6b90-93b0-4448-94dc-41d0bd74e677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:23.607044 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a6b90-93b0-4448-94dc-41d0bd74e677 admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:23.607353 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a6b90-93b0-4448-94dc-41d0bd74e677 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:23.607547 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a6b90-93b0-4448-94dc-41d0bd74e677 admin admin] PATH_INFO: `/v3/projects/6bcf4aea08994c31acd194d2c035af0e/users/f063128266bb4a34bb0f0639dfa63334/roles/74de6794e3b3422b93d26f993d260c35` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:23.618129 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a00f760-bf7b-4604-9a00-8cbd88582f55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee9b210f840e485fb5cd1a0dd0e0fa52, user_id=f1c836a721f54178a02d864ce57c776e, role_id=74de6794e3b3422b93d26f993d260c35)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:23.620788 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a00f760-bf7b-4604-9a00-8cbd88582f55 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:23.624101 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036a6b90-93b0-4448-94dc-41d0bd74e677 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bcf4aea08994c31acd194d2c035af0e, user_id=f063128266bb4a34bb0f0639dfa63334, role_id=74de6794e3b3422b93d26f993d260c35)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:23.627164 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036a6b90-93b0-4448-94dc-41d0bd74e677 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:23.640300 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 797/1608] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 14:55:23 2022] PUT /identity/v3/projects/ee9b210f840e485fb5cd1a0dd0e0fa52/users/f1c836a721f54178a02d864ce57c776e/roles/74de6794e3b3422b93d26f993d260c35 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:55:23.640300 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45e0698-0857-48dc-9856-712db2ef5787 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:23.640300 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45e0698-0857-48dc-9856-712db2ef5787 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:23.640300 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45e0698-0857-48dc-9856-712db2ef5787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:23.646802 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 812/1609] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 14:55:23 2022] PUT /identity/v3/projects/6bcf4aea08994c31acd194d2c035af0e/users/f063128266bb4a34bb0f0639dfa63334/roles/74de6794e3b3422b93d26f993d260c35 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:55:23.647619 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036a6b90-93b0-4448-94dc-41d0bd74e677 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:23.660032 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-f45e0698-0857-48dc-9856-712db2ef5787 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:55:23.661296 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f45e0698-0857-48dc-9856-712db2ef5787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:23.716687 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036a6b90-93b0-4448-94dc-41d0bd74e677 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:23.718027 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:55:23.723316 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef88337-1850-43e7-bc76-3cbcc74eab38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:23.724260 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef88337-1850-43e7-bc76-3cbcc74eab38 admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:23.724692 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef88337-1850-43e7-bc76-3cbcc74eab38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:23.725150 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef88337-1850-43e7-bc76-3cbcc74eab38 admin admin] PATH_INFO: `/v3/projects/2e76bceadd264ae898111a05b4a42216/users/34c0f151ec0940449a2fb3e68b33925f/roles/74de6794e3b3422b93d26f993d260c35` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:23.732827 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 798/1610] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:55:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:55:23.734173 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45e0698-0857-48dc-9856-712db2ef5787 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:23.744950 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef88337-1850-43e7-bc76-3cbcc74eab38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e76bceadd264ae898111a05b4a42216, user_id=34c0f151ec0940449a2fb3e68b33925f, role_id=74de6794e3b3422b93d26f993d260c35)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:23.747919 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45e0698-0857-48dc-9856-712db2ef5787 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:23.748104 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef88337-1850-43e7-bc76-3cbcc74eab38 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:23.753648 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80e3ba0-0347-4f6c-bb88-e702c82e05ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:23.754293 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80e3ba0-0347-4f6c-bb88-e702c82e05ce admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:23.754595 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80e3ba0-0347-4f6c-bb88-e702c82e05ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:23.754916 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80e3ba0-0347-4f6c-bb88-e702c82e05ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:23.755623 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80e3ba0-0347-4f6c-bb88-e702c82e05ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:23.757407 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80e3ba0-0347-4f6c-bb88-e702c82e05ce admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:23.764712 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 813/1611] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 14:55:23 2022] PUT /identity/v3/projects/2e76bceadd264ae898111a05b4a42216/users/34c0f151ec0940449a2fb3e68b33925f/roles/74de6794e3b3422b93d26f993d260c35 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:55:23.766251 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef88337-1850-43e7-bc76-3cbcc74eab38 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:23.771969 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 799/1612] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:55:23 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:55:23.771969 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d91142-1629-4319-820f-78c32cf8ef42 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:23.771969 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d91142-1629-4319-820f-78c32cf8ef42 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:23.771969 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d91142-1629-4319-820f-78c32cf8ef42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:23.801491 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-a1d91142-1629-4319-820f-78c32cf8ef42 None None] MFA Rules not processed for user `0849c164d4644da39055dfac64af06d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:55:23.802619 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a1d91142-1629-4319-820f-78c32cf8ef42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:23.834003 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef88337-1850-43e7-bc76-3cbcc74eab38 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:23.839156 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aca87a-c56c-4e52-b59a-c34894eba65f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:23.839772 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aca87a-c56c-4e52-b59a-c34894eba65f service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:23.840050 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aca87a-c56c-4e52-b59a-c34894eba65f service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:23.840318 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aca87a-c56c-4e52-b59a-c34894eba65f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:23.872188 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 800/1613] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:55:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:55:23.873647 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d41637-b4bd-465f-9637-b5b9c532b364 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:23.873934 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d41637-b4bd-465f-9637-b5b9c532b364 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:23.874205 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d41637-b4bd-465f-9637-b5b9c532b364 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:23.875495 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 801/1614] 10.222.0.26 () {54 vars in 965 bytes} [Mon Sep 19 14:55:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:55:23.876519 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eaba5a-0d6f-46ad-a5f3-f2cde552e799 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:23.876793 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eaba5a-0d6f-46ad-a5f3-f2cde552e799 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:23.877082 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eaba5a-0d6f-46ad-a5f3-f2cde552e799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:23.889962 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:55:23.899304 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-60eaba5a-0d6f-46ad-a5f3-f2cde552e799 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:55:23.900736 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-60eaba5a-0d6f-46ad-a5f3-f2cde552e799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:23.920330 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aca87a-c56c-4e52-b59a-c34894eba65f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:23.921809 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aca87a-c56c-4e52-b59a-c34894eba65f service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:23.931641 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 814/1615] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:55:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:55:23.932901 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a89d4-d49a-4e9d-ba53-48a4492b85cc None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:23.933214 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a89d4-d49a-4e9d-ba53-48a4492b85cc None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:23.933494 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a89d4-d49a-4e9d-ba53-48a4492b85cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:23.956154 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-da4a89d4-d49a-4e9d-ba53-48a4492b85cc None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:55:23.957478 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-da4a89d4-d49a-4e9d-ba53-48a4492b85cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:23.966903 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 802/1616] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:55:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:55:23.967530 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 815/1617] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:55:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:55:23.968373 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eaba5a-0d6f-46ad-a5f3-f2cde552e799 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:23.969041 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf50aa-fb6a-4b6e-8072-777a114fcbc8 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:23.969377 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf50aa-fb6a-4b6e-8072-777a114fcbc8 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:23.969712 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf50aa-fb6a-4b6e-8072-777a114fcbc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:23.976928 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-60eaba5a-0d6f-46ad-a5f3-f2cde552e799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:23.990679 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eaba5a-0d6f-46ad-a5f3-f2cde552e799 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:23.994829 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69294ad8-e622-46cd-a78a-704afbdcf302 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:23.995299 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69294ad8-e622-46cd-a78a-704afbdcf302 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:23.995581 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69294ad8-e622-46cd-a78a-704afbdcf302 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:23.995856 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69294ad8-e622-46cd-a78a-704afbdcf302 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:23.998871 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-5abf50aa-fb6a-4b6e-8072-777a114fcbc8 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:55:24.000418 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-5abf50aa-fb6a-4b6e-8072-777a114fcbc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:24.007626 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69294ad8-e622-46cd-a78a-704afbdcf302 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:24.010002 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69294ad8-e622-46cd-a78a-704afbdcf302 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:24.010315 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 816/1618] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:55:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:55:24.011243 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abf50aa-fb6a-4b6e-8072-777a114fcbc8 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:24.021684 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 803/1619] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:55:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:55:24.021871 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abf50aa-fb6a-4b6e-8072-777a114fcbc8 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:24.022938 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d532e12-7abe-485e-a1f2-0d43048b0c29 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:24.023681 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d532e12-7abe-485e-a1f2-0d43048b0c29 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:24.023681 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d532e12-7abe-485e-a1f2-0d43048b0c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:24.027424 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af9e5f7-0faf-4acb-ac47-559737361d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:24.028269 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af9e5f7-0faf-4acb-ac47-559737361d5f admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:24.028711 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af9e5f7-0faf-4acb-ac47-559737361d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:24.029208 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af9e5f7-0faf-4acb-ac47-559737361d5f admin admin] PATH_INFO: `/v3/projects/928a02bfd26d4caf8e7fd3313273c852/users/2efb97c678fa4b55979d8f942b3361db/roles/019bde1756cb40de8ce06cef6b261f79` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:24.031319 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af9e5f7-0faf-4acb-ac47-559737361d5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=928a02bfd26d4caf8e7fd3313273c852, user_id=2efb97c678fa4b55979d8f942b3361db, role_id=019bde1756cb40de8ce06cef6b261f79)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:24.034210 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af9e5f7-0faf-4acb-ac47-559737361d5f admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:24.047655 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 817/1620] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 14:55:24 2022] PUT /identity/v3/projects/928a02bfd26d4caf8e7fd3313273c852/users/2efb97c678fa4b55979d8f942b3361db/roles/019bde1756cb40de8ce06cef6b261f79 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:55:24.049486 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe67c3f2-01b8-46c1-b18a-df03589c9921 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:24.049779 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe67c3f2-01b8-46c1-b18a-df03589c9921 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:24.050040 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe67c3f2-01b8-46c1-b18a-df03589c9921 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:24.051458 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 818/1621] 10.222.0.26 () {54 vars in 965 bytes} [Mon Sep 19 14:55:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:55:24.052037 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe67c3f2-01b8-46c1-b18a-df03589c9921 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:24.084953 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-9d532e12-7abe-485e-a1f2-0d43048b0c29 None None] MFA Rules not processed for user `3017e5d92bef4cc2aeae4f28c78ba233`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:55:24.086988 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-9d532e12-7abe-485e-a1f2-0d43048b0c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:24.131958 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe67c3f2-01b8-46c1-b18a-df03589c9921 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:24.138568 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c666c9-4087-4039-b100-727c159fcdc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:24.140694 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c666c9-4087-4039-b100-727c159fcdc7 service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:24.141347 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c666c9-4087-4039-b100-727c159fcdc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:24.141347 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c666c9-4087-4039-b100-727c159fcdc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:24.151736 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:55:24.221185 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 804/1622] 10.222.0.26 () {58 vars in 1062 bytes} [Mon Sep 19 14:55:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:55:24.222135 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d532e12-7abe-485e-a1f2-0d43048b0c29 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:24.240573 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d532e12-7abe-485e-a1f2-0d43048b0c29 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:24.249043 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dac264-4d79-4d05-8772-1158215fb680 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:24.250636 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dac264-4d79-4d05-8772-1158215fb680 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:24.251119 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c666c9-4087-4039-b100-727c159fcdc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:24.251980 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dac264-4d79-4d05-8772-1158215fb680 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:24.253219 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c666c9-4087-4039-b100-727c159fcdc7 service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:24.253612 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dac264-4d79-4d05-8772-1158215fb680 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:24.270477 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dac264-4d79-4d05-8772-1158215fb680 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:24.272069 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dac264-4d79-4d05-8772-1158215fb680 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:24.272798 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 819/1623] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:55:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:55:24.276051 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c666c9-4087-4039-b100-727c159fcdc7 service neutron] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:24.284245 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 805/1624] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:55:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:55:24.285629 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e896ed-3110-4c68-8c8c-c9520adf6f3e None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:24.286015 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e896ed-3110-4c68-8c8c-c9520adf6f3e None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:24.286409 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e896ed-3110-4c68-8c8c-c9520adf6f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:24.289404 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c666c9-4087-4039-b100-727c159fcdc7 service neutron] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:24.293230 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babbe759-c96f-4681-b11d-e1069b488c99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:24.293872 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babbe759-c96f-4681-b11d-e1069b488c99 service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:24.294143 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babbe759-c96f-4681-b11d-e1069b488c99 service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:24.294407 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babbe759-c96f-4681-b11d-e1069b488c99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:24.307292 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babbe759-c96f-4681-b11d-e1069b488c99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:24.309728 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babbe759-c96f-4681-b11d-e1069b488c99 service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:24.321940 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-b1e896ed-3110-4c68-8c8c-c9520adf6f3e None None] MFA Rules not processed for user `2efb97c678fa4b55979d8f942b3361db`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:55:24.323373 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b1e896ed-3110-4c68-8c8c-c9520adf6f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:24.323527 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 820/1625] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:55:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:55:24.324825 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b3388a-7251-46e2-99b6-487a652c540b None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:24.325144 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b3388a-7251-46e2-99b6-487a652c540b None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:24.325412 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b3388a-7251-46e2-99b6-487a652c540b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:24.361557 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-50b3388a-7251-46e2-99b6-487a652c540b None None] MFA Rules not processed for user `3017e5d92bef4cc2aeae4f28c78ba233`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:55:24.364680 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-50b3388a-7251-46e2-99b6-487a652c540b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:24.392064 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 821/1626] 10.222.0.26 () {58 vars in 1062 bytes} [Mon Sep 19 14:55:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:55:24.393160 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b3388a-7251-46e2-99b6-487a652c540b None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:24.404716 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b3388a-7251-46e2-99b6-487a652c540b None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:24.411438 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f7d357-9d97-4404-940c-11205e461974 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3017e5d92bef4cc2aeae4f28c78ba233', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:24.412306 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f7d357-9d97-4404-940c-11205e461974 service nova] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:24.412804 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f7d357-9d97-4404-940c-11205e461974 service nova] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:24.413342 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f7d357-9d97-4404-940c-11205e461974 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:24.457572 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:55:24.465082 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 806/1627] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:55:24 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:55:24.465082 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e896ed-3110-4c68-8c8c-c9520adf6f3e None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:24.494909 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e896ed-3110-4c68-8c8c-c9520adf6f3e None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:24.497066 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f7d357-9d97-4404-940c-11205e461974 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:24.499702 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f7d357-9d97-4404-940c-11205e461974 service nova] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:24.505590 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8295a9a8-a04b-4260-ab8a-d412cad0efdd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3017e5d92bef4cc2aeae4f28c78ba233', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:24.507455 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295a9a8-a04b-4260-ab8a-d412cad0efdd service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:24.507971 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295a9a8-a04b-4260-ab8a-d412cad0efdd service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:24.508724 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295a9a8-a04b-4260-ab8a-d412cad0efdd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:24.524381 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 822/1628] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:55:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:55:24.526654 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f7d357-9d97-4404-940c-11205e461974 service nova] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:24.620479 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8295a9a8-a04b-4260-ab8a-d412cad0efdd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:24.627239 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8295a9a8-a04b-4260-ab8a-d412cad0efdd service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:24.669287 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f7d357-9d97-4404-940c-11205e461974 service nova] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:24.679955 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb68b4a-50ab-47d5-a117-3e2ade47606b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df648c909ddb41418128b43f925f5ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:24.680671 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb68b4a-50ab-47d5-a117-3e2ade47606b service cinder] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:24.680958 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb68b4a-50ab-47d5-a117-3e2ade47606b service cinder] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:24.681258 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb68b4a-50ab-47d5-a117-3e2ade47606b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:24.685163 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 807/1629] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:55:24 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:55:24.701859 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb68b4a-50ab-47d5-a117-3e2ade47606b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:24.707684 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb68b4a-50ab-47d5-a117-3e2ade47606b service cinder] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:24.730929 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 823/1630] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:55:24 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:55:24.913885 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8295a9a8-a04b-4260-ab8a-d412cad0efdd service nova] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:24.929408 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a738e67-cd8e-4788-a84f-55e5f02362a1 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:24.929738 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a738e67-cd8e-4788-a84f-55e5f02362a1 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:24.930018 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a738e67-cd8e-4788-a84f-55e5f02362a1 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:24.932641 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 824/1631] 10.222.0.26 () {54 vars in 912 bytes} [Mon Sep 19 14:55:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 14:55:24.934037 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8295a9a8-a04b-4260-ab8a-d412cad0efdd service nova] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:24.940174 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa458ba-d696-4e14-9582-9182cfbbe773 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:24.940695 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa458ba-d696-4e14-9582-9182cfbbe773 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:24.941240 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa458ba-d696-4e14-9582-9182cfbbe773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:24.943456 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87a4e6a-f14c-4123-b1b0-c3e797558e65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df648c909ddb41418128b43f925f5ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:24.945677 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a4e6a-f14c-4123-b1b0-c3e797558e65 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:24.946023 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a4e6a-f14c-4123-b1b0-c3e797558e65 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:24.949046 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a4e6a-f14c-4123-b1b0-c3e797558e65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:24.969599 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-9fa458ba-d696-4e14-9582-9182cfbbe773 None None] MFA Rules not processed for user `3017e5d92bef4cc2aeae4f28c78ba233`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:55:24.971329 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-9fa458ba-d696-4e14-9582-9182cfbbe773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:25.009382 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 825/1632] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Sep 19 14:55:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 14:55:25.025391 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa458ba-d696-4e14-9582-9182cfbbe773 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:25.048736 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa458ba-d696-4e14-9582-9182cfbbe773 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:25.054669 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c8309f-c035-4aea-bf54-9cdbd23ea7d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df648c909ddb41418128b43f925f5ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:25.055532 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c8309f-c035-4aea-bf54-9cdbd23ea7d7 service cinder] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:25.055818 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c8309f-c035-4aea-bf54-9cdbd23ea7d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:25.056200 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c8309f-c035-4aea-bf54-9cdbd23ea7d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:25.069965 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c8309f-c035-4aea-bf54-9cdbd23ea7d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:25.071827 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c8309f-c035-4aea-bf54-9cdbd23ea7d7 service cinder] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:25.090560 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 826/1633] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:55:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:55:25.091645 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:55:25.123191 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0908ebb6-6d80-4dbe-ac79-ed27c8c27571 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:25.123583 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87a4e6a-f14c-4123-b1b0-c3e797558e65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:25.125317 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87a4e6a-f14c-4123-b1b0-c3e797558e65 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:25.125799 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0908ebb6-6d80-4dbe-ac79-ed27c8c27571 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:25.126184 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0908ebb6-6d80-4dbe-ac79-ed27c8c27571 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:25.129444 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 827/1634] 10.222.0.26 () {54 vars in 912 bytes} [Mon Sep 19 14:55:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:55:25.138899 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ef44d-6b41-4eb8-be44-c58cb20c9f3e None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:25.139585 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ef44d-6b41-4eb8-be44-c58cb20c9f3e None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:25.140302 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ef44d-6b41-4eb8-be44-c58cb20c9f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:25.160327 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 808/1635] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:55:24 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:55:25.170943 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-c63ef44d-6b41-4eb8-be44-c58cb20c9f3e None None] MFA Rules not processed for user `3017e5d92bef4cc2aeae4f28c78ba233`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:55:25.173655 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-c63ef44d-6b41-4eb8-be44-c58cb20c9f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:25.184660 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 828/1636] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Sep 19 14:55:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:55:25.554454 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87a4e6a-f14c-4123-b1b0-c3e797558e65 service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:25.572876 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87a4e6a-f14c-4123-b1b0-c3e797558e65 service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:25.584093 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c82a2f8-ca18-45a0-bd3f-6051b3e3e47b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df648c909ddb41418128b43f925f5ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:25.589937 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c82a2f8-ca18-45a0-bd3f-6051b3e3e47b service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:25.590230 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c82a2f8-ca18-45a0-bd3f-6051b3e3e47b service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:25.590459 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c82a2f8-ca18-45a0-bd3f-6051b3e3e47b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:25.626383 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c82a2f8-ca18-45a0-bd3f-6051b3e3e47b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:25.631078 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c82a2f8-ca18-45a0-bd3f-6051b3e3e47b service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:25.658441 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 809/1637] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:55:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:55:28.448040 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63ef44d-6b41-4eb8-be44-c58cb20c9f3e None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:28.467834 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63ef44d-6b41-4eb8-be44-c58cb20c9f3e None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:28.485683 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be750ef7-738f-465c-a6fb-b38827d65665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:28.486970 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be750ef7-738f-465c-a6fb-b38827d65665 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:28.487840 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be750ef7-738f-465c-a6fb-b38827d65665 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:28.488233 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be750ef7-738f-465c-a6fb-b38827d65665 admin admin] PATH_INFO: `/v3/users/2ec08b0857b847379074dbf1950e0114` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:28.495539 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be750ef7-738f-465c-a6fb-b38827d65665 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ec08b0857b847379074dbf1950e0114)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:28.500767 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be750ef7-738f-465c-a6fb-b38827d65665 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:28.631438 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-be750ef7-738f-465c-a6fb-b38827d65665 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ec08b0857b847379074dbf1950e0114'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:55:28.659129 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-be750ef7-738f-465c-a6fb-b38827d65665 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ec08b0857b847379074dbf1950e0114'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:55:28.661571 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-be750ef7-738f-465c-a6fb-b38827d65665 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ec08b0857b847379074dbf1950e0114'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:55:28.664680 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-be750ef7-738f-465c-a6fb-b38827d65665 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ec08b0857b847379074dbf1950e0114'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:55:28.711014 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-be750ef7-738f-465c-a6fb-b38827d65665 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ec08b0857b847379074dbf1950e0114'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:55:28.770812 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 829/1638] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 14:55:28 2022] DELETE /identity/v3/users/2ec08b0857b847379074dbf1950e0114 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:55:28.772555 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f80014a-4357-4b86-9995-9c3e8e9a4815 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:28.773470 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f80014a-4357-4b86-9995-9c3e8e9a4815 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:28.774133 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f80014a-4357-4b86-9995-9c3e8e9a4815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:28.848485 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-4f80014a-4357-4b86-9995-9c3e8e9a4815 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:55:28.858225 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-4f80014a-4357-4b86-9995-9c3e8e9a4815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:29.045673 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 810/1639] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:55:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:55:29.085717 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be750ef7-738f-465c-a6fb-b38827d65665 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:29.088620 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-be750ef7-738f-465c-a6fb-b38827d65665 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:29.126265 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:55:29.187706 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be750ef7-738f-465c-a6fb-b38827d65665 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:29.194462 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e6cfd5-36b6-4ec3-adf1-c05e75f8e7dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:29.195559 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e6cfd5-36b6-4ec3-adf1-c05e75f8e7dc service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:29.196171 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e6cfd5-36b6-4ec3-adf1-c05e75f8e7dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:29.197661 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e6cfd5-36b6-4ec3-adf1-c05e75f8e7dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:29.215971 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e6cfd5-36b6-4ec3-adf1-c05e75f8e7dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:29.218213 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e6cfd5-36b6-4ec3-adf1-c05e75f8e7dc service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:29.237495 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 830/1640] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:55:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:55:31.043995 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f80014a-4357-4b86-9995-9c3e8e9a4815 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:31.046173 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-4f80014a-4357-4b86-9995-9c3e8e9a4815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:31.063499 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f80014a-4357-4b86-9995-9c3e8e9a4815 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:31.071546 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3600b9a2-3f99-44c6-8a62-5a687b07e58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:31.073623 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3600b9a2-3f99-44c6-8a62-5a687b07e58f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:31.074786 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3600b9a2-3f99-44c6-8a62-5a687b07e58f admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:31.075646 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3600b9a2-3f99-44c6-8a62-5a687b07e58f admin admin] PATH_INFO: `/v3/projects/768c757de3db4eccb491b71ec25a0a8f` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:31.077589 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3600b9a2-3f99-44c6-8a62-5a687b07e58f admin admin] RBAC: Authorizing `identity:delete_project(project_id=768c757de3db4eccb491b71ec25a0a8f)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:31.084102 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3600b9a2-3f99-44c6-8a62-5a687b07e58f admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:31.180954 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-3600b9a2-3f99-44c6-8a62-5a687b07e58f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '768c757de3db4eccb491b71ec25a0a8f', 'request_id': 'req-3600b9a2-3f99-44c6-8a62-5a687b07e58f'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:55:31.213063 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-3600b9a2-3f99-44c6-8a62-5a687b07e58f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '768c757de3db4eccb491b71ec25a0a8f', 'request_id': 'req-3600b9a2-3f99-44c6-8a62-5a687b07e58f'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:55:31.232806 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-3600b9a2-3f99-44c6-8a62-5a687b07e58f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '768c757de3db4eccb491b71ec25a0a8f', 'request_id': 'req-3600b9a2-3f99-44c6-8a62-5a687b07e58f'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:55:31.265558 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-3600b9a2-3f99-44c6-8a62-5a687b07e58f admin admin] The token cache is being invalidate because project 768c757de3db4eccb491b71ec25a0a8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:55:31.266527 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-3600b9a2-3f99-44c6-8a62-5a687b07e58f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:55:31.267459 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-3600b9a2-3f99-44c6-8a62-5a687b07e58f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:55:31.275450 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371e03e-e52b-4618-adee-08131f25e398 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:31.276047 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371e03e-e52b-4618-adee-08131f25e398 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:31.276354 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371e03e-e52b-4618-adee-08131f25e398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:31.276775 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 811/1641] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 14:55:31 2022] DELETE /identity/v3/projects/768c757de3db4eccb491b71ec25a0a8f => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:55:31.327752 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-9371e03e-e52b-4618-adee-08131f25e398 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:55:31.329346 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-9371e03e-e52b-4618-adee-08131f25e398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:31.530584 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b5d5a0-e6cf-4e17-961a-59c7478514f7 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:31.531357 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b5d5a0-e6cf-4e17-961a-59c7478514f7 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:31.531487 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b5d5a0-e6cf-4e17-961a-59c7478514f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:31.542462 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 831/1642] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:55:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:55:31.572690 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-b9b5d5a0-e6cf-4e17-961a-59c7478514f7 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:55:31.575843 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b9b5d5a0-e6cf-4e17-961a-59c7478514f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:31.597226 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9371e03e-e52b-4618-adee-08131f25e398 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:31.613905 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 812/1643] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:55:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:55:31.623753 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9371e03e-e52b-4618-adee-08131f25e398 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:31.631093 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609f44b5-3f71-4118-98f6-8385e4839679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:31.631979 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609f44b5-3f71-4118-98f6-8385e4839679 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:31.632310 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609f44b5-3f71-4118-98f6-8385e4839679 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:31.633589 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609f44b5-3f71-4118-98f6-8385e4839679 admin admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:31.634363 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609f44b5-3f71-4118-98f6-8385e4839679 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:55:31.634673 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609f44b5-3f71-4118-98f6-8385e4839679 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:31.637327 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609f44b5-3f71-4118-98f6-8385e4839679 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:31.658914 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 832/1644] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 19 14:55:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:55:31.659415 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b5d5a0-e6cf-4e17-961a-59c7478514f7 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:31.674476 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b5d5a0-e6cf-4e17-961a-59c7478514f7 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:31.691793 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e3e6b6-541b-45e7-bd68-245ec372b21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:31.692575 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e3e6b6-541b-45e7-bd68-245ec372b21b admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:31.692883 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e3e6b6-541b-45e7-bd68-245ec372b21b admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:31.693175 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e3e6b6-541b-45e7-bd68-245ec372b21b admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:31.693817 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e3e6b6-541b-45e7-bd68-245ec372b21b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:31.698625 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e3e6b6-541b-45e7-bd68-245ec372b21b admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:31.763822 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 813/1645] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 14:55:31 2022] POST /identity/v3/projects => generated 375 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:55:31.769890 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609f44b5-3f71-4118-98f6-8385e4839679 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:31.778801 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e3e6b6-541b-45e7-bd68-245ec372b21b admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:31.784029 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-66e3e6b6-541b-45e7-bd68-245ec372b21b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:31.803997 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609f44b5-3f71-4118-98f6-8385e4839679 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:31.926845 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:55:32.010271 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5d8cb6-77a5-45ad-9ece-bd2a2441c97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:32.011183 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d8cb6-77a5-45ad-9ece-bd2a2441c97f admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:32.012819 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d8cb6-77a5-45ad-9ece-bd2a2441c97f admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:32.015707 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d8cb6-77a5-45ad-9ece-bd2a2441c97f admin admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:32.017192 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5d8cb6-77a5-45ad-9ece-bd2a2441c97f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:32.022680 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e3e6b6-541b-45e7-bd68-245ec372b21b admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:32.024752 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5d8cb6-77a5-45ad-9ece-bd2a2441c97f admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:32.048559 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a933df4-1774-4dcf-ad3e-84dacbf12a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:32.050099 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a933df4-1774-4dcf-ad3e-84dacbf12a65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:32.051527 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a933df4-1774-4dcf-ad3e-84dacbf12a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:32.053019 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a933df4-1774-4dcf-ad3e-84dacbf12a65 admin admin] PATH_INFO: `/v3/users/0849c164d4644da39055dfac64af06d4` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:32.061722 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a933df4-1774-4dcf-ad3e-84dacbf12a65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0849c164d4644da39055dfac64af06d4)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:32.069647 dv-cinder-756709-7-smb devstack@keystone.service[81472]: WARNING py.warnings [None req-9a933df4-1774-4dcf-ad3e-84dacbf12a65 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 14:55:32.069647 dv-cinder-756709-7-smb devstack@keystone.service[81472]: warnings.warn(msg) Sep 19 14:55:32.069647 dv-cinder-756709-7-smb devstack@keystone.service[81472]: Sep 19 14:55:32.070657 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 833/1646] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 14:55:31 2022] POST /identity/v3/users => generated 288 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:55:32.072610 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5d8cb6-77a5-45ad-9ece-bd2a2441c97f admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:32.085314 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a933df4-1774-4dcf-ad3e-84dacbf12a65 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:32.091274 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5d8cb6-77a5-45ad-9ece-bd2a2441c97f admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:32.104717 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6f561b-4d9b-43d7-b808-ec30350e9d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:32.106296 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6f561b-4d9b-43d7-b808-ec30350e9d9e admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:32.106646 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6f561b-4d9b-43d7-b808-ec30350e9d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:32.107071 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6f561b-4d9b-43d7-b808-ec30350e9d9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:32.108085 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6f561b-4d9b-43d7-b808-ec30350e9d9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:32.110232 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6f561b-4d9b-43d7-b808-ec30350e9d9e admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:32.132796 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 834/1647] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:55:32 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:55:32.134077 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6f561b-4d9b-43d7-b808-ec30350e9d9e admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:32.165207 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6f561b-4d9b-43d7-b808-ec30350e9d9e admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:32.176121 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0918c695-ea53-4673-92bb-14eddf295326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:32.177451 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0918c695-ea53-4673-92bb-14eddf295326 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:32.177738 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0918c695-ea53-4673-92bb-14eddf295326 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:32.178015 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0918c695-ea53-4673-92bb-14eddf295326 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:32.178806 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0918c695-ea53-4673-92bb-14eddf295326 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:32.181567 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0918c695-ea53-4673-92bb-14eddf295326 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:32.207438 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 835/1648] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:55:32 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:55:32.214106 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0918c695-ea53-4673-92bb-14eddf295326 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:32.228588 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0918c695-ea53-4673-92bb-14eddf295326 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:32.234162 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba104f1-2089-4847-adfd-831d08feb0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:32.234850 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba104f1-2089-4847-adfd-831d08feb0fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:32.235132 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba104f1-2089-4847-adfd-831d08feb0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:32.235479 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba104f1-2089-4847-adfd-831d08feb0fe admin admin] PATH_INFO: `/v3/projects/384d936be4124686ad9484f6316ddd2b/users/738d4b0425164ca2aa260a16d92967cb/roles/74de6794e3b3422b93d26f993d260c35` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:32.237302 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-9a933df4-1774-4dcf-ad3e-84dacbf12a65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0849c164d4644da39055dfac64af06d4'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:55:32.256003 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba104f1-2089-4847-adfd-831d08feb0fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=384d936be4124686ad9484f6316ddd2b, user_id=738d4b0425164ca2aa260a16d92967cb, role_id=74de6794e3b3422b93d26f993d260c35)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:32.258572 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-9a933df4-1774-4dcf-ad3e-84dacbf12a65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0849c164d4644da39055dfac64af06d4'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:55:32.259570 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba104f1-2089-4847-adfd-831d08feb0fe admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:32.260067 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-9a933df4-1774-4dcf-ad3e-84dacbf12a65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0849c164d4644da39055dfac64af06d4'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:55:32.262846 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-9a933df4-1774-4dcf-ad3e-84dacbf12a65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0849c164d4644da39055dfac64af06d4'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:55:32.276927 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:55:32.294440 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 836/1649] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 14:55:32 2022] PUT /identity/v3/projects/384d936be4124686ad9484f6316ddd2b/users/738d4b0425164ca2aa260a16d92967cb/roles/74de6794e3b3422b93d26f993d260c35 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:55:32.296411 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-9a933df4-1774-4dcf-ad3e-84dacbf12a65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0849c164d4644da39055dfac64af06d4'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:55:32.300909 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd44f4-d85f-4c38-9b18-0763fb79dc8e None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:32.301550 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd44f4-d85f-4c38-9b18-0763fb79dc8e None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:32.301879 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd44f4-d85f-4c38-9b18-0763fb79dc8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:32.395806 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-09fd44f4-d85f-4c38-9b18-0763fb79dc8e None None] MFA Rules not processed for user `738d4b0425164ca2aa260a16d92967cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:55:32.396809 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 814/1650] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 14:55:31 2022] DELETE /identity/v3/users/0849c164d4644da39055dfac64af06d4 => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:55:32.400777 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-09fd44f4-d85f-4c38-9b18-0763fb79dc8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:32.404365 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a8173a-5683-4eac-8d25-e7088e3b3f1d None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:32.405305 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a8173a-5683-4eac-8d25-e7088e3b3f1d None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:32.405592 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a8173a-5683-4eac-8d25-e7088e3b3f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:32.462415 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-79a8173a-5683-4eac-8d25-e7088e3b3f1d None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:55:32.463945 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-79a8173a-5683-4eac-8d25-e7088e3b3f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:32.557448 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 837/1651] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:55:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:55:32.567984 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fd44f4-d85f-4c38-9b18-0763fb79dc8e None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:32.570034 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-09fd44f4-d85f-4c38-9b18-0763fb79dc8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:32.628796 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 815/1652] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:55:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 14:55:32.705234 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a8173a-5683-4eac-8d25-e7088e3b3f1d None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:32.706857 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-79a8173a-5683-4eac-8d25-e7088e3b3f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:32.766690 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fd44f4-d85f-4c38-9b18-0763fb79dc8e None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:32.783229 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa162fc-0a32-48be-996c-97424e29758d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3017e5d92bef4cc2aeae4f28c78ba233', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:32.783924 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa162fc-0a32-48be-996c-97424e29758d service nova] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:32.784206 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa162fc-0a32-48be-996c-97424e29758d service nova] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:32.785082 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa162fc-0a32-48be-996c-97424e29758d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:32.809667 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa162fc-0a32-48be-996c-97424e29758d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:32.814546 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa162fc-0a32-48be-996c-97424e29758d service nova] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:32.844544 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 838/1653] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:55:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 14:55:32.853039 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a8173a-5683-4eac-8d25-e7088e3b3f1d None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:32.860124 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b92cfca-b7ac-4a9b-997e-e73759bd675f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:32.860429 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b92cfca-b7ac-4a9b-997e-e73759bd675f service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:32.860795 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b92cfca-b7ac-4a9b-997e-e73759bd675f service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:32.861025 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b92cfca-b7ac-4a9b-997e-e73759bd675f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:32.871153 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:55:32.886520 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b92cfca-b7ac-4a9b-997e-e73759bd675f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:32.888507 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b92cfca-b7ac-4a9b-997e-e73759bd675f service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:32.917346 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 816/1654] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:55:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 14:55:33.168817 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa162fc-0a32-48be-996c-97424e29758d service nova] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:33.170500 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-4aa162fc-0a32-48be-996c-97424e29758d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:33.194804 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa162fc-0a32-48be-996c-97424e29758d service nova] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:33.214977 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d5a02a-8465-49a3-b07b-1933d284dfbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:33.215835 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d5a02a-8465-49a3-b07b-1933d284dfbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:33.216114 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d5a02a-8465-49a3-b07b-1933d284dfbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:33.216554 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d5a02a-8465-49a3-b07b-1933d284dfbe admin admin] PATH_INFO: `/v3/users/738d4b0425164ca2aa260a16d92967cb` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:33.217862 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d5a02a-8465-49a3-b07b-1933d284dfbe admin admin] RBAC: Authorizing `identity:delete_user(user_id=738d4b0425164ca2aa260a16d92967cb)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:33.219830 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d5a02a-8465-49a3-b07b-1933d284dfbe admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:33.402182 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-51d5a02a-8465-49a3-b07b-1933d284dfbe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '738d4b0425164ca2aa260a16d92967cb'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:55:33.421908 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-51d5a02a-8465-49a3-b07b-1933d284dfbe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '738d4b0425164ca2aa260a16d92967cb'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:55:33.422672 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-51d5a02a-8465-49a3-b07b-1933d284dfbe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '738d4b0425164ca2aa260a16d92967cb'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:55:33.423576 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-51d5a02a-8465-49a3-b07b-1933d284dfbe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '738d4b0425164ca2aa260a16d92967cb'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:55:33.455722 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:55:33.461470 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-51d5a02a-8465-49a3-b07b-1933d284dfbe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '738d4b0425164ca2aa260a16d92967cb'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:55:33.493770 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 839/1655] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 14:55:33 2022] DELETE /identity/v3/users/738d4b0425164ca2aa260a16d92967cb => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:55:33.499611 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66545028-403d-4e38-a744-606565896ce5 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:33.500547 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66545028-403d-4e38-a744-606565896ce5 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:33.500971 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66545028-403d-4e38-a744-606565896ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:33.573726 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-66545028-403d-4e38-a744-606565896ce5 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:55:33.577432 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-66545028-403d-4e38-a744-606565896ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:33.876067 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 817/1656] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:55:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:55:34.049410 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d5a02a-8465-49a3-b07b-1933d284dfbe admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:34.050924 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-51d5a02a-8465-49a3-b07b-1933d284dfbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:34.075988 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d5a02a-8465-49a3-b07b-1933d284dfbe admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:34.097353 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48cfb02-ffa9-437d-8079-69110e391a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:34.098091 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48cfb02-ffa9-437d-8079-69110e391a04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:34.098728 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48cfb02-ffa9-437d-8079-69110e391a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:34.098965 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48cfb02-ffa9-437d-8079-69110e391a04 admin admin] PATH_INFO: `/v3/users/6de02da8424b46019a3ea0e73e8e0937` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:34.103226 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48cfb02-ffa9-437d-8079-69110e391a04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6de02da8424b46019a3ea0e73e8e0937)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:34.106343 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48cfb02-ffa9-437d-8079-69110e391a04 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:34.248625 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66545028-403d-4e38-a744-606565896ce5 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:34.250117 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-66545028-403d-4e38-a744-606565896ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:34.310276 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-e48cfb02-ffa9-437d-8079-69110e391a04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6de02da8424b46019a3ea0e73e8e0937'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:55:34.337105 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-e48cfb02-ffa9-437d-8079-69110e391a04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6de02da8424b46019a3ea0e73e8e0937'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:55:34.338247 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-e48cfb02-ffa9-437d-8079-69110e391a04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6de02da8424b46019a3ea0e73e8e0937'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:55:34.339672 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-e48cfb02-ffa9-437d-8079-69110e391a04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6de02da8424b46019a3ea0e73e8e0937'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:55:34.381780 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-e48cfb02-ffa9-437d-8079-69110e391a04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6de02da8424b46019a3ea0e73e8e0937'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:55:34.422485 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 840/1657] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 14:55:34 2022] DELETE /identity/v3/users/6de02da8424b46019a3ea0e73e8e0937 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:55:34.428539 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b25a4cb-85ad-42c8-9ad2-7fe3b23b51e0 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:34.428827 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b25a4cb-85ad-42c8-9ad2-7fe3b23b51e0 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:34.429122 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b25a4cb-85ad-42c8-9ad2-7fe3b23b51e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:34.455485 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66545028-403d-4e38-a744-606565896ce5 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:34.550819 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-4b25a4cb-85ad-42c8-9ad2-7fe3b23b51e0 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:55:34.553759 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-4b25a4cb-85ad-42c8-9ad2-7fe3b23b51e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:34.649846 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29293c3d-bf30-49ed-8b00-87f7211e919f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:34.650772 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29293c3d-bf30-49ed-8b00-87f7211e919f service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:34.651288 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29293c3d-bf30-49ed-8b00-87f7211e919f service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:34.654593 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29293c3d-bf30-49ed-8b00-87f7211e919f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:34.660388 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-29293c3d-bf30-49ed-8b00-87f7211e919f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:34.745017 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 841/1658] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:55:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:55:34.788082 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b25a4cb-85ad-42c8-9ad2-7fe3b23b51e0 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:34.789606 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-4b25a4cb-85ad-42c8-9ad2-7fe3b23b51e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:34.818257 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b25a4cb-85ad-42c8-9ad2-7fe3b23b51e0 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:34.828170 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aad340-f823-4bf4-857d-bfee6ca07003 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:34.828870 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aad340-f823-4bf4-857d-bfee6ca07003 service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:34.829190 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aad340-f823-4bf4-857d-bfee6ca07003 service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:34.829464 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aad340-f823-4bf4-857d-bfee6ca07003 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:34.903565 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aad340-f823-4bf4-857d-bfee6ca07003 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:34.909606 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aad340-f823-4bf4-857d-bfee6ca07003 service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:34.920863 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29293c3d-bf30-49ed-8b00-87f7211e919f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:34.922212 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29293c3d-bf30-49ed-8b00-87f7211e919f service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:34.943334 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 842/1659] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:55:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:55:34.944762 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:55:34.964155 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 818/1660] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:55:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 716 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 14:55:36.118263 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4564238a-503f-4bbc-bb1a-b981888a4f02 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:36.119407 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4564238a-503f-4bbc-bb1a-b981888a4f02 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:36.120054 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4564238a-503f-4bbc-bb1a-b981888a4f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:36.186035 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-4564238a-503f-4bbc-bb1a-b981888a4f02 None None] MFA Rules not processed for user `34c0f151ec0940449a2fb3e68b33925f`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:55:36.187408 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-4564238a-503f-4bbc-bb1a-b981888a4f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:36.269746 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:55:36.349068 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 843/1661] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:55:36 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:55:36.357235 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639ef2c9-b7fd-45d0-b304-4574a0a6842e None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:36.358860 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639ef2c9-b7fd-45d0-b304-4574a0a6842e None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:36.360071 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639ef2c9-b7fd-45d0-b304-4574a0a6842e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:36.376949 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4564238a-503f-4bbc-bb1a-b981888a4f02 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:36.378695 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-4564238a-503f-4bbc-bb1a-b981888a4f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:36.424248 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-639ef2c9-b7fd-45d0-b304-4574a0a6842e None None] MFA Rules not processed for user `34c0f151ec0940449a2fb3e68b33925f`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:55:36.427941 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4564238a-503f-4bbc-bb1a-b981888a4f02 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:36.429997 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-639ef2c9-b7fd-45d0-b304-4574a0a6842e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:36.446963 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6ebdc1-8ba7-47f2-a6e6-db39be874a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:36.448599 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ebdc1-8ba7-47f2-a6e6-db39be874a8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:36.449978 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ebdc1-8ba7-47f2-a6e6-db39be874a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:36.450624 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 819/1662] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:55:36 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:55:36.474330 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639ef2c9-b7fd-45d0-b304-4574a0a6842e None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:36.475374 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ebdc1-8ba7-47f2-a6e6-db39be874a8c admin admin] PATH_INFO: `/v3/projects/b39001af10bd401d939dad33af8da45d` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:36.476337 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-639ef2c9-b7fd-45d0-b304-4574a0a6842e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:36.478424 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6ebdc1-8ba7-47f2-a6e6-db39be874a8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b39001af10bd401d939dad33af8da45d)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:36.480837 dv-cinder-756709-7-smb devstack@keystone.service[81471]: WARNING py.warnings [None req-1a6ebdc1-8ba7-47f2-a6e6-db39be874a8c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 14:55:36.480837 dv-cinder-756709-7-smb devstack@keystone.service[81471]: warnings.warn(msg) Sep 19 14:55:36.480837 dv-cinder-756709-7-smb devstack@keystone.service[81471]: Sep 19 14:55:36.485390 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6ebdc1-8ba7-47f2-a6e6-db39be874a8c admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:36.680595 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-1a6ebdc1-8ba7-47f2-a6e6-db39be874a8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b39001af10bd401d939dad33af8da45d', 'request_id': 'req-1a6ebdc1-8ba7-47f2-a6e6-db39be874a8c'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:55:36.694520 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639ef2c9-b7fd-45d0-b304-4574a0a6842e None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:36.722524 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-1a6ebdc1-8ba7-47f2-a6e6-db39be874a8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b39001af10bd401d939dad33af8da45d', 'request_id': 'req-1a6ebdc1-8ba7-47f2-a6e6-db39be874a8c'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:55:36.740561 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-1a6ebdc1-8ba7-47f2-a6e6-db39be874a8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b39001af10bd401d939dad33af8da45d', 'request_id': 'req-1a6ebdc1-8ba7-47f2-a6e6-db39be874a8c'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:55:36.773256 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-1a6ebdc1-8ba7-47f2-a6e6-db39be874a8c admin admin] The token cache is being invalidate because project b39001af10bd401d939dad33af8da45d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:55:36.773552 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-1a6ebdc1-8ba7-47f2-a6e6-db39be874a8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:55:36.776083 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-1a6ebdc1-8ba7-47f2-a6e6-db39be874a8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:55:36.782816 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 844/1663] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 14:55:36 2022] DELETE /identity/v3/projects/b39001af10bd401d939dad33af8da45d => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 14:55:36.782816 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6ebdc1-8ba7-47f2-a6e6-db39be874a8c admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:36.784352 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-1a6ebdc1-8ba7-47f2-a6e6-db39be874a8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:36.903227 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc11883-28f9-4eee-b89e-f361fdc10a75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3017e5d92bef4cc2aeae4f28c78ba233', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:36.904588 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc11883-28f9-4eee-b89e-f361fdc10a75 service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:36.904873 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc11883-28f9-4eee-b89e-f361fdc10a75 service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:36.906475 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc11883-28f9-4eee-b89e-f361fdc10a75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:36.912187 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2cc11883-28f9-4eee-b89e-f361fdc10a75 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:36.955442 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6ebdc1-8ba7-47f2-a6e6-db39be874a8c admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:36.966358 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbed1fe4-478c-4dd9-a2d0-850aff85ce79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:36.967092 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed1fe4-478c-4dd9-a2d0-850aff85ce79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:36.967395 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed1fe4-478c-4dd9-a2d0-850aff85ce79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:36.967853 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed1fe4-478c-4dd9-a2d0-850aff85ce79 admin admin] PATH_INFO: `/v3/projects/895a41db8112420ebd5acb8e0b72b8f2` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:36.972202 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbed1fe4-478c-4dd9-a2d0-850aff85ce79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=895a41db8112420ebd5acb8e0b72b8f2)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:36.974365 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbed1fe4-478c-4dd9-a2d0-850aff85ce79 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:37.064636 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc11883-28f9-4eee-b89e-f361fdc10a75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:37.069260 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc11883-28f9-4eee-b89e-f361fdc10a75 service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:37.102764 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-cbed1fe4-478c-4dd9-a2d0-850aff85ce79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '895a41db8112420ebd5acb8e0b72b8f2', 'request_id': 'req-cbed1fe4-478c-4dd9-a2d0-850aff85ce79'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:55:37.105556 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 820/1664] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:55:36 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 631 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 14:55:37.107675 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc11883-28f9-4eee-b89e-f361fdc10a75 service nova] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:37.115562 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2cc11883-28f9-4eee-b89e-f361fdc10a75 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:37.128839 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-cbed1fe4-478c-4dd9-a2d0-850aff85ce79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '895a41db8112420ebd5acb8e0b72b8f2', 'request_id': 'req-cbed1fe4-478c-4dd9-a2d0-850aff85ce79'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:55:37.136296 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:55:37.142171 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-cbed1fe4-478c-4dd9-a2d0-850aff85ce79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '895a41db8112420ebd5acb8e0b72b8f2', 'request_id': 'req-cbed1fe4-478c-4dd9-a2d0-850aff85ce79'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:55:37.152507 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc11883-28f9-4eee-b89e-f361fdc10a75 service nova] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:37.169239 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-cbed1fe4-478c-4dd9-a2d0-850aff85ce79 admin admin] The token cache is being invalidate because project 895a41db8112420ebd5acb8e0b72b8f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:55:37.171915 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-cbed1fe4-478c-4dd9-a2d0-850aff85ce79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:55:37.175001 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-cbed1fe4-478c-4dd9-a2d0-850aff85ce79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:55:37.182306 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 845/1665] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 14:55:36 2022] DELETE /identity/v3/projects/895a41db8112420ebd5acb8e0b72b8f2 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:55:37.186098 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f466e30-9adc-460a-8cb6-b953d556b055 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:37.186452 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f466e30-9adc-460a-8cb6-b953d556b055 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:37.186786 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f466e30-9adc-460a-8cb6-b953d556b055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:37.235888 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-9f466e30-9adc-460a-8cb6-b953d556b055 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:55:37.246847 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:55:37.263354 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-9f466e30-9adc-460a-8cb6-b953d556b055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:37.420217 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d260e-cf49-425a-ba55-61c753a92079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:37.423204 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d260e-cf49-425a-ba55-61c753a92079 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:37.423500 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d260e-cf49-425a-ba55-61c753a92079 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:37.424385 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d260e-cf49-425a-ba55-61c753a92079 admin admin] PATH_INFO: `/v3/users/2efb97c678fa4b55979d8f942b3361db` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:37.428818 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 846/1666] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:55:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:55:37.430002 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366d260e-cf49-425a-ba55-61c753a92079 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2efb97c678fa4b55979d8f942b3361db)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:37.445383 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366d260e-cf49-425a-ba55-61c753a92079 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:37.452374 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3021dd0f-9418-4d0f-a936-819758d2f43e None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:37.453853 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3021dd0f-9418-4d0f-a936-819758d2f43e None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:37.457041 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3021dd0f-9418-4d0f-a936-819758d2f43e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:37.514612 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-3021dd0f-9418-4d0f-a936-819758d2f43e None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:55:37.522405 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-3021dd0f-9418-4d0f-a936-819758d2f43e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:37.561894 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 847/1667] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:55:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:55:37.563949 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3021dd0f-9418-4d0f-a936-819758d2f43e None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:37.582043 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-366d260e-cf49-425a-ba55-61c753a92079 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2efb97c678fa4b55979d8f942b3361db'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:55:37.595586 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-366d260e-cf49-425a-ba55-61c753a92079 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2efb97c678fa4b55979d8f942b3361db'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:55:37.598185 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-366d260e-cf49-425a-ba55-61c753a92079 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2efb97c678fa4b55979d8f942b3361db'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:55:37.600339 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-366d260e-cf49-425a-ba55-61c753a92079 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2efb97c678fa4b55979d8f942b3361db'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:55:37.622704 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3021dd0f-9418-4d0f-a936-819758d2f43e None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:37.623852 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-366d260e-cf49-425a-ba55-61c753a92079 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2efb97c678fa4b55979d8f942b3361db'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:55:37.636481 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647ec3af-ed6a-4fde-8274-a2abe4784e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:37.637191 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ec3af-ed6a-4fde-8274-a2abe4784e5d admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:37.637464 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ec3af-ed6a-4fde-8274-a2abe4784e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:37.637726 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ec3af-ed6a-4fde-8274-a2abe4784e5d admin admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:37.638375 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647ec3af-ed6a-4fde-8274-a2abe4784e5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:55:37.638678 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647ec3af-ed6a-4fde-8274-a2abe4784e5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:37.642262 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647ec3af-ed6a-4fde-8274-a2abe4784e5d admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:37.672001 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 821/1668] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 14:55:37 2022] DELETE /identity/v3/users/2efb97c678fa4b55979d8f942b3361db => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:55:37.683208 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 848/1669] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 19 14:55:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:55:37.688269 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d260e-cf49-425a-ba55-61c753a92079 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:37.689885 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-366d260e-cf49-425a-ba55-61c753a92079 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:37.855099 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d260e-cf49-425a-ba55-61c753a92079 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:37.869719 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ce5c77-0c62-47c8-96c0-26aaf59b5f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:37.870390 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce5c77-0c62-47c8-96c0-26aaf59b5f4a admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:37.870678 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce5c77-0c62-47c8-96c0-26aaf59b5f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:37.870959 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce5c77-0c62-47c8-96c0-26aaf59b5f4a admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:37.871613 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ce5c77-0c62-47c8-96c0-26aaf59b5f4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:37.873612 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ce5c77-0c62-47c8-96c0-26aaf59b5f4a admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:37.927020 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 822/1670] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 14:55:37 2022] POST /identity/v3/projects => generated 405 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 14:55:37.931034 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647ec3af-ed6a-4fde-8274-a2abe4784e5d admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:37.950509 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647ec3af-ed6a-4fde-8274-a2abe4784e5d admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:38.060365 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7228202f-f777-471c-a0f5-65cb3e9096bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:38.061861 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7228202f-f777-471c-a0f5-65cb3e9096bb admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:38.062184 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7228202f-f777-471c-a0f5-65cb3e9096bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:38.062457 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7228202f-f777-471c-a0f5-65cb3e9096bb admin admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:38.063119 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7228202f-f777-471c-a0f5-65cb3e9096bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:38.065587 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7228202f-f777-471c-a0f5-65cb3e9096bb admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:38.107871 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 849/1671] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 14:55:37 2022] POST /identity/v3/users => generated 303 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:55:38.108080 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ce5c77-0c62-47c8-96c0-26aaf59b5f4a admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:38.129070 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ce5c77-0c62-47c8-96c0-26aaf59b5f4a admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:38.138300 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494cf201-732b-4537-9f4f-d254b6636edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:38.139096 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494cf201-732b-4537-9f4f-d254b6636edc admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:38.139405 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494cf201-732b-4537-9f4f-d254b6636edc admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:38.139657 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494cf201-732b-4537-9f4f-d254b6636edc admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:38.140319 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494cf201-732b-4537-9f4f-d254b6636edc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:38.142004 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494cf201-732b-4537-9f4f-d254b6636edc admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:38.168200 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 823/1672] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:55:38 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:55:38.173355 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7228202f-f777-471c-a0f5-65cb3e9096bb admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:38.207692 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7228202f-f777-471c-a0f5-65cb3e9096bb admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:38.223279 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f02fb93-1b96-4d38-aca1-d01abd3ed4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:38.223775 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86715b0b-0174-4ea8-872a-f6fa9783e92b None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:38.224056 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86715b0b-0174-4ea8-872a-f6fa9783e92b None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:38.224224 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f02fb93-1b96-4d38-aca1-d01abd3ed4f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:38.224316 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86715b0b-0174-4ea8-872a-f6fa9783e92b None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:38.224644 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f02fb93-1b96-4d38-aca1-d01abd3ed4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:38.225097 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f02fb93-1b96-4d38-aca1-d01abd3ed4f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:38.225879 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 824/1673] 10.222.0.26 () {54 vars in 912 bytes} [Mon Sep 19 14:55:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 14:55:38.226135 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f02fb93-1b96-4d38-aca1-d01abd3ed4f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:38.229924 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f02fb93-1b96-4d38-aca1-d01abd3ed4f0 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:38.236881 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d072862c-23cd-49e2-b977-3ad917f3e371 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:38.237220 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d072862c-23cd-49e2-b977-3ad917f3e371 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:38.239708 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d072862c-23cd-49e2-b977-3ad917f3e371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:38.246026 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 850/1674] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:55:38 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:55:38.254849 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f02fb93-1b96-4d38-aca1-d01abd3ed4f0 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:38.292835 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f02fb93-1b96-4d38-aca1-d01abd3ed4f0 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:38.321287 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-d072862c-23cd-49e2-b977-3ad917f3e371 None None] MFA Rules not processed for user `d20a0d24e7034b6db447ba842ac986dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:55:38.323348 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d072862c-23cd-49e2-b977-3ad917f3e371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:38.348640 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f307297-7df9-45fb-b379-07a9986923b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:38.349402 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f307297-7df9-45fb-b379-07a9986923b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:38.349883 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f307297-7df9-45fb-b379-07a9986923b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:38.350255 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f307297-7df9-45fb-b379-07a9986923b4 admin admin] PATH_INFO: `/v3/projects/34fcd181687b45068534e6f7def1ac71/users/cb42f22f96f74cd5bdf36d5a0a236880/roles/74de6794e3b3422b93d26f993d260c35` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:38.360285 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:55:38.390678 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f307297-7df9-45fb-b379-07a9986923b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34fcd181687b45068534e6f7def1ac71, user_id=cb42f22f96f74cd5bdf36d5a0a236880, role_id=74de6794e3b3422b93d26f993d260c35)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:38.395023 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f307297-7df9-45fb-b379-07a9986923b4 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:38.434522 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 851/1675] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 14:55:38 2022] PUT /identity/v3/projects/34fcd181687b45068534e6f7def1ac71/users/cb42f22f96f74cd5bdf36d5a0a236880/roles/74de6794e3b3422b93d26f993d260c35 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:55:38.435725 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f307297-7df9-45fb-b379-07a9986923b4 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:38.437728 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-2f307297-7df9-45fb-b379-07a9986923b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:38.488817 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:55:38.497417 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 825/1676] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Sep 19 14:55:38 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 14:55:38.499529 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e0183-011b-4fa8-893a-9e6481d1ef6f None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:38.499972 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e0183-011b-4fa8-893a-9e6481d1ef6f None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:38.500256 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e0183-011b-4fa8-893a-9e6481d1ef6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:38.570460 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-d19e0183-011b-4fa8-893a-9e6481d1ef6f None None] MFA Rules not processed for user `cb42f22f96f74cd5bdf36d5a0a236880`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:55:38.571900 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d19e0183-011b-4fa8-893a-9e6481d1ef6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:38.597971 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f307297-7df9-45fb-b379-07a9986923b4 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:38.603729 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eae2b9-ea3f-4817-b05f-a37d0e19338f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:38.605093 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eae2b9-ea3f-4817-b05f-a37d0e19338f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:38.605707 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eae2b9-ea3f-4817-b05f-a37d0e19338f admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:38.605986 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eae2b9-ea3f-4817-b05f-a37d0e19338f admin admin] PATH_INFO: `/v3/projects/384d936be4124686ad9484f6316ddd2b` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:38.608012 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eae2b9-ea3f-4817-b05f-a37d0e19338f admin admin] RBAC: Authorizing `identity:delete_project(project_id=384d936be4124686ad9484f6316ddd2b)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:38.613969 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eae2b9-ea3f-4817-b05f-a37d0e19338f admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:38.730174 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-f7eae2b9-ea3f-4817-b05f-a37d0e19338f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '384d936be4124686ad9484f6316ddd2b', 'request_id': 'req-f7eae2b9-ea3f-4817-b05f-a37d0e19338f'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:55:38.740421 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-f7eae2b9-ea3f-4817-b05f-a37d0e19338f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '384d936be4124686ad9484f6316ddd2b', 'request_id': 'req-f7eae2b9-ea3f-4817-b05f-a37d0e19338f'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:55:38.744872 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 826/1677] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:55:38 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:55:38.746318 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19e0183-011b-4fa8-893a-9e6481d1ef6f None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:38.748662 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d19e0183-011b-4fa8-893a-9e6481d1ef6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:38.752413 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-f7eae2b9-ea3f-4817-b05f-a37d0e19338f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '384d936be4124686ad9484f6316ddd2b', 'request_id': 'req-f7eae2b9-ea3f-4817-b05f-a37d0e19338f'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:55:38.785642 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-f7eae2b9-ea3f-4817-b05f-a37d0e19338f admin admin] The token cache is being invalidate because project 384d936be4124686ad9484f6316ddd2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:55:38.785733 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-f7eae2b9-ea3f-4817-b05f-a37d0e19338f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:55:38.789861 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-f7eae2b9-ea3f-4817-b05f-a37d0e19338f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:55:38.797560 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 852/1678] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 14:55:38 2022] DELETE /identity/v3/projects/384d936be4124686ad9484f6316ddd2b => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:55:38.798772 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eae2b9-ea3f-4817-b05f-a37d0e19338f admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:38.802255 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-f7eae2b9-ea3f-4817-b05f-a37d0e19338f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:38.920329 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19e0183-011b-4fa8-893a-9e6481d1ef6f None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:38.962622 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eae2b9-ea3f-4817-b05f-a37d0e19338f admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:38.972354 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5fc98c-745b-450b-8fc0-630c7db6b97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:38.972979 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5fc98c-745b-450b-8fc0-630c7db6b97a admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:38.973350 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5fc98c-745b-450b-8fc0-630c7db6b97a admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:38.973620 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5fc98c-745b-450b-8fc0-630c7db6b97a admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:38.974259 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5fc98c-745b-450b-8fc0-630c7db6b97a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:38.976172 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5fc98c-745b-450b-8fc0-630c7db6b97a admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:38.993122 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8a477c-f883-4cbd-93a2-d57210716542 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:38.997789 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8a477c-f883-4cbd-93a2-d57210716542 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:38.997789 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8a477c-f883-4cbd-93a2-d57210716542 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:38.997789 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8a477c-f883-4cbd-93a2-d57210716542 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:39.000629 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-5b8a477c-f883-4cbd-93a2-d57210716542 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:39.013567 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8a477c-f883-4cbd-93a2-d57210716542 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:39.016010 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8a477c-f883-4cbd-93a2-d57210716542 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:39.028412 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 827/1679] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:55:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:55:39.029893 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deea0b8e-63bf-4118-925f-3a669696cbaf None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:39.030181 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deea0b8e-63bf-4118-925f-3a669696cbaf None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:39.031045 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deea0b8e-63bf-4118-925f-3a669696cbaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:39.042263 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 853/1680] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 14:55:38 2022] POST /identity/v3/projects => generated 405 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:55:39.050113 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5fc98c-745b-450b-8fc0-630c7db6b97a admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:39.059278 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:55:39.066893 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-deea0b8e-63bf-4118-925f-3a669696cbaf None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:55:39.068416 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-deea0b8e-63bf-4118-925f-3a669696cbaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:39.138548 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:55:39.173772 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 828/1681] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:55:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:55:39.186300 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5fc98c-745b-450b-8fc0-630c7db6b97a admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:39.191415 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71be206-7415-4292-bfb0-54f461cd5e9e None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:39.191911 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71be206-7415-4292-bfb0-54f461cd5e9e None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:39.193130 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71be206-7415-4292-bfb0-54f461cd5e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:39.203908 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbbd979-6423-40d9-b8f8-21dde0235ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:39.204945 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbbd979-6423-40d9-b8f8-21dde0235ed0 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:39.205092 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbbd979-6423-40d9-b8f8-21dde0235ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:39.205333 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbbd979-6423-40d9-b8f8-21dde0235ed0 admin admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:39.206823 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbbd979-6423-40d9-b8f8-21dde0235ed0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:39.207962 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbbd979-6423-40d9-b8f8-21dde0235ed0 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:39.240442 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-d71be206-7415-4292-bfb0-54f461cd5e9e None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:55:39.241930 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d71be206-7415-4292-bfb0-54f461cd5e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:39.254091 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 829/1682] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:55:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:55:39.258525 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 854/1683] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 14:55:39 2022] POST /identity/v3/users => generated 309 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:55:39.259362 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71be206-7415-4292-bfb0-54f461cd5e9e None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:39.259473 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbbd979-6423-40d9-b8f8-21dde0235ed0 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:39.272922 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71be206-7415-4292-bfb0-54f461cd5e9e None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:39.279148 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d869fb1-5202-425d-a4f8-91aae53009b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:39.280150 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d869fb1-5202-425d-a4f8-91aae53009b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:39.280641 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d869fb1-5202-425d-a4f8-91aae53009b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:39.281002 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d869fb1-5202-425d-a4f8-91aae53009b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:39.281742 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d869fb1-5202-425d-a4f8-91aae53009b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:55:39.282115 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d869fb1-5202-425d-a4f8-91aae53009b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:39.283941 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d869fb1-5202-425d-a4f8-91aae53009b1 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:39.287952 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbbd979-6423-40d9-b8f8-21dde0235ed0 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:39.307459 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 830/1684] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 19 14:55:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:55:39.308203 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5804de32-44bc-4e86-b3a0-65bff7cc54e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:39.308662 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d869fb1-5202-425d-a4f8-91aae53009b1 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:39.308882 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5804de32-44bc-4e86-b3a0-65bff7cc54e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:39.309332 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5804de32-44bc-4e86-b3a0-65bff7cc54e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:39.309600 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5804de32-44bc-4e86-b3a0-65bff7cc54e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:39.310251 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5804de32-44bc-4e86-b3a0-65bff7cc54e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:39.317339 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5804de32-44bc-4e86-b3a0-65bff7cc54e9 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:39.322525 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d869fb1-5202-425d-a4f8-91aae53009b1 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:39.328303 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93d49fa-20ec-4f0b-8e4b-4125c04b02f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:39.329167 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93d49fa-20ec-4f0b-8e4b-4125c04b02f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:39.329560 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93d49fa-20ec-4f0b-8e4b-4125c04b02f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:39.329899 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93d49fa-20ec-4f0b-8e4b-4125c04b02f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:39.331294 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93d49fa-20ec-4f0b-8e4b-4125c04b02f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:39.334947 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93d49fa-20ec-4f0b-8e4b-4125c04b02f1 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:39.358335 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 855/1685] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:55:39 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:55:39.359057 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5804de32-44bc-4e86-b3a0-65bff7cc54e9 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:39.384812 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5804de32-44bc-4e86-b3a0-65bff7cc54e9 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:39.400651 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f828d2-88c6-43cc-ba18-8022e75431ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:39.401397 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f828d2-88c6-43cc-ba18-8022e75431ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:39.403124 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f828d2-88c6-43cc-ba18-8022e75431ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:39.404238 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f828d2-88c6-43cc-ba18-8022e75431ad admin admin] PATH_INFO: `/v3/projects/78c474ded20644058923eadd52331774/users/068f53add1044d3ab00aab570d9f495b/roles/019bde1756cb40de8ce06cef6b261f79` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:39.424675 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 831/1686] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 14:55:39 2022] POST /identity/v3/projects => generated 369 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:55:39.427001 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93d49fa-20ec-4f0b-8e4b-4125c04b02f1 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:39.460640 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f828d2-88c6-43cc-ba18-8022e75431ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=78c474ded20644058923eadd52331774, user_id=068f53add1044d3ab00aab570d9f495b, role_id=019bde1756cb40de8ce06cef6b261f79)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:39.463420 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f828d2-88c6-43cc-ba18-8022e75431ad admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:39.515595 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 856/1687] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 14:55:39 2022] PUT /identity/v3/projects/78c474ded20644058923eadd52331774/users/068f53add1044d3ab00aab570d9f495b/roles/019bde1756cb40de8ce06cef6b261f79 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:55:39.516783 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f828d2-88c6-43cc-ba18-8022e75431ad admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:39.529874 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-04f828d2-88c6-43cc-ba18-8022e75431ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:39.549159 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93d49fa-20ec-4f0b-8e4b-4125c04b02f1 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:39.745262 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b63210a-15d9-45a9-be27-497b4d7648fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:39.746168 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b63210a-15d9-45a9-be27-497b4d7648fa admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:39.746451 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b63210a-15d9-45a9-be27-497b4d7648fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:39.746730 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b63210a-15d9-45a9-be27-497b4d7648fa admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:39.748197 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b63210a-15d9-45a9-be27-497b4d7648fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:39.752814 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b63210a-15d9-45a9-be27-497b4d7648fa admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:39.791878 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 832/1688] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 14:55:39 2022] POST /identity/v3/users => generated 285 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:55:39.798265 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b63210a-15d9-45a9-be27-497b4d7648fa admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:39.799553 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f828d2-88c6-43cc-ba18-8022e75431ad admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:39.804755 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:55:39.814561 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b63210a-15d9-45a9-be27-497b4d7648fa admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:39.816406 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d312d5-904c-49f1-8793-ad94baffb092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:39.817053 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d312d5-904c-49f1-8793-ad94baffb092 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:39.817310 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d312d5-904c-49f1-8793-ad94baffb092 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:39.817578 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d312d5-904c-49f1-8793-ad94baffb092 admin admin] PATH_INFO: `/v3/projects/928a02bfd26d4caf8e7fd3313273c852` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:39.819537 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d312d5-904c-49f1-8793-ad94baffb092 admin admin] RBAC: Authorizing `identity:delete_project(project_id=928a02bfd26d4caf8e7fd3313273c852)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:39.822017 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d312d5-904c-49f1-8793-ad94baffb092 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:39.822289 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed650a6-7753-4f33-8602-9e6dc4b01085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:39.822974 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed650a6-7753-4f33-8602-9e6dc4b01085 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:39.823407 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed650a6-7753-4f33-8602-9e6dc4b01085 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:39.823944 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed650a6-7753-4f33-8602-9e6dc4b01085 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:39.824707 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed650a6-7753-4f33-8602-9e6dc4b01085 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:39.833033 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed650a6-7753-4f33-8602-9e6dc4b01085 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:39.860346 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 833/1689] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:55:39 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:55:39.865430 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed650a6-7753-4f33-8602-9e6dc4b01085 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:39.889487 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed650a6-7753-4f33-8602-9e6dc4b01085 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:39.906294 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bb64d0-fccf-409a-b6bb-a936d7968891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:39.914230 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb64d0-fccf-409a-b6bb-a936d7968891 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:39.914537 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb64d0-fccf-409a-b6bb-a936d7968891 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:39.914825 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb64d0-fccf-409a-b6bb-a936d7968891 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:39.915679 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bb64d0-fccf-409a-b6bb-a936d7968891 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:39.917444 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bb64d0-fccf-409a-b6bb-a936d7968891 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:39.979724 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 834/1690] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:55:39 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:55:39.980729 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bb64d0-fccf-409a-b6bb-a936d7968891 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:39.993221 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-28d312d5-904c-49f1-8793-ad94baffb092 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '928a02bfd26d4caf8e7fd3313273c852', 'request_id': 'req-28d312d5-904c-49f1-8793-ad94baffb092'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:55:40.011083 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bb64d0-fccf-409a-b6bb-a936d7968891 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:40.022234 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-28d312d5-904c-49f1-8793-ad94baffb092 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '928a02bfd26d4caf8e7fd3313273c852', 'request_id': 'req-28d312d5-904c-49f1-8793-ad94baffb092'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:55:40.060852 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-28d312d5-904c-49f1-8793-ad94baffb092 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '928a02bfd26d4caf8e7fd3313273c852', 'request_id': 'req-28d312d5-904c-49f1-8793-ad94baffb092'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:55:40.094759 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-28d312d5-904c-49f1-8793-ad94baffb092 admin admin] The token cache is being invalidate because project 928a02bfd26d4caf8e7fd3313273c852 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:55:40.095421 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-28d312d5-904c-49f1-8793-ad94baffb092 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:55:40.096459 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-28d312d5-904c-49f1-8793-ad94baffb092 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:55:40.118434 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 857/1691] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 14:55:39 2022] DELETE /identity/v3/projects/928a02bfd26d4caf8e7fd3313273c852 => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:55:40.125209 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d312d5-904c-49f1-8793-ad94baffb092 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:40.129722 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-28d312d5-904c-49f1-8793-ad94baffb092 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:40.199951 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:55:40.201813 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97862076-bc83-4a78-b5d5-37b73b79e23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:40.203042 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97862076-bc83-4a78-b5d5-37b73b79e23a admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:40.203590 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97862076-bc83-4a78-b5d5-37b73b79e23a admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:40.204143 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97862076-bc83-4a78-b5d5-37b73b79e23a admin admin] PATH_INFO: `/v3/projects/78c474ded20644058923eadd52331774/users/068f53add1044d3ab00aab570d9f495b/roles/019bde1756cb40de8ce06cef6b261f79` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:40.211463 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97862076-bc83-4a78-b5d5-37b73b79e23a admin admin] RBAC: Authorizing `identity:create_grant(project_id=78c474ded20644058923eadd52331774, user_id=068f53add1044d3ab00aab570d9f495b, role_id=019bde1756cb40de8ce06cef6b261f79)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:40.220213 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97862076-bc83-4a78-b5d5-37b73b79e23a admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:40.275513 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 835/1692] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 14:55:39 2022] PUT /identity/v3/projects/78c474ded20644058923eadd52331774/users/068f53add1044d3ab00aab570d9f495b/roles/019bde1756cb40de8ce06cef6b261f79 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:55:40.277519 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65230e5f-97f6-415a-8397-2545ef8c43d3 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:40.278495 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65230e5f-97f6-415a-8397-2545ef8c43d3 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:40.280581 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65230e5f-97f6-415a-8397-2545ef8c43d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:40.329530 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-65230e5f-97f6-415a-8397-2545ef8c43d3 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:55:40.339501 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d312d5-904c-49f1-8793-ad94baffb092 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:40.341108 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-65230e5f-97f6-415a-8397-2545ef8c43d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:40.490351 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eda200-c3b8-41aa-b3f9-001d47feaa17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:40.491183 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eda200-c3b8-41aa-b3f9-001d47feaa17 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:40.491889 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eda200-c3b8-41aa-b3f9-001d47feaa17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:40.492423 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eda200-c3b8-41aa-b3f9-001d47feaa17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:40.493972 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eda200-c3b8-41aa-b3f9-001d47feaa17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:40.505267 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eda200-c3b8-41aa-b3f9-001d47feaa17 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:40.505869 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 836/1693] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:55:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:55:40.507551 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49310e9-94ac-4302-9aa0-c0c3a35f10d8 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:40.509390 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49310e9-94ac-4302-9aa0-c0c3a35f10d8 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:40.509783 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49310e9-94ac-4302-9aa0-c0c3a35f10d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:40.533840 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 858/1694] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:55:40 2022] GET /identity/v3/roles => generated 1420 bytes in 415 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:55:40.538118 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c02ac-d7a5-46c8-ba47-fa7528bb3449 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:40.538536 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c02ac-d7a5-46c8-ba47-fa7528bb3449 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:40.538924 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c02ac-d7a5-46c8-ba47-fa7528bb3449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:40.580635 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-f49310e9-94ac-4302-9aa0-c0c3a35f10d8 None None] MFA Rules not processed for user `068f53add1044d3ab00aab570d9f495b`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:55:40.581959 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f49310e9-94ac-4302-9aa0-c0c3a35f10d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:40.604016 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-304c02ac-d7a5-46c8-ba47-fa7528bb3449 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:55:40.608517 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-304c02ac-d7a5-46c8-ba47-fa7528bb3449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:40.645810 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 859/1695] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:55:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:55:40.650886 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304c02ac-d7a5-46c8-ba47-fa7528bb3449 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:40.673433 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304c02ac-d7a5-46c8-ba47-fa7528bb3449 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:40.690480 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1f57b0-ac67-4a03-91df-ec5040ce553c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:40.693904 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f57b0-ac67-4a03-91df-ec5040ce553c admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:40.694665 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f57b0-ac67-4a03-91df-ec5040ce553c admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:40.695318 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f57b0-ac67-4a03-91df-ec5040ce553c admin admin] PATH_INFO: `/v3/projects/abdc1ed269184df1aa62d49a03644d36/users/e8feb9bb504b46ef973b708a6b1ee7d7/roles/74de6794e3b3422b93d26f993d260c35` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:40.737877 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1f57b0-ac67-4a03-91df-ec5040ce553c admin admin] RBAC: Authorizing `identity:create_grant(project_id=abdc1ed269184df1aa62d49a03644d36, user_id=e8feb9bb504b46ef973b708a6b1ee7d7, role_id=74de6794e3b3422b93d26f993d260c35)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:40.741998 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1f57b0-ac67-4a03-91df-ec5040ce553c admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:40.757347 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:55:40.784189 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 837/1696] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:55:40 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:55:40.787958 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49310e9-94ac-4302-9aa0-c0c3a35f10d8 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:40.795236 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 860/1697] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 14:55:40 2022] PUT /identity/v3/projects/abdc1ed269184df1aa62d49a03644d36/users/e8feb9bb504b46ef973b708a6b1ee7d7/roles/74de6794e3b3422b93d26f993d260c35 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:55:40.800343 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1f57b0-ac67-4a03-91df-ec5040ce553c admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:40.809758 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-1e1f57b0-ac67-4a03-91df-ec5040ce553c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:40.852238 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49310e9-94ac-4302-9aa0-c0c3a35f10d8 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:41.081928 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bf73e1-0dbd-467e-9428-1086ae9041c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:41.082926 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf73e1-0dbd-467e-9428-1086ae9041c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:41.083460 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf73e1-0dbd-467e-9428-1086ae9041c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:41.087071 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf73e1-0dbd-467e-9428-1086ae9041c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:41.090433 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bf73e1-0dbd-467e-9428-1086ae9041c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:55:41.091298 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bf73e1-0dbd-467e-9428-1086ae9041c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:41.093392 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1f57b0-ac67-4a03-91df-ec5040ce553c admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:41.095023 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bf73e1-0dbd-467e-9428-1086ae9041c4 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:41.107312 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00890d9-4dcf-43fa-842b-4bf9e42c8774 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df648c909ddb41418128b43f925f5ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:41.107957 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00890d9-4dcf-43fa-842b-4bf9e42c8774 service cinder] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:41.108233 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00890d9-4dcf-43fa-842b-4bf9e42c8774 service cinder] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:41.108499 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00890d9-4dcf-43fa-842b-4bf9e42c8774 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:41.131363 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 838/1698] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 19 14:55:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:55:41.134438 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3b2d5-0967-4ebb-8ee8-61106f206b47 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:41.134731 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3b2d5-0967-4ebb-8ee8-61106f206b47 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:41.135003 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3b2d5-0967-4ebb-8ee8-61106f206b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:41.212073 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-2fb3b2d5-0967-4ebb-8ee8-61106f206b47 None None] MFA Rules not processed for user `e8feb9bb504b46ef973b708a6b1ee7d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:55:41.214549 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2fb3b2d5-0967-4ebb-8ee8-61106f206b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:41.282787 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:55:41.313687 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00890d9-4dcf-43fa-842b-4bf9e42c8774 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:41.319779 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00890d9-4dcf-43fa-842b-4bf9e42c8774 service cinder] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:41.335646 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 861/1699] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:55:40 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:55:41.336900 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00890d9-4dcf-43fa-842b-4bf9e42c8774 service cinder] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:41.338612 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-b00890d9-4dcf-43fa-842b-4bf9e42c8774 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:41.454886 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 839/1700] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:55:41 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:55:41.456336 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb3b2d5-0967-4ebb-8ee8-61106f206b47 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:41.480397 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb3b2d5-0967-4ebb-8ee8-61106f206b47 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:41.499125 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a93b71-aa9c-48a3-9ba5-fe8af4c65322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:41.499922 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a93b71-aa9c-48a3-9ba5-fe8af4c65322 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:41.500293 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a93b71-aa9c-48a3-9ba5-fe8af4c65322 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:41.500653 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a93b71-aa9c-48a3-9ba5-fe8af4c65322 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:41.501861 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a93b71-aa9c-48a3-9ba5-fe8af4c65322 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:41.506497 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a93b71-aa9c-48a3-9ba5-fe8af4c65322 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:41.557191 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00890d9-4dcf-43fa-842b-4bf9e42c8774 service cinder] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:41.577333 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c7d545-def5-41a9-a4cf-a8e7124b2613 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da0a58c526f34afda909e4ede2b1e1c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:41.578299 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c7d545-def5-41a9-a4cf-a8e7124b2613 service placement] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:41.578961 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c7d545-def5-41a9-a4cf-a8e7124b2613 service placement] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:41.579786 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c7d545-def5-41a9-a4cf-a8e7124b2613 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:41.583970 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-a2c7d545-def5-41a9-a4cf-a8e7124b2613 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:41.627308 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c7d545-def5-41a9-a4cf-a8e7124b2613 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:41.631573 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c7d545-def5-41a9-a4cf-a8e7124b2613 service placement] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:41.651304 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 840/1701] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 14:55:41 2022] POST /identity/v3/projects => generated 377 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:55:41.652697 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a93b71-aa9c-48a3-9ba5-fe8af4c65322 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:41.665075 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 862/1702] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:55:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:55:41.666068 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c7d545-def5-41a9-a4cf-a8e7124b2613 service placement] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:41.669876 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-a2c7d545-def5-41a9-a4cf-a8e7124b2613 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:41.707092 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c7d545-def5-41a9-a4cf-a8e7124b2613 service placement] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:41.871962 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a93b71-aa9c-48a3-9ba5-fe8af4c65322 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:41.885943 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad46b463-893d-4f51-820b-d0465ed39441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:41.886588 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46b463-893d-4f51-820b-d0465ed39441 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:41.886871 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46b463-893d-4f51-820b-d0465ed39441 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:41.887146 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46b463-893d-4f51-820b-d0465ed39441 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:41.887899 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad46b463-893d-4f51-820b-d0465ed39441 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:41.890042 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad46b463-893d-4f51-820b-d0465ed39441 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:41.895663 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730414fd-574b-41ca-b490-7c9b51e93c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:41.896322 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730414fd-574b-41ca-b490-7c9b51e93c38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:41.896598 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730414fd-574b-41ca-b490-7c9b51e93c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:41.896868 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730414fd-574b-41ca-b490-7c9b51e93c38 admin admin] PATH_INFO: `/v3/users/cb42f22f96f74cd5bdf36d5a0a236880` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:41.902438 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730414fd-574b-41ca-b490-7c9b51e93c38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb42f22f96f74cd5bdf36d5a0a236880)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:41.905263 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730414fd-574b-41ca-b490-7c9b51e93c38 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:41.905737 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:55:41.971388 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 841/1703] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 14:55:41 2022] POST /identity/v3/projects => generated 371 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:55:41.978964 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad46b463-893d-4f51-820b-d0465ed39441 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:42.041982 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-730414fd-574b-41ca-b490-7c9b51e93c38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb42f22f96f74cd5bdf36d5a0a236880'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:55:42.074781 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-730414fd-574b-41ca-b490-7c9b51e93c38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb42f22f96f74cd5bdf36d5a0a236880'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:55:42.075602 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-730414fd-574b-41ca-b490-7c9b51e93c38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb42f22f96f74cd5bdf36d5a0a236880'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:55:42.076411 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-730414fd-574b-41ca-b490-7c9b51e93c38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb42f22f96f74cd5bdf36d5a0a236880'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:55:42.115343 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-730414fd-574b-41ca-b490-7c9b51e93c38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb42f22f96f74cd5bdf36d5a0a236880'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:55:42.137685 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:55:42.160735 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad46b463-893d-4f51-820b-d0465ed39441 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:42.174605 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 863/1704] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 14:55:41 2022] DELETE /identity/v3/users/cb42f22f96f74cd5bdf36d5a0a236880 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:55:42.180164 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450b8e14-3675-424f-b66a-e77300f5c5b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:42.180786 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450b8e14-3675-424f-b66a-e77300f5c5b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:42.181081 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450b8e14-3675-424f-b66a-e77300f5c5b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:42.181358 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450b8e14-3675-424f-b66a-e77300f5c5b2 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:42.181740 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730414fd-574b-41ca-b490-7c9b51e93c38 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:42.186417 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-730414fd-574b-41ca-b490-7c9b51e93c38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:42.188588 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450b8e14-3675-424f-b66a-e77300f5c5b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:42.190894 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450b8e14-3675-424f-b66a-e77300f5c5b2 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:42.271295 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 842/1705] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 14:55:41 2022] POST /identity/v3/users => generated 289 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:55:42.276091 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d656f5-4498-4ec2-8de6-ede4e7cc5adb None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:42.279178 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d656f5-4498-4ec2-8de6-ede4e7cc5adb None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:42.279746 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d656f5-4498-4ec2-8de6-ede4e7cc5adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:42.334984 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730414fd-574b-41ca-b490-7c9b51e93c38 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:42.344179 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-c3d656f5-4498-4ec2-8de6-ede4e7cc5adb None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:55:42.346686 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2241ed9-49cb-4c50-a004-e275a53c96cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:42.347863 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2241ed9-49cb-4c50-a004-e275a53c96cf admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:42.347863 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2241ed9-49cb-4c50-a004-e275a53c96cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:42.348428 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2241ed9-49cb-4c50-a004-e275a53c96cf admin admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:42.349432 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2241ed9-49cb-4c50-a004-e275a53c96cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:42.350516 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-c3d656f5-4498-4ec2-8de6-ede4e7cc5adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:42.351626 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2241ed9-49cb-4c50-a004-e275a53c96cf admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:42.376295 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 843/1706] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:55:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:55:42.379661 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90549ab0-38ce-4ea9-9553-9c38b285ab09 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:42.379999 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90549ab0-38ce-4ea9-9553-9c38b285ab09 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:42.380211 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90549ab0-38ce-4ea9-9553-9c38b285ab09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:42.421575 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 864/1707] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 14:55:42 2022] POST /identity/v3/users => generated 292 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:55:42.424391 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2241ed9-49cb-4c50-a004-e275a53c96cf admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:42.428133 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-f2241ed9-49cb-4c50-a004-e275a53c96cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:42.465949 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-90549ab0-38ce-4ea9-9553-9c38b285ab09 None None] MFA Rules not processed for user `53fe9d2b2e8b4d22acb170b18f697515`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:55:42.467238 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-90549ab0-38ce-4ea9-9553-9c38b285ab09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:42.469474 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2241ed9-49cb-4c50-a004-e275a53c96cf admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:42.485025 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4d2f6f-8420-41a4-b187-8b7c21366394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:42.485751 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d2f6f-8420-41a4-b187-8b7c21366394 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:42.487018 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d2f6f-8420-41a4-b187-8b7c21366394 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:42.487359 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d2f6f-8420-41a4-b187-8b7c21366394 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:42.489325 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4d2f6f-8420-41a4-b187-8b7c21366394 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:42.493852 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4d2f6f-8420-41a4-b187-8b7c21366394 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:42.535635 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 865/1708] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:55:42 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:55:42.543616 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4d2f6f-8420-41a4-b187-8b7c21366394 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:42.566129 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4d2f6f-8420-41a4-b187-8b7c21366394 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:42.585102 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69f9a50-39a6-46aa-a159-1364c8ac88bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:42.585748 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69f9a50-39a6-46aa-a159-1364c8ac88bf admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:42.586120 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69f9a50-39a6-46aa-a159-1364c8ac88bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:42.586483 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69f9a50-39a6-46aa-a159-1364c8ac88bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:42.587452 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69f9a50-39a6-46aa-a159-1364c8ac88bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:42.590575 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69f9a50-39a6-46aa-a159-1364c8ac88bf admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:42.663898 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 866/1709] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:55:42 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:55:42.681620 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69f9a50-39a6-46aa-a159-1364c8ac88bf admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:42.687728 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-a69f9a50-39a6-46aa-a159-1364c8ac88bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:42.735907 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 844/1710] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:55:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:55:42.736915 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90549ab0-38ce-4ea9-9553-9c38b285ab09 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:42.793094 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90549ab0-38ce-4ea9-9553-9c38b285ab09 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:42.827952 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442d99e5-c0cc-4bde-8b74-99e42eeb1540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:42.831186 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442d99e5-c0cc-4bde-8b74-99e42eeb1540 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:42.831677 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442d99e5-c0cc-4bde-8b74-99e42eeb1540 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:42.832139 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442d99e5-c0cc-4bde-8b74-99e42eeb1540 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:42.835660 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442d99e5-c0cc-4bde-8b74-99e42eeb1540 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:42.840775 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442d99e5-c0cc-4bde-8b74-99e42eeb1540 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:42.895433 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 845/1711] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:55:42 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:55:42.896491 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442d99e5-c0cc-4bde-8b74-99e42eeb1540 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:42.933387 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442d99e5-c0cc-4bde-8b74-99e42eeb1540 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:42.955189 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835892cf-3873-4577-b431-1ba7ee717578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:42.956083 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835892cf-3873-4577-b431-1ba7ee717578 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:42.956384 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835892cf-3873-4577-b431-1ba7ee717578 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:42.956657 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835892cf-3873-4577-b431-1ba7ee717578 admin admin] PATH_INFO: `/v3/projects/55e9fceb3cbc4c9593d74693726dfce2/users/b69f2c8681dc4071b3b4c5295bba65a7/roles/019bde1756cb40de8ce06cef6b261f79` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:42.974620 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69f9a50-39a6-46aa-a159-1364c8ac88bf admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:42.999826 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf11fc5-c745-4edf-94f3-211e17fd822a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:43.000467 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf11fc5-c745-4edf-94f3-211e17fd822a service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:43.000747 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf11fc5-c745-4edf-94f3-211e17fd822a service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:43.001046 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf11fc5-c745-4edf-94f3-211e17fd822a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:43.002661 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835892cf-3873-4577-b431-1ba7ee717578 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55e9fceb3cbc4c9593d74693726dfce2, user_id=b69f2c8681dc4071b3b4c5295bba65a7, role_id=019bde1756cb40de8ce06cef6b261f79)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:43.008787 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835892cf-3873-4577-b431-1ba7ee717578 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:43.046618 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 846/1712] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 14:55:42 2022] PUT /identity/v3/projects/55e9fceb3cbc4c9593d74693726dfce2/users/b69f2c8681dc4071b3b4c5295bba65a7/roles/019bde1756cb40de8ce06cef6b261f79 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:55:43.048973 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835892cf-3873-4577-b431-1ba7ee717578 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:43.050821 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-835892cf-3873-4577-b431-1ba7ee717578 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:43.073929 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf11fc5-c745-4edf-94f3-211e17fd822a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:43.075911 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf11fc5-c745-4edf-94f3-211e17fd822a service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:43.095593 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 867/1713] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:55:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:55:43.105875 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf11fc5-c745-4edf-94f3-211e17fd822a service neutron] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:43.138925 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:55:43.139107 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf11fc5-c745-4edf-94f3-211e17fd822a service neutron] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:43.292568 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835892cf-3873-4577-b431-1ba7ee717578 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:43.313021 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85f5dc4-8f50-4b66-9dd0-77d5d3b00e0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3017e5d92bef4cc2aeae4f28c78ba233', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:43.316611 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f5dc4-8f50-4b66-9dd0-77d5d3b00e0b service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:43.317657 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f5dc4-8f50-4b66-9dd0-77d5d3b00e0b service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:43.317950 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f5dc4-8f50-4b66-9dd0-77d5d3b00e0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:43.324758 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c164c0-b1b5-472e-a12c-a4ae91d81f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:43.331866 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c164c0-b1b5-472e-a12c-a4ae91d81f6c admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:43.334303 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c164c0-b1b5-472e-a12c-a4ae91d81f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:43.337867 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c164c0-b1b5-472e-a12c-a4ae91d81f6c admin admin] PATH_INFO: `/v3/projects/76f1d83ac282440e998c3e44cec6532a/users/1e0b644e2f8940168f09650536beb9f3/roles/74de6794e3b3422b93d26f993d260c35` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:43.365746 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:55:43.381921 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c164c0-b1b5-472e-a12c-a4ae91d81f6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=76f1d83ac282440e998c3e44cec6532a, user_id=1e0b644e2f8940168f09650536beb9f3, role_id=74de6794e3b3422b93d26f993d260c35)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:43.385350 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c164c0-b1b5-472e-a12c-a4ae91d81f6c admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:43.444629 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 868/1714] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 14:55:43 2022] PUT /identity/v3/projects/76f1d83ac282440e998c3e44cec6532a/users/1e0b644e2f8940168f09650536beb9f3/roles/74de6794e3b3422b93d26f993d260c35 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:55:43.444629 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c164c0-b1b5-472e-a12c-a4ae91d81f6c admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:43.611003 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85f5dc4-8f50-4b66-9dd0-77d5d3b00e0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:43.612825 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85f5dc4-8f50-4b66-9dd0-77d5d3b00e0b service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:43.632454 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 847/1715] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:55:43 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 585 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:55:43.644806 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec607e-c419-44ea-af89-8d6bc7278b20 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:43.645362 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec607e-c419-44ea-af89-8d6bc7278b20 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:43.645833 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec607e-c419-44ea-af89-8d6bc7278b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:43.716848 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-7aec607e-c419-44ea-af89-8d6bc7278b20 None None] MFA Rules not processed for user `1e0b644e2f8940168f09650536beb9f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:55:43.719059 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-7aec607e-c419-44ea-af89-8d6bc7278b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:43.802486 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c164c0-b1b5-472e-a12c-a4ae91d81f6c admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:43.821530 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adb947f-df79-4d2e-bc22-721a36f703d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:43.822424 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adb947f-df79-4d2e-bc22-721a36f703d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:43.822804 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adb947f-df79-4d2e-bc22-721a36f703d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:43.823169 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adb947f-df79-4d2e-bc22-721a36f703d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:43.825170 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adb947f-df79-4d2e-bc22-721a36f703d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:43.832625 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adb947f-df79-4d2e-bc22-721a36f703d1 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:43.874436 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 869/1716] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:55:43 2022] GET /identity/v3/roles => generated 1420 bytes in 436 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:55:43.875659 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adb947f-df79-4d2e-bc22-721a36f703d1 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:43.928975 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adb947f-df79-4d2e-bc22-721a36f703d1 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:43.967154 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12409746-41ba-444a-92bb-0c39feb89d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:43.969926 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12409746-41ba-444a-92bb-0c39feb89d52 admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:43.973441 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12409746-41ba-444a-92bb-0c39feb89d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:43.973980 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12409746-41ba-444a-92bb-0c39feb89d52 admin admin] PATH_INFO: `/v3/projects/55e9fceb3cbc4c9593d74693726dfce2/users/b69f2c8681dc4071b3b4c5295bba65a7/roles/019bde1756cb40de8ce06cef6b261f79` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:43.980794 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12409746-41ba-444a-92bb-0c39feb89d52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55e9fceb3cbc4c9593d74693726dfce2, user_id=b69f2c8681dc4071b3b4c5295bba65a7, role_id=019bde1756cb40de8ce06cef6b261f79)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:44.000543 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12409746-41ba-444a-92bb-0c39feb89d52 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:44.022153 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 848/1717] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:55:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:55:44.023909 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aec607e-c419-44ea-af89-8d6bc7278b20 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:44.041574 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aec607e-c419-44ea-af89-8d6bc7278b20 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:44.077022 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 870/1718] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 14:55:43 2022] PUT /identity/v3/projects/55e9fceb3cbc4c9593d74693726dfce2/users/b69f2c8681dc4071b3b4c5295bba65a7/roles/019bde1756cb40de8ce06cef6b261f79 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:55:44.088983 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f92a1fb-2e3b-493b-8ad6-1a0dd3f69cb3 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:44.089548 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f92a1fb-2e3b-493b-8ad6-1a0dd3f69cb3 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:44.089922 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f92a1fb-2e3b-493b-8ad6-1a0dd3f69cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:44.178706 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-5f92a1fb-2e3b-493b-8ad6-1a0dd3f69cb3 None None] MFA Rules not processed for user `b69f2c8681dc4071b3b4c5295bba65a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:55:44.182239 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-5f92a1fb-2e3b-493b-8ad6-1a0dd3f69cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:44.233622 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:55:44.270155 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8ae7d9-1c44-405b-bce0-fccecdf1fc07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:44.270810 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8ae7d9-1c44-405b-bce0-fccecdf1fc07 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:44.271575 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8ae7d9-1c44-405b-bce0-fccecdf1fc07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:44.271856 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8ae7d9-1c44-405b-bce0-fccecdf1fc07 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:44.272645 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8ae7d9-1c44-405b-bce0-fccecdf1fc07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:44.275001 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8ae7d9-1c44-405b-bce0-fccecdf1fc07 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:44.348207 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 849/1719] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 14:55:44 2022] POST /identity/v3/projects => generated 377 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 14:55:44.354816 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8ae7d9-1c44-405b-bce0-fccecdf1fc07 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:44.467821 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 871/1720] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:55:44 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 380 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:55:44.496905 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f92a1fb-2e3b-493b-8ad6-1a0dd3f69cb3 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:44.498561 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-5f92a1fb-2e3b-493b-8ad6-1a0dd3f69cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:44.510235 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8ae7d9-1c44-405b-bce0-fccecdf1fc07 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:44.519246 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4567dd23-a580-4947-aedd-e643b8fd7d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:44.520846 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4567dd23-a580-4947-aedd-e643b8fd7d97 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:44.521175 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4567dd23-a580-4947-aedd-e643b8fd7d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:44.522456 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4567dd23-a580-4947-aedd-e643b8fd7d97 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:44.523162 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4567dd23-a580-4947-aedd-e643b8fd7d97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:44.525794 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4567dd23-a580-4947-aedd-e643b8fd7d97 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:44.593722 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 850/1721] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 14:55:44 2022] POST /identity/v3/users => generated 295 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:55:44.596091 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4567dd23-a580-4947-aedd-e643b8fd7d97 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:44.625866 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4567dd23-a580-4947-aedd-e643b8fd7d97 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:44.639052 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4716aea7-b155-4026-8c08-152a01e66c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:44.639677 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4716aea7-b155-4026-8c08-152a01e66c32 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:44.639956 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4716aea7-b155-4026-8c08-152a01e66c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:44.641195 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4716aea7-b155-4026-8c08-152a01e66c32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:44.644029 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4716aea7-b155-4026-8c08-152a01e66c32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:44.648824 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4716aea7-b155-4026-8c08-152a01e66c32 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:44.682826 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 851/1722] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:55:44 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:55:44.684382 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4716aea7-b155-4026-8c08-152a01e66c32 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:44.707362 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f92a1fb-2e3b-493b-8ad6-1a0dd3f69cb3 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:44.708808 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4716aea7-b155-4026-8c08-152a01e66c32 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:44.723421 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72aaae8-c4ca-4bf0-a24c-cf30cc612387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:44.724962 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:55:44.732794 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72aaae8-c4ca-4bf0-a24c-cf30cc612387 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:44.733096 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72aaae8-c4ca-4bf0-a24c-cf30cc612387 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:44.734241 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72aaae8-c4ca-4bf0-a24c-cf30cc612387 admin admin] PATH_INFO: `/v3/projects/35a87f624f5346cea3f686d9c996b3db/users/b70d0a4680ef454ab8cf3b07a986b284/roles/019bde1756cb40de8ce06cef6b261f79` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:44.798752 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72aaae8-c4ca-4bf0-a24c-cf30cc612387 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35a87f624f5346cea3f686d9c996b3db, user_id=b70d0a4680ef454ab8cf3b07a986b284, role_id=019bde1756cb40de8ce06cef6b261f79)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:44.801837 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72aaae8-c4ca-4bf0-a24c-cf30cc612387 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:44.824568 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 852/1723] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 14:55:44 2022] PUT /identity/v3/projects/35a87f624f5346cea3f686d9c996b3db/users/b70d0a4680ef454ab8cf3b07a986b284/roles/019bde1756cb40de8ce06cef6b261f79 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:55:44.824568 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93479b1-43d2-4848-971f-50753ec70c6c None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:44.824568 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93479b1-43d2-4848-971f-50753ec70c6c None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:44.824568 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93479b1-43d2-4848-971f-50753ec70c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:44.861868 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80e3be4-a12b-4189-81ce-68b950ec426a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df648c909ddb41418128b43f925f5ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:44.862728 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80e3be4-a12b-4189-81ce-68b950ec426a service cinder] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:44.863115 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80e3be4-a12b-4189-81ce-68b950ec426a service cinder] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:44.863490 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80e3be4-a12b-4189-81ce-68b950ec426a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:44.863642 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-e93479b1-43d2-4848-971f-50753ec70c6c None None] MFA Rules not processed for user `ab3ebacb745f4074bb708d9a40c9161d`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:55:44.864885 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e93479b1-43d2-4848-971f-50753ec70c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:45.022583 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80e3be4-a12b-4189-81ce-68b950ec426a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:45.026414 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 853/1724] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:55:44 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:55:45.027949 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80e3be4-a12b-4189-81ce-68b950ec426a service cinder] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:45.040581 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93479b1-43d2-4848-971f-50753ec70c6c None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:45.067140 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 872/1725] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:55:44 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 571 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 14:55:45.069073 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80e3be4-a12b-4189-81ce-68b950ec426a service cinder] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:45.118517 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:55:45.263603 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93479b1-43d2-4848-971f-50753ec70c6c None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:45.279162 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af4566f-1d9c-48b2-b93c-9ffc19e0cf96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:45.279808 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4566f-1d9c-48b2-b93c-9ffc19e0cf96 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:45.281186 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4566f-1d9c-48b2-b93c-9ffc19e0cf96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:45.281519 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4566f-1d9c-48b2-b93c-9ffc19e0cf96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:45.282147 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af4566f-1d9c-48b2-b93c-9ffc19e0cf96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:45.283775 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af4566f-1d9c-48b2-b93c-9ffc19e0cf96 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:45.318689 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 854/1726] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:55:45 2022] GET /identity/v3/roles => generated 1420 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:55:45.321401 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af4566f-1d9c-48b2-b93c-9ffc19e0cf96 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:45.326449 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-4af4566f-1d9c-48b2-b93c-9ffc19e0cf96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:45.342022 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80e3be4-a12b-4189-81ce-68b950ec426a service cinder] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:45.383749 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af4566f-1d9c-48b2-b93c-9ffc19e0cf96 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:45.403357 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb7ce76-f0d0-4bb4-9bec-77ca7bc60792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:45.404835 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb7ce76-f0d0-4bb4-9bec-77ca7bc60792 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:45.406888 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb7ce76-f0d0-4bb4-9bec-77ca7bc60792 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:45.406888 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb7ce76-f0d0-4bb4-9bec-77ca7bc60792 admin admin] PATH_INFO: `/v3/projects/34fcd181687b45068534e6f7def1ac71` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:45.412360 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb7ce76-f0d0-4bb4-9bec-77ca7bc60792 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34fcd181687b45068534e6f7def1ac71)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:45.416681 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb7ce76-f0d0-4bb4-9bec-77ca7bc60792 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:45.572932 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:55:45.600659 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f720aa-8830-4faa-aa90-186ed0de22ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3017e5d92bef4cc2aeae4f28c78ba233', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:45.603254 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f720aa-8830-4faa-aa90-186ed0de22ed service nova] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:45.603594 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f720aa-8830-4faa-aa90-186ed0de22ed service nova] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:45.603999 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f720aa-8830-4faa-aa90-186ed0de22ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:45.624628 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f720aa-8830-4faa-aa90-186ed0de22ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:45.626675 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f720aa-8830-4faa-aa90-186ed0de22ed service nova] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:45.632247 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ffb7ce76-f0d0-4bb4-9bec-77ca7bc60792 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34fcd181687b45068534e6f7def1ac71', 'request_id': 'req-ffb7ce76-f0d0-4bb4-9bec-77ca7bc60792'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:55:45.643015 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 873/1727] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:55:45 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 575 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:55:45.643928 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f720aa-8830-4faa-aa90-186ed0de22ed service nova] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:45.659921 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f720aa-8830-4faa-aa90-186ed0de22ed service nova] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:45.675982 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ffb7ce76-f0d0-4bb4-9bec-77ca7bc60792 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34fcd181687b45068534e6f7def1ac71', 'request_id': 'req-ffb7ce76-f0d0-4bb4-9bec-77ca7bc60792'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:55:45.710225 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ffb7ce76-f0d0-4bb4-9bec-77ca7bc60792 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34fcd181687b45068534e6f7def1ac71', 'request_id': 'req-ffb7ce76-f0d0-4bb4-9bec-77ca7bc60792'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:55:45.775562 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ffb7ce76-f0d0-4bb4-9bec-77ca7bc60792 admin admin] The token cache is being invalidate because project 34fcd181687b45068534e6f7def1ac71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:55:45.775780 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cc9331-db58-4de8-967c-8edd5bb868c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:45.775918 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ffb7ce76-f0d0-4bb4-9bec-77ca7bc60792 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:55:45.776812 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc9331-db58-4de8-967c-8edd5bb868c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:45.777133 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc9331-db58-4de8-967c-8edd5bb868c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:45.777415 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc9331-db58-4de8-967c-8edd5bb868c5 admin admin] PATH_INFO: `/v3/projects/35a87f624f5346cea3f686d9c996b3db/users/b70d0a4680ef454ab8cf3b07a986b284/roles/019bde1756cb40de8ce06cef6b261f79` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:45.780689 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cc9331-db58-4de8-967c-8edd5bb868c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35a87f624f5346cea3f686d9c996b3db, user_id=b70d0a4680ef454ab8cf3b07a986b284, role_id=019bde1756cb40de8ce06cef6b261f79)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:45.783596 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cc9331-db58-4de8-967c-8edd5bb868c5 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:45.784538 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ffb7ce76-f0d0-4bb4-9bec-77ca7bc60792 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:55:45.791803 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 855/1728] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 14:55:45 2022] DELETE /identity/v3/projects/34fcd181687b45068534e6f7def1ac71 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:55:45.792802 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb7ce76-f0d0-4bb4-9bec-77ca7bc60792 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:45.799454 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ffb7ce76-f0d0-4bb4-9bec-77ca7bc60792 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:45.800045 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 874/1729] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 14:55:45 2022] PUT /identity/v3/projects/35a87f624f5346cea3f686d9c996b3db/users/b70d0a4680ef454ab8cf3b07a986b284/roles/019bde1756cb40de8ce06cef6b261f79 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:55:45.801262 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cc9331-db58-4de8-967c-8edd5bb868c5 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:45.803323 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-d9cc9331-db58-4de8-967c-8edd5bb868c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:45.906216 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cc9331-db58-4de8-967c-8edd5bb868c5 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:45.914527 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40800345-9050-4760-b0d8-82ad0bf66fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:45.916142 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40800345-9050-4760-b0d8-82ad0bf66fc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:45.916517 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40800345-9050-4760-b0d8-82ad0bf66fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:45.916928 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40800345-9050-4760-b0d8-82ad0bf66fc8 admin admin] PATH_INFO: `/v3/users/068f53add1044d3ab00aab570d9f495b` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:45.918572 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40800345-9050-4760-b0d8-82ad0bf66fc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=068f53add1044d3ab00aab570d9f495b)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:45.922740 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40800345-9050-4760-b0d8-82ad0bf66fc8 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:45.982670 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb7ce76-f0d0-4bb4-9bec-77ca7bc60792 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:46.036411 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-40800345-9050-4760-b0d8-82ad0bf66fc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '068f53add1044d3ab00aab570d9f495b'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:55:46.063348 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-40800345-9050-4760-b0d8-82ad0bf66fc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '068f53add1044d3ab00aab570d9f495b'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:55:46.064433 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-40800345-9050-4760-b0d8-82ad0bf66fc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '068f53add1044d3ab00aab570d9f495b'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:55:46.071468 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-40800345-9050-4760-b0d8-82ad0bf66fc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '068f53add1044d3ab00aab570d9f495b'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:55:46.150597 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-40800345-9050-4760-b0d8-82ad0bf66fc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '068f53add1044d3ab00aab570d9f495b'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:55:46.187404 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:55:46.205934 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 875/1730] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 14:55:45 2022] DELETE /identity/v3/users/068f53add1044d3ab00aab570d9f495b => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:55:46.207013 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173419dc-6651-47d4-8d05-47458a5b16e8 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:46.207301 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173419dc-6651-47d4-8d05-47458a5b16e8 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:46.207578 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173419dc-6651-47d4-8d05-47458a5b16e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:46.224900 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358b5dab-198e-4679-8be3-bc03c17dcfb3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df648c909ddb41418128b43f925f5ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:46.225555 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b5dab-198e-4679-8be3-bc03c17dcfb3 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:46.225840 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b5dab-198e-4679-8be3-bc03c17dcfb3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:46.226114 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b5dab-198e-4679-8be3-bc03c17dcfb3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:46.232394 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-358b5dab-198e-4679-8be3-bc03c17dcfb3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:46.283979 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:55:46.311098 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-173419dc-6651-47d4-8d05-47458a5b16e8 None None] MFA Rules not processed for user `b70d0a4680ef454ab8cf3b07a986b284`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:55:46.316749 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-173419dc-6651-47d4-8d05-47458a5b16e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:46.474769 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358b5dab-198e-4679-8be3-bc03c17dcfb3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:46.478412 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358b5dab-198e-4679-8be3-bc03c17dcfb3 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:46.494611 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 876/1731] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:55:46 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:55:46.508549 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a437ae26-f870-4297-bcdc-3874d7b9bc85 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:46.509087 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 856/1732] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:55:45 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 717 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:55:46.512599 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358b5dab-198e-4679-8be3-bc03c17dcfb3 service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:46.517339 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-358b5dab-198e-4679-8be3-bc03c17dcfb3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:46.520652 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a437ae26-f870-4297-bcdc-3874d7b9bc85 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:46.521151 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a437ae26-f870-4297-bcdc-3874d7b9bc85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:46.536861 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358b5dab-198e-4679-8be3-bc03c17dcfb3 service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:46.618382 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad28829-dc63-45ae-9949-3965938f3361 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df648c909ddb41418128b43f925f5ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:46.619277 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad28829-dc63-45ae-9949-3965938f3361 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:46.619625 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad28829-dc63-45ae-9949-3965938f3361 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:46.619960 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad28829-dc63-45ae-9949-3965938f3361 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:46.626516 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-3ad28829-dc63-45ae-9949-3965938f3361 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:46.725700 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-a437ae26-f870-4297-bcdc-3874d7b9bc85 None None] MFA Rules not processed for user `2c2b1ac1a17c43d28da8f7e9a199dea4`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:55:46.730624 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-a437ae26-f870-4297-bcdc-3874d7b9bc85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:46.839933 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad28829-dc63-45ae-9949-3965938f3361 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:46.846940 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad28829-dc63-45ae-9949-3965938f3361 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:46.892743 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 857/1733] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:55:46 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:55:47.002407 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 877/1734] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Sep 19 14:55:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 507 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:55:47.221973 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad28829-dc63-45ae-9949-3965938f3361 service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:47.223416 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-3ad28829-dc63-45ae-9949-3965938f3361 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:47.450847 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:55:47.646291 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad28829-dc63-45ae-9949-3965938f3361 service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:47.663425 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dc6bee-d11f-47c9-b090-a59994b36884 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cb60a5e90343e69a38db4356cb3a90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:47.664049 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc6bee-d11f-47c9-b090-a59994b36884 service swift] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:47.664476 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc6bee-d11f-47c9-b090-a59994b36884 service swift] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:47.664921 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc6bee-d11f-47c9-b090-a59994b36884 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:47.688043 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dc6bee-d11f-47c9-b090-a59994b36884 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:47.689728 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dc6bee-d11f-47c9-b090-a59994b36884 service swift] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:47.720881 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 858/1735] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Sep 19 14:55:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 14:55:50.259084 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8ae38f-a891-4118-8443-b8ef14a0ae7b None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:50.259084 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8ae38f-a891-4118-8443-b8ef14a0ae7b None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:50.259590 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8ae38f-a891-4118-8443-b8ef14a0ae7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:50.360230 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-ff8ae38f-a891-4118-8443-b8ef14a0ae7b None None] MFA Rules not processed for user `f1c836a721f54178a02d864ce57c776e`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:55:50.363586 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-ff8ae38f-a891-4118-8443-b8ef14a0ae7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:50.487149 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dc6bee-d11f-47c9-b090-a59994b36884 service swift] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:50.491530 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-09dc6bee-d11f-47c9-b090-a59994b36884 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:50.529438 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:55:50.542517 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dc6bee-d11f-47c9-b090-a59994b36884 service swift] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:50.561834 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1251e8-8c6a-4042-a339-3ed20f2208cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df648c909ddb41418128b43f925f5ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:50.564196 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1251e8-8c6a-4042-a339-3ed20f2208cb service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:50.564636 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1251e8-8c6a-4042-a339-3ed20f2208cb service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:50.565170 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1251e8-8c6a-4042-a339-3ed20f2208cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:50.602416 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1251e8-8c6a-4042-a339-3ed20f2208cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:50.605579 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1251e8-8c6a-4042-a339-3ed20f2208cb service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:50.617526 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 878/1736] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:55:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:55:50.619460 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccffb22-9178-4312-80b7-b35d108fb6ac None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:50.619714 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccffb22-9178-4312-80b7-b35d108fb6ac None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:50.623390 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccffb22-9178-4312-80b7-b35d108fb6ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:50.654741 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 859/1737] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:55:50 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:55:50.657603 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1251e8-8c6a-4042-a339-3ed20f2208cb service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:50.659537 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-cf1251e8-8c6a-4042-a339-3ed20f2208cb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:50.775549 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-0ccffb22-9178-4312-80b7-b35d108fb6ac None None] MFA Rules not processed for user `f063128266bb4a34bb0f0639dfa63334`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:55:50.779851 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-0ccffb22-9178-4312-80b7-b35d108fb6ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:50.996167 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 879/1738] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:55:50 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 377 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:55:50.998797 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa6dac1-c82c-41aa-9fe4-1d0893e96445 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:51.001161 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa6dac1-c82c-41aa-9fe4-1d0893e96445 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:51.002219 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa6dac1-c82c-41aa-9fe4-1d0893e96445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:51.021594 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1251e8-8c6a-4042-a339-3ed20f2208cb service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:51.042591 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933c4e41-34f7-4155-a8fa-20bcca0235a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3017e5d92bef4cc2aeae4f28c78ba233', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:51.044418 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c4e41-34f7-4155-a8fa-20bcca0235a6 service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:51.044698 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c4e41-34f7-4155-a8fa-20bcca0235a6 service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:51.045692 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-9aa6dac1-c82c-41aa-9fe4-1d0893e96445 None None] MFA Rules not processed for user `d20a0d24e7034b6db447ba842ac986dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:55:51.047032 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-9aa6dac1-c82c-41aa-9fe4-1d0893e96445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:51.048768 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c4e41-34f7-4155-a8fa-20bcca0235a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:51.085476 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933c4e41-34f7-4155-a8fa-20bcca0235a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:51.089159 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933c4e41-34f7-4155-a8fa-20bcca0235a6 service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:51.122292 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 860/1739] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:55:50 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:55:51.135262 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a1bc84-63a7-4781-bcf8-0e1e2499ee7a None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:51.135901 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a1bc84-63a7-4781-bcf8-0e1e2499ee7a None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:51.136863 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a1bc84-63a7-4781-bcf8-0e1e2499ee7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:51.209879 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-88a1bc84-63a7-4781-bcf8-0e1e2499ee7a None None] MFA Rules not processed for user `f063128266bb4a34bb0f0639dfa63334`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:55:51.212816 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-88a1bc84-63a7-4781-bcf8-0e1e2499ee7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:51.224093 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 861/1740] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:55:51 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:55:51.224961 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a1bc84-63a7-4781-bcf8-0e1e2499ee7a None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:51.229629 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-88a1bc84-63a7-4781-bcf8-0e1e2499ee7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:51.244973 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 880/1741] 10.222.0.67 () {58 vars in 1015 bytes} [Mon Sep 19 14:55:50 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:55:51.326857 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa6dac1-c82c-41aa-9fe4-1d0893e96445 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:51.328468 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-9aa6dac1-c82c-41aa-9fe4-1d0893e96445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:51.351179 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa6dac1-c82c-41aa-9fe4-1d0893e96445 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:51.363775 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21dd97a-5fc6-4c23-8924-df6ef5d59734 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:51.364591 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21dd97a-5fc6-4c23-8924-df6ef5d59734 service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:51.366450 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21dd97a-5fc6-4c23-8924-df6ef5d59734 service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:51.370087 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21dd97a-5fc6-4c23-8924-df6ef5d59734 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:51.397719 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21dd97a-5fc6-4c23-8924-df6ef5d59734 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:51.399566 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21dd97a-5fc6-4c23-8924-df6ef5d59734 service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:51.429429 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 881/1742] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:55:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:55:51.430467 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21dd97a-5fc6-4c23-8924-df6ef5d59734 service neutron] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:51.494594 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21dd97a-5fc6-4c23-8924-df6ef5d59734 service neutron] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:51.499848 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a1bc84-63a7-4781-bcf8-0e1e2499ee7a None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:51.512031 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57607a01-0cac-471f-989a-118bd320cd1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3017e5d92bef4cc2aeae4f28c78ba233', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:51.512730 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57607a01-0cac-471f-989a-118bd320cd1e service nova] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:51.513047 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57607a01-0cac-471f-989a-118bd320cd1e service nova] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:51.515768 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57607a01-0cac-471f-989a-118bd320cd1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:51.518602 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fabda0-dba6-42a5-a483-dd8acc11f7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:51.521784 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fabda0-dba6-42a5-a483-dd8acc11f7ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:51.522334 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fabda0-dba6-42a5-a483-dd8acc11f7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:51.524651 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fabda0-dba6-42a5-a483-dd8acc11f7ff admin admin] PATH_INFO: `/v3/projects/78c474ded20644058923eadd52331774` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:51.526773 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fabda0-dba6-42a5-a483-dd8acc11f7ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=78c474ded20644058923eadd52331774)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:51.539893 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fabda0-dba6-42a5-a483-dd8acc11f7ff admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:51.551064 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57607a01-0cac-471f-989a-118bd320cd1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:51.554418 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57607a01-0cac-471f-989a-118bd320cd1e service nova] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:51.607349 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 882/1743] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:55:51 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:55:51.751341 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:55:51.815022 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-84fabda0-dba6-42a5-a483-dd8acc11f7ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78c474ded20644058923eadd52331774', 'request_id': 'req-84fabda0-dba6-42a5-a483-dd8acc11f7ff'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:55:51.860536 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-84fabda0-dba6-42a5-a483-dd8acc11f7ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78c474ded20644058923eadd52331774', 'request_id': 'req-84fabda0-dba6-42a5-a483-dd8acc11f7ff'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:55:51.883605 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-84fabda0-dba6-42a5-a483-dd8acc11f7ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78c474ded20644058923eadd52331774', 'request_id': 'req-84fabda0-dba6-42a5-a483-dd8acc11f7ff'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:55:51.918623 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-84fabda0-dba6-42a5-a483-dd8acc11f7ff admin admin] The token cache is being invalidate because project 78c474ded20644058923eadd52331774 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:55:51.919870 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-84fabda0-dba6-42a5-a483-dd8acc11f7ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:55:51.921399 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-84fabda0-dba6-42a5-a483-dd8acc11f7ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:55:51.924834 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 862/1744] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 14:55:51 2022] DELETE /identity/v3/projects/78c474ded20644058923eadd52331774 => generated 0 bytes in 700 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:55:51.930396 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c1ce4-aa28-4dc9-b28c-a555ecd24cdf None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:51.930684 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c1ce4-aa28-4dc9-b28c-a555ecd24cdf None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:51.931028 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c1ce4-aa28-4dc9-b28c-a555ecd24cdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:51.984136 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-028c1ce4-aa28-4dc9-b28c-a555ecd24cdf None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:55:51.988105 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-028c1ce4-aa28-4dc9-b28c-a555ecd24cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:52.122812 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:55:52.144820 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 883/1745] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:55:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:55:52.152613 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb11a08c-2b0e-4cc6-8b6c-81af5e241653 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:52.153025 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb11a08c-2b0e-4cc6-8b6c-81af5e241653 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:52.153373 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb11a08c-2b0e-4cc6-8b6c-81af5e241653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:52.206342 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-cb11a08c-2b0e-4cc6-8b6c-81af5e241653 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:55:52.209100 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-cb11a08c-2b0e-4cc6-8b6c-81af5e241653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:52.219090 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 863/1746] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:55:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:55:52.224282 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028c1ce4-aa28-4dc9-b28c-a555ecd24cdf None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:52.235705 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028c1ce4-aa28-4dc9-b28c-a555ecd24cdf None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:52.280352 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941ae0fc-c145-4b1f-8fef-d43475ccb80a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:52.280905 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ae0fc-c145-4b1f-8fef-d43475ccb80a admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:52.281240 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ae0fc-c145-4b1f-8fef-d43475ccb80a admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:52.281511 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ae0fc-c145-4b1f-8fef-d43475ccb80a admin admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:52.282175 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941ae0fc-c145-4b1f-8fef-d43475ccb80a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:55:52.282481 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941ae0fc-c145-4b1f-8fef-d43475ccb80a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:52.284437 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941ae0fc-c145-4b1f-8fef-d43475ccb80a admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:52.324640 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb11a08c-2b0e-4cc6-8b6c-81af5e241653 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:52.344126 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 884/1747] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 19 14:55:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:55:52.353070 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb11a08c-2b0e-4cc6-8b6c-81af5e241653 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:52.365450 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74ecfe3-281a-4c9e-aaff-0d9c3b9560f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:52.366359 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ecfe3-281a-4c9e-aaff-0d9c3b9560f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:52.367746 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ecfe3-281a-4c9e-aaff-0d9c3b9560f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:52.368205 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ecfe3-281a-4c9e-aaff-0d9c3b9560f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:52.372971 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74ecfe3-281a-4c9e-aaff-0d9c3b9560f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:52.378096 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74ecfe3-281a-4c9e-aaff-0d9c3b9560f0 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:52.471886 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941ae0fc-c145-4b1f-8fef-d43475ccb80a admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:52.482802 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 864/1748] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 14:55:52 2022] POST /identity/v3/projects => generated 363 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:55:52.487178 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941ae0fc-c145-4b1f-8fef-d43475ccb80a admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:52.693032 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33d7cd9-34db-4af3-bc62-97b5f5053ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:52.694271 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33d7cd9-34db-4af3-bc62-97b5f5053ede admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:52.696725 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33d7cd9-34db-4af3-bc62-97b5f5053ede admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:52.699465 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33d7cd9-34db-4af3-bc62-97b5f5053ede admin admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:52.701588 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33d7cd9-34db-4af3-bc62-97b5f5053ede admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:52.705655 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33d7cd9-34db-4af3-bc62-97b5f5053ede admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:52.785693 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 885/1749] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 14:55:52 2022] POST /identity/v3/users => generated 282 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 14:55:52.785796 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74ecfe3-281a-4c9e-aaff-0d9c3b9560f0 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:52.806968 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74ecfe3-281a-4c9e-aaff-0d9c3b9560f0 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:52.846036 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8d47aa-3323-4477-8ed6-555a58451e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:52.846681 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d47aa-3323-4477-8ed6-555a58451e11 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:52.855669 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d47aa-3323-4477-8ed6-555a58451e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:52.866382 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d47aa-3323-4477-8ed6-555a58451e11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:52.866382 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8d47aa-3323-4477-8ed6-555a58451e11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:52.872646 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8d47aa-3323-4477-8ed6-555a58451e11 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:52.923213 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 865/1750] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:55:52 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:55:52.924764 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33d7cd9-34db-4af3-bc62-97b5f5053ede admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:52.967320 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33d7cd9-34db-4af3-bc62-97b5f5053ede admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:53.003247 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1b69e2-7f0a-49ff-b05e-db4b364dd885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:53.007725 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1b69e2-7f0a-49ff-b05e-db4b364dd885 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:53.011932 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1b69e2-7f0a-49ff-b05e-db4b364dd885 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:53.013385 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1b69e2-7f0a-49ff-b05e-db4b364dd885 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:53.014911 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1b69e2-7f0a-49ff-b05e-db4b364dd885 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:53.046332 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1b69e2-7f0a-49ff-b05e-db4b364dd885 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:53.092331 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 886/1751] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:55:52 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:55:53.096866 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8d47aa-3323-4477-8ed6-555a58451e11 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:53.113656 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8d47aa-3323-4477-8ed6-555a58451e11 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:53.130667 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5668a0f-30d4-4cd8-bd53-f75568622725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:53.131360 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5668a0f-30d4-4cd8-bd53-f75568622725 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:53.132137 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5668a0f-30d4-4cd8-bd53-f75568622725 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:53.132137 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5668a0f-30d4-4cd8-bd53-f75568622725 admin admin] PATH_INFO: `/v3/projects/7d37eaeecb82427eacd373d98b7b5400/users/1cf26746d7754c05890d063c13deb452/roles/74de6794e3b3422b93d26f993d260c35` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:53.166325 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5668a0f-30d4-4cd8-bd53-f75568622725 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d37eaeecb82427eacd373d98b7b5400, user_id=1cf26746d7754c05890d063c13deb452, role_id=74de6794e3b3422b93d26f993d260c35)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:53.169277 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5668a0f-30d4-4cd8-bd53-f75568622725 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:53.206359 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 866/1752] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 14:55:53 2022] PUT /identity/v3/projects/7d37eaeecb82427eacd373d98b7b5400/users/1cf26746d7754c05890d063c13deb452/roles/74de6794e3b3422b93d26f993d260c35 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:55:53.219681 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0393df76-099b-4192-90d5-2e78f07ab59e None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:53.220327 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0393df76-099b-4192-90d5-2e78f07ab59e None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:53.220704 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0393df76-099b-4192-90d5-2e78f07ab59e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:53.317476 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-0393df76-099b-4192-90d5-2e78f07ab59e None None] MFA Rules not processed for user `1cf26746d7754c05890d063c13deb452`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:55:53.330470 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-0393df76-099b-4192-90d5-2e78f07ab59e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:53.645535 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 887/1753] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:55:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 427 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:55:53.650501 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5668a0f-30d4-4cd8-bd53-f75568622725 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:53.932027 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5668a0f-30d4-4cd8-bd53-f75568622725 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:53.968092 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49ee45f-55ab-4906-bc93-106941664d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:53.968901 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ee45f-55ab-4906-bc93-106941664d84 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:53.970734 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ee45f-55ab-4906-bc93-106941664d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:53.971031 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ee45f-55ab-4906-bc93-106941664d84 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:53.974213 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49ee45f-55ab-4906-bc93-106941664d84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:53.984103 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49ee45f-55ab-4906-bc93-106941664d84 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:54.094350 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3524513c-41bd-4104-b1c1-c6fe2e3d5225 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:54.094638 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3524513c-41bd-4104-b1c1-c6fe2e3d5225 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:54.094938 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3524513c-41bd-4104-b1c1-c6fe2e3d5225 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:54.096500 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 888/1754] 10.222.0.26 () {54 vars in 912 bytes} [Mon Sep 19 14:55:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:55:54.123960 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a334d9ee-01fb-4699-b59f-2b7f66e34f3a None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:54.124255 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a334d9ee-01fb-4699-b59f-2b7f66e34f3a None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:54.124536 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a334d9ee-01fb-4699-b59f-2b7f66e34f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:54.149971 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 867/1755] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 14:55:53 2022] POST /identity/v3/projects => generated 363 bytes in 497 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:55:54.166366 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49ee45f-55ab-4906-bc93-106941664d84 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:54.227950 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-a334d9ee-01fb-4699-b59f-2b7f66e34f3a None None] MFA Rules not processed for user `d20a0d24e7034b6db447ba842ac986dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:55:54.247779 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-a334d9ee-01fb-4699-b59f-2b7f66e34f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:54.522674 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:55:54.569179 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49ee45f-55ab-4906-bc93-106941664d84 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:54.589582 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533939b2-104c-4f0b-ac39-a3c142141b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:54.590626 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533939b2-104c-4f0b-ac39-a3c142141b77 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:54.591055 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533939b2-104c-4f0b-ac39-a3c142141b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:54.591475 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533939b2-104c-4f0b-ac39-a3c142141b77 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:54.592564 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533939b2-104c-4f0b-ac39-a3c142141b77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:54.595828 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533939b2-104c-4f0b-ac39-a3c142141b77 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:54.628137 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 889/1756] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Sep 19 14:55:54 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 505 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 14:55:54.672976 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a334d9ee-01fb-4699-b59f-2b7f66e34f3a None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:54.674499 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-a334d9ee-01fb-4699-b59f-2b7f66e34f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:54.690759 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:55:54.698321 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a334d9ee-01fb-4699-b59f-2b7f66e34f3a None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:54.728629 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970839b3-2855-4587-852f-897727264f2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:54.729343 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970839b3-2855-4587-852f-897727264f2d service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:54.729666 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970839b3-2855-4587-852f-897727264f2d service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:54.729935 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970839b3-2855-4587-852f-897727264f2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:54.730968 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 868/1757] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 14:55:54 2022] POST /identity/v3/users => generated 288 bytes in 572 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:55:54.732053 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533939b2-104c-4f0b-ac39-a3c142141b77 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:54.764122 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970839b3-2855-4587-852f-897727264f2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:54.766744 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970839b3-2855-4587-852f-897727264f2d service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:54.789023 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533939b2-104c-4f0b-ac39-a3c142141b77 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:54.798904 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 890/1758] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:55:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:55:54.809493 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2088638-15b2-438f-8111-3b3a5e7efccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:54.811001 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2088638-15b2-438f-8111-3b3a5e7efccd admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:54.813933 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2088638-15b2-438f-8111-3b3a5e7efccd admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:54.814218 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2088638-15b2-438f-8111-3b3a5e7efccd admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:54.815253 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2088638-15b2-438f-8111-3b3a5e7efccd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:54.844899 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2088638-15b2-438f-8111-3b3a5e7efccd admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:54.918654 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970839b3-2855-4587-852f-897727264f2d service neutron] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:54.920581 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 869/1759] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:55:54 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:55:54.962607 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970839b3-2855-4587-852f-897727264f2d service neutron] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:55.011428 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2344da5-d5f7-474d-a61f-f3b2c3247e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:55.012343 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2344da5-d5f7-474d-a61f-f3b2c3247e4b admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:55.013043 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2344da5-d5f7-474d-a61f-f3b2c3247e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:55.013043 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2344da5-d5f7-474d-a61f-f3b2c3247e4b admin admin] PATH_INFO: `/v3/projects/e10ec9579cd24da689d672563ead32f7/users/a813dcfe73304ef59a243690cdc8fafd/roles/019bde1756cb40de8ce06cef6b261f79` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:55.091241 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2344da5-d5f7-474d-a61f-f3b2c3247e4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e10ec9579cd24da689d672563ead32f7, user_id=a813dcfe73304ef59a243690cdc8fafd, role_id=019bde1756cb40de8ce06cef6b261f79)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:55.096293 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2344da5-d5f7-474d-a61f-f3b2c3247e4b admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:55.152742 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 891/1760] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 14:55:54 2022] PUT /identity/v3/projects/e10ec9579cd24da689d672563ead32f7/users/a813dcfe73304ef59a243690cdc8fafd/roles/019bde1756cb40de8ce06cef6b261f79 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 14:55:55.158070 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2088638-15b2-438f-8111-3b3a5e7efccd admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:55.190407 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2088638-15b2-438f-8111-3b3a5e7efccd admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:55.462164 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dfc30d-8465-4b78-be54-a12501d67f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:55.464069 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dfc30d-8465-4b78-be54-a12501d67f9f admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:55.465279 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dfc30d-8465-4b78-be54-a12501d67f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:55.465998 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dfc30d-8465-4b78-be54-a12501d67f9f admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:55.468172 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dfc30d-8465-4b78-be54-a12501d67f9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:55.470862 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dfc30d-8465-4b78-be54-a12501d67f9f admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:55.505981 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2344da5-d5f7-474d-a61f-f3b2c3247e4b admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:55.517886 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 870/1761] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:55:55 2022] GET /identity/v3/roles => generated 1420 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:55:55.536110 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2344da5-d5f7-474d-a61f-f3b2c3247e4b admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:55.551847 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9acf37-93f4-4955-a70f-84d871fdcd1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:55.552819 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9acf37-93f4-4955-a70f-84d871fdcd1b admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:55.553349 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9acf37-93f4-4955-a70f-84d871fdcd1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:55.554522 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9acf37-93f4-4955-a70f-84d871fdcd1b admin admin] PATH_INFO: `/v3/projects/e10ec9579cd24da689d672563ead32f7/users/a813dcfe73304ef59a243690cdc8fafd/roles/019bde1756cb40de8ce06cef6b261f79` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:55.562060 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9acf37-93f4-4955-a70f-84d871fdcd1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e10ec9579cd24da689d672563ead32f7, user_id=a813dcfe73304ef59a243690cdc8fafd, role_id=019bde1756cb40de8ce06cef6b261f79)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:55.570513 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9acf37-93f4-4955-a70f-84d871fdcd1b admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:55.633103 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 892/1762] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 14:55:55 2022] PUT /identity/v3/projects/e10ec9579cd24da689d672563ead32f7/users/a813dcfe73304ef59a243690cdc8fafd/roles/019bde1756cb40de8ce06cef6b261f79 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 14:55:55.643935 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa2500-b965-459c-a4de-8a5c0a913653 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:55.644831 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa2500-b965-459c-a4de-8a5c0a913653 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:55.645344 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa2500-b965-459c-a4de-8a5c0a913653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:55.706873 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-88aa2500-b965-459c-a4de-8a5c0a913653 None None] MFA Rules not processed for user `a813dcfe73304ef59a243690cdc8fafd`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:55:55.708913 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-88aa2500-b965-459c-a4de-8a5c0a913653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:56.052868 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 871/1763] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:55:55 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 413 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:55:56.068361 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9acf37-93f4-4955-a70f-84d871fdcd1b admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:56.070974 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-1d9acf37-93f4-4955-a70f-84d871fdcd1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:56.218046 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9acf37-93f4-4955-a70f-84d871fdcd1b admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:56.233209 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aea3664-4ea8-4aab-ae66-80bb9bc14455 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df648c909ddb41418128b43f925f5ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:56.234008 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea3664-4ea8-4aab-ae66-80bb9bc14455 service cinder] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:56.234339 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea3664-4ea8-4aab-ae66-80bb9bc14455 service cinder] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:56.234588 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea3664-4ea8-4aab-ae66-80bb9bc14455 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:56.267726 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aea3664-4ea8-4aab-ae66-80bb9bc14455 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:56.279681 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aea3664-4ea8-4aab-ae66-80bb9bc14455 service cinder] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:56.316807 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 893/1764] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:55:56 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:55:57.235842 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e36ab-a285-46c3-907b-85d0b85e1e56 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:57.236334 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e36ab-a285-46c3-907b-85d0b85e1e56 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:57.236422 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e36ab-a285-46c3-907b-85d0b85e1e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:57.239087 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ab809-caaf-4297-aeff-1c6e862db782 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:57.240793 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ab809-caaf-4297-aeff-1c6e862db782 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:57.241302 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ab809-caaf-4297-aeff-1c6e862db782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:57.338045 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-0c6ab809-caaf-4297-aeff-1c6e862db782 None None] MFA Rules not processed for user `f063128266bb4a34bb0f0639dfa63334`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:55:57.338764 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-586e36ab-a285-46c3-907b-85d0b85e1e56 None None] MFA Rules not processed for user `ab3ebacb745f4074bb708d9a40c9161d`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:55:57.341951 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-0c6ab809-caaf-4297-aeff-1c6e862db782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:57.342301 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-586e36ab-a285-46c3-907b-85d0b85e1e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:57.542512 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:55:57.583224 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 872/1765] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:55:57 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:55:57.585713 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43351787-6190-4ecc-a161-342f0087dae6 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:57.585861 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43351787-6190-4ecc-a161-342f0087dae6 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:57.586288 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43351787-6190-4ecc-a161-342f0087dae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:57.619150 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 894/1766] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:55:57 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 381 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:55:57.652100 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-43351787-6190-4ecc-a161-342f0087dae6 None None] MFA Rules not processed for user `53fe9d2b2e8b4d22acb170b18f697515`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:55:57.653385 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-43351787-6190-4ecc-a161-342f0087dae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:57.823196 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6ab809-caaf-4297-aeff-1c6e862db782 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:57.854161 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 873/1767] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:55:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:55:58.124560 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6ab809-caaf-4297-aeff-1c6e862db782 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:58.143391 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fdcc56-f570-463f-8082-d24f823b57f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:58.143962 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fdcc56-f570-463f-8082-d24f823b57f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:58.144299 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fdcc56-f570-463f-8082-d24f823b57f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:58.144497 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fdcc56-f570-463f-8082-d24f823b57f3 admin admin] PATH_INFO: `/v3/users/1cf26746d7754c05890d063c13deb452` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:58.146247 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fdcc56-f570-463f-8082-d24f823b57f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cf26746d7754c05890d063c13deb452)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:58.151476 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fdcc56-f570-463f-8082-d24f823b57f3 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:58.156863 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:55:58.260382 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-d3fdcc56-f570-463f-8082-d24f823b57f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cf26746d7754c05890d063c13deb452'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:55:58.278178 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-d3fdcc56-f570-463f-8082-d24f823b57f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cf26746d7754c05890d063c13deb452'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:55:58.280158 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-d3fdcc56-f570-463f-8082-d24f823b57f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cf26746d7754c05890d063c13deb452'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:55:58.281274 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-d3fdcc56-f570-463f-8082-d24f823b57f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cf26746d7754c05890d063c13deb452'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:55:58.311647 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-d3fdcc56-f570-463f-8082-d24f823b57f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cf26746d7754c05890d063c13deb452'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:55:58.396971 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 895/1768] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 14:55:57 2022] DELETE /identity/v3/users/1cf26746d7754c05890d063c13deb452 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:55:58.402244 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c850668-5ab3-4581-9208-6a133e4f7efd None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:58.403067 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c850668-5ab3-4581-9208-6a133e4f7efd None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:58.403471 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c850668-5ab3-4581-9208-6a133e4f7efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:58.451588 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-8c850668-5ab3-4581-9208-6a133e4f7efd None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:55:58.452825 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-8c850668-5ab3-4581-9208-6a133e4f7efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:58.688265 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 874/1769] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:55:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:55:58.754734 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fdcc56-f570-463f-8082-d24f823b57f3 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:55:58.756362 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-d3fdcc56-f570-463f-8082-d24f823b57f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:58.894490 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fdcc56-f570-463f-8082-d24f823b57f3 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:55:58.906706 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e967d615-1140-4d9c-83d4-73e985de8b20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:55:58.906706 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e967d615-1140-4d9c-83d4-73e985de8b20 service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:58.911677 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e967d615-1140-4d9c-83d4-73e985de8b20 service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:58.912154 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e967d615-1140-4d9c-83d4-73e985de8b20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:58.948224 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e967d615-1140-4d9c-83d4-73e985de8b20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:55:58.957493 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e967d615-1140-4d9c-83d4-73e985de8b20 service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:55:58.990664 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 896/1770] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:55:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:55:59.402993 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775e6d33-52bb-4bf5-b153-b54eff89055f None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:59.404004 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775e6d33-52bb-4bf5-b153-b54eff89055f None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:59.404471 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775e6d33-52bb-4bf5-b153-b54eff89055f None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:59.406508 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 875/1771] 10.222.0.26 () {54 vars in 921 bytes} [Mon Sep 19 14:55:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:55:59.506244 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6fdcdd-80ce-4685-8db5-8756f632a44d None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:55:59.506710 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6fdcdd-80ce-4685-8db5-8756f632a44d None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:55:59.506710 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6fdcdd-80ce-4685-8db5-8756f632a44d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:55:59.568324 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-7b6fdcdd-80ce-4685-8db5-8756f632a44d None None] MFA Rules not processed for user `3017e5d92bef4cc2aeae4f28c78ba233`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:55:59.574320 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-7b6fdcdd-80ce-4685-8db5-8756f632a44d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:55:59.873640 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 897/1772] 10.222.0.26 () {58 vars in 1018 bytes} [Mon Sep 19 14:55:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:56:00.406921 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775e6d33-52bb-4bf5-b153-b54eff89055f None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:00.412418 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-775e6d33-52bb-4bf5-b153-b54eff89055f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:00.461650 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775e6d33-52bb-4bf5-b153-b54eff89055f None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:00.513051 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777c30d2-3b59-4e8e-b43d-41c55ce37ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:00.514375 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c30d2-3b59-4e8e-b43d-41c55ce37ef8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:00.536727 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c30d2-3b59-4e8e-b43d-41c55ce37ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:00.538060 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c30d2-3b59-4e8e-b43d-41c55ce37ef8 admin admin] PATH_INFO: `/v3/projects/7d37eaeecb82427eacd373d98b7b5400` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:00.541639 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777c30d2-3b59-4e8e-b43d-41c55ce37ef8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d37eaeecb82427eacd373d98b7b5400)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:00.556537 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777c30d2-3b59-4e8e-b43d-41c55ce37ef8 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:00.661442 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-777c30d2-3b59-4e8e-b43d-41c55ce37ef8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d37eaeecb82427eacd373d98b7b5400', 'request_id': 'req-777c30d2-3b59-4e8e-b43d-41c55ce37ef8'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:00.714915 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-777c30d2-3b59-4e8e-b43d-41c55ce37ef8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d37eaeecb82427eacd373d98b7b5400', 'request_id': 'req-777c30d2-3b59-4e8e-b43d-41c55ce37ef8'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:00.750244 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-777c30d2-3b59-4e8e-b43d-41c55ce37ef8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d37eaeecb82427eacd373d98b7b5400', 'request_id': 'req-777c30d2-3b59-4e8e-b43d-41c55ce37ef8'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:00.822100 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-777c30d2-3b59-4e8e-b43d-41c55ce37ef8 admin admin] The token cache is being invalidate because project 7d37eaeecb82427eacd373d98b7b5400 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:56:00.822427 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-777c30d2-3b59-4e8e-b43d-41c55ce37ef8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:00.832698 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-777c30d2-3b59-4e8e-b43d-41c55ce37ef8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:00.840372 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 876/1773] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 14:56:00 2022] DELETE /identity/v3/projects/7d37eaeecb82427eacd373d98b7b5400 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:56:00.841439 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6fdcdd-80ce-4685-8db5-8756f632a44d None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:00.864267 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6fdcdd-80ce-4685-8db5-8756f632a44d None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:00.892968 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:01.113311 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0e5a64-17d6-492b-9333-ac50b5d2971b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:01.114384 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0e5a64-17d6-492b-9333-ac50b5d2971b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:01.114799 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0e5a64-17d6-492b-9333-ac50b5d2971b admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:01.115314 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0e5a64-17d6-492b-9333-ac50b5d2971b admin admin] PATH_INFO: `/v3/users/a813dcfe73304ef59a243690cdc8fafd` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:01.116647 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0e5a64-17d6-492b-9333-ac50b5d2971b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a813dcfe73304ef59a243690cdc8fafd)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:01.124607 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0e5a64-17d6-492b-9333-ac50b5d2971b admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:01.246515 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-fb0e5a64-17d6-492b-9333-ac50b5d2971b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a813dcfe73304ef59a243690cdc8fafd'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:01.285269 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-fb0e5a64-17d6-492b-9333-ac50b5d2971b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a813dcfe73304ef59a243690cdc8fafd'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:01.286187 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-fb0e5a64-17d6-492b-9333-ac50b5d2971b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a813dcfe73304ef59a243690cdc8fafd'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:01.290055 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-fb0e5a64-17d6-492b-9333-ac50b5d2971b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a813dcfe73304ef59a243690cdc8fafd'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:01.348283 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-fb0e5a64-17d6-492b-9333-ac50b5d2971b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a813dcfe73304ef59a243690cdc8fafd'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:01.389121 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 898/1774] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 14:56:00 2022] DELETE /identity/v3/users/a813dcfe73304ef59a243690cdc8fafd => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 14:56:01.750478 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777c30d2-3b59-4e8e-b43d-41c55ce37ef8 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:01.757264 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-777c30d2-3b59-4e8e-b43d-41c55ce37ef8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:01.885812 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:02.011448 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777c30d2-3b59-4e8e-b43d-41c55ce37ef8 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:02.311579 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54762713-81c3-4393-b416-eebee1aa9d3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3017e5d92bef4cc2aeae4f28c78ba233', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:02.318481 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54762713-81c3-4393-b416-eebee1aa9d3d service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:02.318900 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54762713-81c3-4393-b416-eebee1aa9d3d service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:02.319275 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54762713-81c3-4393-b416-eebee1aa9d3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:02.325859 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-54762713-81c3-4393-b416-eebee1aa9d3d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:02.384182 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54762713-81c3-4393-b416-eebee1aa9d3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:02.391287 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54762713-81c3-4393-b416-eebee1aa9d3d service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:02.437645 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 877/1775] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:56:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 688 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:56:03.127350 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85e4a28-5796-4b1f-91b9-0277c3c0e995 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:03.127848 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85e4a28-5796-4b1f-91b9-0277c3c0e995 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:03.128044 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85e4a28-5796-4b1f-91b9-0277c3c0e995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:03.216340 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-b85e4a28-5796-4b1f-91b9-0277c3c0e995 None None] MFA Rules not processed for user `f1c836a721f54178a02d864ce57c776e`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:03.218498 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-b85e4a28-5796-4b1f-91b9-0277c3c0e995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:03.531403 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 899/1776] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:56:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 405 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:56:05.561770 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54762713-81c3-4393-b416-eebee1aa9d3d service nova] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:05.564229 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-54762713-81c3-4393-b416-eebee1aa9d3d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:05.823713 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54762713-81c3-4393-b416-eebee1aa9d3d service nova] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:05.842622 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d7469a-e669-46f9-a8e5-33d6fc2794eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:05.846014 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d7469a-e669-46f9-a8e5-33d6fc2794eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:05.848219 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d7469a-e669-46f9-a8e5-33d6fc2794eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:05.849051 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d7469a-e669-46f9-a8e5-33d6fc2794eb admin admin] PATH_INFO: `/v3/projects/e10ec9579cd24da689d672563ead32f7` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:05.851762 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d7469a-e669-46f9-a8e5-33d6fc2794eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=e10ec9579cd24da689d672563ead32f7)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:05.860360 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d7469a-e669-46f9-a8e5-33d6fc2794eb admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:05.996289 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c9d7469a-e669-46f9-a8e5-33d6fc2794eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e10ec9579cd24da689d672563ead32f7', 'request_id': 'req-c9d7469a-e669-46f9-a8e5-33d6fc2794eb'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:05.996663 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:06.004940 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c9d7469a-e669-46f9-a8e5-33d6fc2794eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e10ec9579cd24da689d672563ead32f7', 'request_id': 'req-c9d7469a-e669-46f9-a8e5-33d6fc2794eb'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:06.025793 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c9d7469a-e669-46f9-a8e5-33d6fc2794eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e10ec9579cd24da689d672563ead32f7', 'request_id': 'req-c9d7469a-e669-46f9-a8e5-33d6fc2794eb'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:06.059779 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c9d7469a-e669-46f9-a8e5-33d6fc2794eb admin admin] The token cache is being invalidate because project e10ec9579cd24da689d672563ead32f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:56:06.061885 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c9d7469a-e669-46f9-a8e5-33d6fc2794eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:06.064637 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c9d7469a-e669-46f9-a8e5-33d6fc2794eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:06.073180 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 878/1777] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 14:56:05 2022] DELETE /identity/v3/projects/e10ec9579cd24da689d672563ead32f7 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:56:06.073508 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bcf628-629f-4f2a-b695-4a3bd0a0bd7a None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:06.075804 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bcf628-629f-4f2a-b695-4a3bd0a0bd7a None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:06.076081 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bcf628-629f-4f2a-b695-4a3bd0a0bd7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:06.153998 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-f0bcf628-629f-4f2a-b695-4a3bd0a0bd7a None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:06.155489 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-f0bcf628-629f-4f2a-b695-4a3bd0a0bd7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:06.274421 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:06.321314 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 900/1778] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:56:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:56:06.330727 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5fbe79-bb83-44fe-b683-b4260c704db6 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:06.331089 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5fbe79-bb83-44fe-b683-b4260c704db6 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:06.331430 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5fbe79-bb83-44fe-b683-b4260c704db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:06.434659 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-4d5fbe79-bb83-44fe-b683-b4260c704db6 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:06.445633 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-4d5fbe79-bb83-44fe-b683-b4260c704db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:06.484488 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 879/1779] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:56:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:56:06.486064 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bcf628-629f-4f2a-b695-4a3bd0a0bd7a None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:06.501990 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bcf628-629f-4f2a-b695-4a3bd0a0bd7a None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:06.518044 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32f50bc-0a8a-4d1e-ac23-b8938cbaabb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:06.519430 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32f50bc-0a8a-4d1e-ac23-b8938cbaabb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:06.522833 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32f50bc-0a8a-4d1e-ac23-b8938cbaabb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:06.523469 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32f50bc-0a8a-4d1e-ac23-b8938cbaabb1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:06.524410 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32f50bc-0a8a-4d1e-ac23-b8938cbaabb1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:56:06.525319 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32f50bc-0a8a-4d1e-ac23-b8938cbaabb1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:06.530163 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32f50bc-0a8a-4d1e-ac23-b8938cbaabb1 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:06.549713 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 901/1780] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 19 14:56:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:56:06.554281 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5fbe79-bb83-44fe-b683-b4260c704db6 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:06.566674 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5fbe79-bb83-44fe-b683-b4260c704db6 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:06.591174 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76509191-ca75-45cf-b363-201b824ebe54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:06.591951 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76509191-ca75-45cf-b363-201b824ebe54 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:06.592347 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76509191-ca75-45cf-b363-201b824ebe54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:06.592729 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76509191-ca75-45cf-b363-201b824ebe54 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:06.595100 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76509191-ca75-45cf-b363-201b824ebe54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:06.599169 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76509191-ca75-45cf-b363-201b824ebe54 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:06.689367 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 880/1781] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 14:56:06 2022] POST /identity/v3/projects => generated 369 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:56:06.692955 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32f50bc-0a8a-4d1e-ac23-b8938cbaabb1 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:06.710682 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32f50bc-0a8a-4d1e-ac23-b8938cbaabb1 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:06.827379 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265babfc-851f-4519-abe8-17896675169f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:06.828323 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265babfc-851f-4519-abe8-17896675169f admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:06.828745 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265babfc-851f-4519-abe8-17896675169f admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:06.829080 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265babfc-851f-4519-abe8-17896675169f admin admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:06.829831 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265babfc-851f-4519-abe8-17896675169f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:06.832921 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265babfc-851f-4519-abe8-17896675169f admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:06.905761 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 902/1782] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 14:56:06 2022] POST /identity/v3/users => generated 285 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:56:06.908506 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76509191-ca75-45cf-b363-201b824ebe54 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:06.923447 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76509191-ca75-45cf-b363-201b824ebe54 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:06.942014 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410756b5-848e-4352-aa4f-6300cd2c150c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:06.942824 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410756b5-848e-4352-aa4f-6300cd2c150c admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:06.943155 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410756b5-848e-4352-aa4f-6300cd2c150c admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:06.944756 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410756b5-848e-4352-aa4f-6300cd2c150c admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:06.945691 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410756b5-848e-4352-aa4f-6300cd2c150c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:06.953481 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410756b5-848e-4352-aa4f-6300cd2c150c admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:06.983963 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265babfc-851f-4519-abe8-17896675169f admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:06.998688 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 881/1783] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:56:06 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:56:06.999653 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265babfc-851f-4519-abe8-17896675169f admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:07.008566 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3416f935-f483-49ff-8411-f752552b70f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:07.011885 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416f935-f483-49ff-8411-f752552b70f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:07.012386 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416f935-f483-49ff-8411-f752552b70f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:07.023720 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416f935-f483-49ff-8411-f752552b70f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:07.027400 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3416f935-f483-49ff-8411-f752552b70f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:07.036271 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3416f935-f483-49ff-8411-f752552b70f2 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:07.092976 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410756b5-848e-4352-aa4f-6300cd2c150c admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:07.098672 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 903/1784] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:56:06 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:56:07.105118 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410756b5-848e-4352-aa4f-6300cd2c150c admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:07.120140 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fa1683-a1e9-4c6b-8f5e-3a84408fefba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:07.120959 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa1683-a1e9-4c6b-8f5e-3a84408fefba admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:07.121363 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa1683-a1e9-4c6b-8f5e-3a84408fefba admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:07.122860 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa1683-a1e9-4c6b-8f5e-3a84408fefba admin admin] PATH_INFO: `/v3/projects/5b451900a500412d95d64b2179f1eeb5/users/45bbb4606cdc4df4a02fa381daa80252/roles/74de6794e3b3422b93d26f993d260c35` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:07.164334 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fa1683-a1e9-4c6b-8f5e-3a84408fefba admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b451900a500412d95d64b2179f1eeb5, user_id=45bbb4606cdc4df4a02fa381daa80252, role_id=74de6794e3b3422b93d26f993d260c35)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:07.171075 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fa1683-a1e9-4c6b-8f5e-3a84408fefba admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:07.214967 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 882/1785] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 14:56:07 2022] PUT /identity/v3/projects/5b451900a500412d95d64b2179f1eeb5/users/45bbb4606cdc4df4a02fa381daa80252/roles/74de6794e3b3422b93d26f993d260c35 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:56:07.217745 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add32f5c-9697-4577-8b8f-ae6ad7d13843 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:07.218253 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add32f5c-9697-4577-8b8f-ae6ad7d13843 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:07.218687 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add32f5c-9697-4577-8b8f-ae6ad7d13843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:07.252635 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-add32f5c-9697-4577-8b8f-ae6ad7d13843 None None] MFA Rules not processed for user `45bbb4606cdc4df4a02fa381daa80252`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:07.254436 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-add32f5c-9697-4577-8b8f-ae6ad7d13843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:07.371270 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 904/1786] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:56:07 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:56:07.373049 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fa1683-a1e9-4c6b-8f5e-3a84408fefba admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:07.562752 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fa1683-a1e9-4c6b-8f5e-3a84408fefba admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:07.568785 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966e780a-3038-45b1-b773-484f960e97fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:07.570614 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e780a-3038-45b1-b773-484f960e97fc admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:07.571059 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e780a-3038-45b1-b773-484f960e97fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:07.571477 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e780a-3038-45b1-b773-484f960e97fc admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:07.572349 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966e780a-3038-45b1-b773-484f960e97fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:07.575041 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966e780a-3038-45b1-b773-484f960e97fc admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:07.624226 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 883/1787] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 14:56:07 2022] POST /identity/v3/projects => generated 369 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:56:07.625476 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add32f5c-9697-4577-8b8f-ae6ad7d13843 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:07.641322 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add32f5c-9697-4577-8b8f-ae6ad7d13843 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:07.699422 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:07.736955 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aa51ee-2628-4927-839f-1e2473c0ec30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:07.737649 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa51ee-2628-4927-839f-1e2473c0ec30 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:07.737932 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa51ee-2628-4927-839f-1e2473c0ec30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:07.738193 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa51ee-2628-4927-839f-1e2473c0ec30 admin admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:07.738846 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5aa51ee-2628-4927-839f-1e2473c0ec30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:07.742553 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5aa51ee-2628-4927-839f-1e2473c0ec30 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:07.783337 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 905/1788] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 14:56:07 2022] POST /identity/v3/users => generated 291 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 14:56:07.785904 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966e780a-3038-45b1-b773-484f960e97fc admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:07.812726 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966e780a-3038-45b1-b773-484f960e97fc admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:07.822099 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2890dd60-33e1-4d41-8f45-fca0723a2d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:07.823299 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2890dd60-33e1-4d41-8f45-fca0723a2d19 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:07.823580 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2890dd60-33e1-4d41-8f45-fca0723a2d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:07.823855 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2890dd60-33e1-4d41-8f45-fca0723a2d19 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:07.824544 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2890dd60-33e1-4d41-8f45-fca0723a2d19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:07.826148 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2890dd60-33e1-4d41-8f45-fca0723a2d19 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:07.843629 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 884/1789] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:56:07 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:56:07.844895 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aa51ee-2628-4927-839f-1e2473c0ec30 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:07.855986 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aa51ee-2628-4927-839f-1e2473c0ec30 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:07.861908 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6745084e-255e-42be-b668-02fa6ff3c78c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:07.863518 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6745084e-255e-42be-b668-02fa6ff3c78c admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:07.863912 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6745084e-255e-42be-b668-02fa6ff3c78c admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:07.864193 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6745084e-255e-42be-b668-02fa6ff3c78c admin admin] PATH_INFO: `/v3/projects/e17b4a16eb8240868c6abfd5dcc9b4cc/users/3d7d4bb5b2d845d5b9db3b840197aec2/roles/019bde1756cb40de8ce06cef6b261f79` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:07.890348 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6745084e-255e-42be-b668-02fa6ff3c78c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e17b4a16eb8240868c6abfd5dcc9b4cc, user_id=3d7d4bb5b2d845d5b9db3b840197aec2, role_id=019bde1756cb40de8ce06cef6b261f79)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:07.893647 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6745084e-255e-42be-b668-02fa6ff3c78c admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:07.921054 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2890dd60-33e1-4d41-8f45-fca0723a2d19 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:07.921286 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 906/1790] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 14:56:07 2022] PUT /identity/v3/projects/e17b4a16eb8240868c6abfd5dcc9b4cc/users/3d7d4bb5b2d845d5b9db3b840197aec2/roles/019bde1756cb40de8ce06cef6b261f79 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 14:56:07.942257 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2890dd60-33e1-4d41-8f45-fca0723a2d19 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:08.022241 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:08.038619 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355ecc02-70bf-4eb8-b208-d1bbc6411ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:08.039637 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ecc02-70bf-4eb8-b208-d1bbc6411ae5 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:08.040001 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ecc02-70bf-4eb8-b208-d1bbc6411ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:08.040353 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ecc02-70bf-4eb8-b208-d1bbc6411ae5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:08.041127 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355ecc02-70bf-4eb8-b208-d1bbc6411ae5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:08.042796 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355ecc02-70bf-4eb8-b208-d1bbc6411ae5 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:08.057861 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 885/1791] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:56:07 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:56:08.061663 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6745084e-255e-42be-b668-02fa6ff3c78c admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:08.074168 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6745084e-255e-42be-b668-02fa6ff3c78c admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:08.079942 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308de27d-c6cc-49eb-b656-d8c54879617f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:08.080703 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308de27d-c6cc-49eb-b656-d8c54879617f admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:08.080984 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308de27d-c6cc-49eb-b656-d8c54879617f admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:08.081481 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308de27d-c6cc-49eb-b656-d8c54879617f admin admin] PATH_INFO: `/v3/projects/e17b4a16eb8240868c6abfd5dcc9b4cc/users/3d7d4bb5b2d845d5b9db3b840197aec2/roles/019bde1756cb40de8ce06cef6b261f79` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:08.084512 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308de27d-c6cc-49eb-b656-d8c54879617f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e17b4a16eb8240868c6abfd5dcc9b4cc, user_id=3d7d4bb5b2d845d5b9db3b840197aec2, role_id=019bde1756cb40de8ce06cef6b261f79)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:08.087486 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308de27d-c6cc-49eb-b656-d8c54879617f admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:08.100227 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 907/1792] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 14:56:08 2022] PUT /identity/v3/projects/e17b4a16eb8240868c6abfd5dcc9b4cc/users/3d7d4bb5b2d845d5b9db3b840197aec2/roles/019bde1756cb40de8ce06cef6b261f79 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 14:56:08.111067 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c92487-cff6-4464-a4f0-a8decba8c2df None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:08.111255 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c92487-cff6-4464-a4f0-a8decba8c2df None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:08.111543 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c92487-cff6-4464-a4f0-a8decba8c2df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:08.144031 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-04c92487-cff6-4464-a4f0-a8decba8c2df None None] MFA Rules not processed for user `3d7d4bb5b2d845d5b9db3b840197aec2`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:08.145315 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-04c92487-cff6-4464-a4f0-a8decba8c2df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:08.225083 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 886/1793] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:56:08 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:56:08.236945 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308de27d-c6cc-49eb-b656-d8c54879617f admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:08.239002 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-308de27d-c6cc-49eb-b656-d8c54879617f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:08.306319 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308de27d-c6cc-49eb-b656-d8c54879617f admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:08.310405 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffd3c54-ce39-4342-a742-591ea18af2bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df648c909ddb41418128b43f925f5ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:08.311027 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd3c54-ce39-4342-a742-591ea18af2bf service cinder] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:08.311304 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd3c54-ce39-4342-a742-591ea18af2bf service cinder] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:08.311572 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd3c54-ce39-4342-a742-591ea18af2bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:08.323565 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffd3c54-ce39-4342-a742-591ea18af2bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:08.325789 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffd3c54-ce39-4342-a742-591ea18af2bf service cinder] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:08.338999 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 908/1794] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:56:08 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:56:08.387843 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c92487-cff6-4464-a4f0-a8decba8c2df None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:08.389379 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-04c92487-cff6-4464-a4f0-a8decba8c2df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:08.402553 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c92487-cff6-4464-a4f0-a8decba8c2df None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:08.406088 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc63e0b-75cf-4bef-8ec4-d88e219b4162 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df648c909ddb41418128b43f925f5ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:08.406699 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc63e0b-75cf-4bef-8ec4-d88e219b4162 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:08.406979 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc63e0b-75cf-4bef-8ec4-d88e219b4162 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:08.407248 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc63e0b-75cf-4bef-8ec4-d88e219b4162 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:08.471686 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc63e0b-75cf-4bef-8ec4-d88e219b4162 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:08.473181 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc63e0b-75cf-4bef-8ec4-d88e219b4162 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:08.482831 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 887/1795] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:56:08 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:56:08.706125 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffd3c54-ce39-4342-a742-591ea18af2bf service cinder] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:08.712599 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-5ffd3c54-ce39-4342-a742-591ea18af2bf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:08.899732 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffd3c54-ce39-4342-a742-591ea18af2bf service cinder] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:08.904938 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db248004-c818-43be-91d4-98eeecb25397 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:08.905447 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db248004-c818-43be-91d4-98eeecb25397 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:08.905531 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db248004-c818-43be-91d4-98eeecb25397 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:08.907227 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 888/1796] 10.222.0.26 () {54 vars in 921 bytes} [Mon Sep 19 14:56:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:56:08.908350 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce294a54-2fd0-499c-a3dc-c641b5e5f3c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:08.909351 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce294a54-2fd0-499c-a3dc-c641b5e5f3c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:08.909861 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce294a54-2fd0-499c-a3dc-c641b5e5f3c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:08.910474 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce294a54-2fd0-499c-a3dc-c641b5e5f3c1 admin admin] PATH_INFO: `/v3/users/1e0b644e2f8940168f09650536beb9f3` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:08.912474 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce294a54-2fd0-499c-a3dc-c641b5e5f3c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e0b644e2f8940168f09650536beb9f3)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:08.914203 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e852e6cd-f7db-4f51-b9b5-864daed0c245 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:08.914497 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e852e6cd-f7db-4f51-b9b5-864daed0c245 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:08.914769 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e852e6cd-f7db-4f51-b9b5-864daed0c245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:08.915499 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce294a54-2fd0-499c-a3dc-c641b5e5f3c1 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:08.953719 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-e852e6cd-f7db-4f51-b9b5-864daed0c245 None None] MFA Rules not processed for user `3017e5d92bef4cc2aeae4f28c78ba233`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:08.959458 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e852e6cd-f7db-4f51-b9b5-864daed0c245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:09.052380 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:09.083952 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:09.085146 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-ce294a54-2fd0-499c-a3dc-c641b5e5f3c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e0b644e2f8940168f09650536beb9f3'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:09.096590 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-ce294a54-2fd0-499c-a3dc-c641b5e5f3c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e0b644e2f8940168f09650536beb9f3'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:09.097903 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-ce294a54-2fd0-499c-a3dc-c641b5e5f3c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e0b644e2f8940168f09650536beb9f3'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:09.099120 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-ce294a54-2fd0-499c-a3dc-c641b5e5f3c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e0b644e2f8940168f09650536beb9f3'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:09.103936 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 889/1797] 10.222.0.26 () {58 vars in 1018 bytes} [Mon Sep 19 14:56:08 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 14:56:09.114415 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-ce294a54-2fd0-499c-a3dc-c641b5e5f3c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e0b644e2f8940168f09650536beb9f3'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:09.131660 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 909/1798] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 14:56:08 2022] DELETE /identity/v3/users/1e0b644e2f8940168f09650536beb9f3 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:56:09.136955 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b414c-3faf-4fc4-8967-c2ccbcb72dc0 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:09.137293 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b414c-3faf-4fc4-8967-c2ccbcb72dc0 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:09.137562 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b414c-3faf-4fc4-8967-c2ccbcb72dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:09.159182 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-6d5b414c-3faf-4fc4-8967-c2ccbcb72dc0 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:09.160153 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-6d5b414c-3faf-4fc4-8967-c2ccbcb72dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:09.235024 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce294a54-2fd0-499c-a3dc-c641b5e5f3c1 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:09.237593 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 890/1799] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:56:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:56:09.240159 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-ce294a54-2fd0-499c-a3dc-c641b5e5f3c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:09.254452 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5b414c-3faf-4fc4-8967-c2ccbcb72dc0 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:09.255878 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-6d5b414c-3faf-4fc4-8967-c2ccbcb72dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:09.332486 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce294a54-2fd0-499c-a3dc-c641b5e5f3c1 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:09.333032 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5b414c-3faf-4fc4-8967-c2ccbcb72dc0 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:09.337181 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97685d6f-2329-4241-bd9c-c3406569a35b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:09.337792 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97685d6f-2329-4241-bd9c-c3406569a35b service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:09.338066 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97685d6f-2329-4241-bd9c-c3406569a35b service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:09.338361 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97685d6f-2329-4241-bd9c-c3406569a35b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:09.339773 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6c0589-de44-4d9a-bf05-b344fefe88ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3017e5d92bef4cc2aeae4f28c78ba233', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:09.340505 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c0589-de44-4d9a-bf05-b344fefe88ac service nova] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:09.340802 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c0589-de44-4d9a-bf05-b344fefe88ac service nova] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:09.341157 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c0589-de44-4d9a-bf05-b344fefe88ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:09.342952 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-ad6c0589-de44-4d9a-bf05-b344fefe88ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:09.347781 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97685d6f-2329-4241-bd9c-c3406569a35b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:09.349239 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97685d6f-2329-4241-bd9c-c3406569a35b service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:09.358923 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6c0589-de44-4d9a-bf05-b344fefe88ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:09.360657 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6c0589-de44-4d9a-bf05-b344fefe88ac service nova] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:09.361221 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 891/1800] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:56:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:56:09.373799 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 910/1801] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:56:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:56:09.660203 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97685d6f-2329-4241-bd9c-c3406569a35b service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:09.661729 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-97685d6f-2329-4241-bd9c-c3406569a35b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:09.675986 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97685d6f-2329-4241-bd9c-c3406569a35b service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:09.682190 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a298ab-a32d-46c6-979c-e0c38283d04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:09.682841 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a298ab-a32d-46c6-979c-e0c38283d04e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:09.683120 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a298ab-a32d-46c6-979c-e0c38283d04e admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:09.683391 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a298ab-a32d-46c6-979c-e0c38283d04e admin admin] PATH_INFO: `/v3/projects/76f1d83ac282440e998c3e44cec6532a` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:09.684661 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a298ab-a32d-46c6-979c-e0c38283d04e admin admin] RBAC: Authorizing `identity:delete_project(project_id=76f1d83ac282440e998c3e44cec6532a)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:09.694899 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a298ab-a32d-46c6-979c-e0c38283d04e admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:09.780856 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-42a298ab-a32d-46c6-979c-e0c38283d04e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76f1d83ac282440e998c3e44cec6532a', 'request_id': 'req-42a298ab-a32d-46c6-979c-e0c38283d04e'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:09.789485 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-42a298ab-a32d-46c6-979c-e0c38283d04e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76f1d83ac282440e998c3e44cec6532a', 'request_id': 'req-42a298ab-a32d-46c6-979c-e0c38283d04e'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:09.800322 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-42a298ab-a32d-46c6-979c-e0c38283d04e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76f1d83ac282440e998c3e44cec6532a', 'request_id': 'req-42a298ab-a32d-46c6-979c-e0c38283d04e'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:09.851709 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-42a298ab-a32d-46c6-979c-e0c38283d04e admin admin] The token cache is being invalidate because project 76f1d83ac282440e998c3e44cec6532a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:56:09.853461 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-42a298ab-a32d-46c6-979c-e0c38283d04e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:09.856513 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-42a298ab-a32d-46c6-979c-e0c38283d04e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:09.868186 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 892/1802] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 14:56:09 2022] DELETE /identity/v3/projects/76f1d83ac282440e998c3e44cec6532a => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:56:09.869403 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6c0589-de44-4d9a-bf05-b344fefe88ac service nova] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:09.886957 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6c0589-de44-4d9a-bf05-b344fefe88ac service nova] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:10.109648 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e5c6c1-7ddc-4ed2-9d10-f6031280765f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:10.111385 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e5c6c1-7ddc-4ed2-9d10-f6031280765f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:10.111891 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e5c6c1-7ddc-4ed2-9d10-f6031280765f admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:10.114125 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e5c6c1-7ddc-4ed2-9d10-f6031280765f admin admin] PATH_INFO: `/v3/users/b70d0a4680ef454ab8cf3b07a986b284` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:10.122583 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e5c6c1-7ddc-4ed2-9d10-f6031280765f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b70d0a4680ef454ab8cf3b07a986b284)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:10.133857 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e5c6c1-7ddc-4ed2-9d10-f6031280765f admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:10.244238 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:10.277597 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-73e5c6c1-7ddc-4ed2-9d10-f6031280765f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b70d0a4680ef454ab8cf3b07a986b284'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:10.291748 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-73e5c6c1-7ddc-4ed2-9d10-f6031280765f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b70d0a4680ef454ab8cf3b07a986b284'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:10.292565 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-73e5c6c1-7ddc-4ed2-9d10-f6031280765f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b70d0a4680ef454ab8cf3b07a986b284'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:10.293382 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-73e5c6c1-7ddc-4ed2-9d10-f6031280765f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b70d0a4680ef454ab8cf3b07a986b284'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:10.319084 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-73e5c6c1-7ddc-4ed2-9d10-f6031280765f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b70d0a4680ef454ab8cf3b07a986b284'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:10.338579 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 911/1803] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 14:56:09 2022] DELETE /identity/v3/users/b70d0a4680ef454ab8cf3b07a986b284 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 14:56:12.185170 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a298ab-a32d-46c6-979c-e0c38283d04e admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:12.187895 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-42a298ab-a32d-46c6-979c-e0c38283d04e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:12.225818 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a298ab-a32d-46c6-979c-e0c38283d04e admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:12.282588 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:12.352387 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1291a4-5cdd-46f3-a842-1c98a0cb32bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:12.353158 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1291a4-5cdd-46f3-a842-1c98a0cb32bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:12.353698 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1291a4-5cdd-46f3-a842-1c98a0cb32bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:12.354072 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1291a4-5cdd-46f3-a842-1c98a0cb32bd admin admin] PATH_INFO: `/v3/projects/35a87f624f5346cea3f686d9c996b3db` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:12.355592 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1291a4-5cdd-46f3-a842-1c98a0cb32bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=35a87f624f5346cea3f686d9c996b3db)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:12.357736 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1291a4-5cdd-46f3-a842-1c98a0cb32bd admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:12.483450 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-db1291a4-5cdd-46f3-a842-1c98a0cb32bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35a87f624f5346cea3f686d9c996b3db', 'request_id': 'req-db1291a4-5cdd-46f3-a842-1c98a0cb32bd'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:12.501701 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-db1291a4-5cdd-46f3-a842-1c98a0cb32bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35a87f624f5346cea3f686d9c996b3db', 'request_id': 'req-db1291a4-5cdd-46f3-a842-1c98a0cb32bd'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:12.521817 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-db1291a4-5cdd-46f3-a842-1c98a0cb32bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35a87f624f5346cea3f686d9c996b3db', 'request_id': 'req-db1291a4-5cdd-46f3-a842-1c98a0cb32bd'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:12.557517 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-db1291a4-5cdd-46f3-a842-1c98a0cb32bd admin admin] The token cache is being invalidate because project 35a87f624f5346cea3f686d9c996b3db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:56:12.557517 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-db1291a4-5cdd-46f3-a842-1c98a0cb32bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:12.559428 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-db1291a4-5cdd-46f3-a842-1c98a0cb32bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:12.567057 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 893/1804] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 14:56:12 2022] DELETE /identity/v3/projects/35a87f624f5346cea3f686d9c996b3db => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:56:12.568749 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61147ea2-7d60-4172-b35a-9f2f67679bc3 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:12.570076 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61147ea2-7d60-4172-b35a-9f2f67679bc3 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:12.570859 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61147ea2-7d60-4172-b35a-9f2f67679bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:12.627904 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-61147ea2-7d60-4172-b35a-9f2f67679bc3 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:12.629212 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-61147ea2-7d60-4172-b35a-9f2f67679bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:12.774130 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1291a4-5cdd-46f3-a842-1c98a0cb32bd admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:12.776984 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-db1291a4-5cdd-46f3-a842-1c98a0cb32bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:12.809190 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 912/1805] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:56:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:56:12.822708 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc2e87-c217-4c92-9249-830d3cadf639 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:12.823177 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc2e87-c217-4c92-9249-830d3cadf639 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:12.823605 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc2e87-c217-4c92-9249-830d3cadf639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:12.862055 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-a5cc2e87-c217-4c92-9249-830d3cadf639 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:12.863561 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-a5cc2e87-c217-4c92-9249-830d3cadf639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:12.882703 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 913/1806] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:56:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:56:12.886072 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cc2e87-c217-4c92-9249-830d3cadf639 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:12.895482 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cc2e87-c217-4c92-9249-830d3cadf639 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:12.901119 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe00bd4-0cb6-4249-94dd-c43b3c107a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:12.901740 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe00bd4-0cb6-4249-94dd-c43b3c107a21 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:12.902016 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe00bd4-0cb6-4249-94dd-c43b3c107a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:12.902285 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe00bd4-0cb6-4249-94dd-c43b3c107a21 admin admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:12.903004 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe00bd4-0cb6-4249-94dd-c43b3c107a21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:56:12.903299 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe00bd4-0cb6-4249-94dd-c43b3c107a21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:12.904974 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe00bd4-0cb6-4249-94dd-c43b3c107a21 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:12.933598 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 914/1807] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 19 14:56:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:56:12.935442 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe00bd4-0cb6-4249-94dd-c43b3c107a21 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:12.944059 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1291a4-5cdd-46f3-a842-1c98a0cb32bd admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:12.951367 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152534e9-9312-4b37-861a-5d2942fc2bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:12.954676 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe00bd4-0cb6-4249-94dd-c43b3c107a21 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:12.957217 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152534e9-9312-4b37-861a-5d2942fc2bfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:12.957837 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152534e9-9312-4b37-861a-5d2942fc2bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:12.958264 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152534e9-9312-4b37-861a-5d2942fc2bfd admin admin] PATH_INFO: `/v3/users/45bbb4606cdc4df4a02fa381daa80252` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:12.960131 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152534e9-9312-4b37-861a-5d2942fc2bfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=45bbb4606cdc4df4a02fa381daa80252)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:12.960315 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ec276b-7238-4e40-830c-dfe058b50ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:12.961381 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ec276b-7238-4e40-830c-dfe058b50ae2 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:12.961915 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ec276b-7238-4e40-830c-dfe058b50ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:12.962389 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ec276b-7238-4e40-830c-dfe058b50ae2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:12.963003 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152534e9-9312-4b37-861a-5d2942fc2bfd admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:12.963129 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ec276b-7238-4e40-830c-dfe058b50ae2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:12.965143 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ec276b-7238-4e40-830c-dfe058b50ae2 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:13.001036 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 915/1808] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 14:56:12 2022] POST /identity/v3/projects => generated 389 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:56:13.003870 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ec276b-7238-4e40-830c-dfe058b50ae2 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:13.046612 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-152534e9-9312-4b37-861a-5d2942fc2bfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45bbb4606cdc4df4a02fa381daa80252'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:13.055370 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-152534e9-9312-4b37-861a-5d2942fc2bfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45bbb4606cdc4df4a02fa381daa80252'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:13.056031 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-152534e9-9312-4b37-861a-5d2942fc2bfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45bbb4606cdc4df4a02fa381daa80252'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:13.056662 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-152534e9-9312-4b37-861a-5d2942fc2bfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45bbb4606cdc4df4a02fa381daa80252'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:13.061993 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:13.066297 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-152534e9-9312-4b37-861a-5d2942fc2bfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45bbb4606cdc4df4a02fa381daa80252'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:13.078180 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ec276b-7238-4e40-830c-dfe058b50ae2 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:13.089164 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616abcb4-65e2-40ea-8e09-0b8aebffc39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:13.089164 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616abcb4-65e2-40ea-8e09-0b8aebffc39a admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:13.089164 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616abcb4-65e2-40ea-8e09-0b8aebffc39a admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:13.089164 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616abcb4-65e2-40ea-8e09-0b8aebffc39a admin admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:13.089514 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616abcb4-65e2-40ea-8e09-0b8aebffc39a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:13.089584 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 894/1809] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 14:56:12 2022] DELETE /identity/v3/users/45bbb4606cdc4df4a02fa381daa80252 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:56:13.089814 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616abcb4-65e2-40ea-8e09-0b8aebffc39a admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:13.092199 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c73ea9-8f42-43ef-a499-9eb0e4f525bb None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:13.092551 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c73ea9-8f42-43ef-a499-9eb0e4f525bb None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:13.092892 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c73ea9-8f42-43ef-a499-9eb0e4f525bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:13.109350 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:13.112826 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-71c73ea9-8f42-43ef-a499-9eb0e4f525bb None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:13.114053 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-71c73ea9-8f42-43ef-a499-9eb0e4f525bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:13.118595 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 916/1810] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 14:56:13 2022] POST /identity/v3/users => generated 295 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:56:13.119974 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616abcb4-65e2-40ea-8e09-0b8aebffc39a admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:13.122253 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-616abcb4-65e2-40ea-8e09-0b8aebffc39a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:13.134972 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616abcb4-65e2-40ea-8e09-0b8aebffc39a admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:13.173914 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 895/1811] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:56:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 14:56:13.184366 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c73ea9-8f42-43ef-a499-9eb0e4f525bb None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:13.185749 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-71c73ea9-8f42-43ef-a499-9eb0e4f525bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:13.193206 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a445868-3035-4802-acb8-f6edd0be7bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:13.193849 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a445868-3035-4802-acb8-f6edd0be7bd1 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:13.194133 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a445868-3035-4802-acb8-f6edd0be7bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:13.194452 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a445868-3035-4802-acb8-f6edd0be7bd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:13.195388 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a445868-3035-4802-acb8-f6edd0be7bd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:13.196924 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a445868-3035-4802-acb8-f6edd0be7bd1 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:13.207330 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 917/1812] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:56:13 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:56:13.211822 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a445868-3035-4802-acb8-f6edd0be7bd1 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:13.221973 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a445868-3035-4802-acb8-f6edd0be7bd1 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:13.227098 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3970519b-6ef3-4eec-8aa8-e277a7d4ce87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:13.227716 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3970519b-6ef3-4eec-8aa8-e277a7d4ce87 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:13.227996 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3970519b-6ef3-4eec-8aa8-e277a7d4ce87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:13.228270 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3970519b-6ef3-4eec-8aa8-e277a7d4ce87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:13.228926 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3970519b-6ef3-4eec-8aa8-e277a7d4ce87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:13.230560 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3970519b-6ef3-4eec-8aa8-e277a7d4ce87 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:13.242747 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 918/1813] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:56:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:56:13.247506 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3970519b-6ef3-4eec-8aa8-e277a7d4ce87 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:13.248664 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c73ea9-8f42-43ef-a499-9eb0e4f525bb None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:13.253473 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87676058-32e5-43ac-b828-09d722ec8f23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:13.255607 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87676058-32e5-43ac-b828-09d722ec8f23 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:13.255889 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87676058-32e5-43ac-b828-09d722ec8f23 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:13.256166 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87676058-32e5-43ac-b828-09d722ec8f23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:13.258489 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3970519b-6ef3-4eec-8aa8-e277a7d4ce87 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:13.263120 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8933e78-0543-47ba-ac2c-b00c2a900cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:13.263779 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8933e78-0543-47ba-ac2c-b00c2a900cdb admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:13.264725 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8933e78-0543-47ba-ac2c-b00c2a900cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:13.264725 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8933e78-0543-47ba-ac2c-b00c2a900cdb admin admin] PATH_INFO: `/v3/projects/ff2d36666d7645378d926662f31b1910/users/105ff2bae30549ab8cc7e1dfb3c70c17/roles/74de6794e3b3422b93d26f993d260c35` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:13.268557 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87676058-32e5-43ac-b828-09d722ec8f23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:13.271071 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87676058-32e5-43ac-b828-09d722ec8f23 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:13.282892 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 896/1814] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:56:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 14:56:13.284333 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8933e78-0543-47ba-ac2c-b00c2a900cdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff2d36666d7645378d926662f31b1910, user_id=105ff2bae30549ab8cc7e1dfb3c70c17, role_id=74de6794e3b3422b93d26f993d260c35)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:13.287171 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8933e78-0543-47ba-ac2c-b00c2a900cdb admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:13.302975 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 919/1815] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 14:56:13 2022] PUT /identity/v3/projects/ff2d36666d7645378d926662f31b1910/users/105ff2bae30549ab8cc7e1dfb3c70c17/roles/74de6794e3b3422b93d26f993d260c35 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 14:56:13.313784 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc69dc91-85c1-4137-b51d-0208e14d27c2 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:13.314064 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc69dc91-85c1-4137-b51d-0208e14d27c2 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:13.314338 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc69dc91-85c1-4137-b51d-0208e14d27c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:13.345963 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-dc69dc91-85c1-4137-b51d-0208e14d27c2 None None] MFA Rules not processed for user `105ff2bae30549ab8cc7e1dfb3c70c17`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:13.347187 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-dc69dc91-85c1-4137-b51d-0208e14d27c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:13.441042 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 897/1816] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:56:13 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:56:13.443233 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8933e78-0543-47ba-ac2c-b00c2a900cdb admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:13.553603 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8933e78-0543-47ba-ac2c-b00c2a900cdb admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:13.559192 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e524116c-3626-4cbd-b39e-01451701b294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:13.559897 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e524116c-3626-4cbd-b39e-01451701b294 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:13.560254 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e524116c-3626-4cbd-b39e-01451701b294 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:13.560621 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e524116c-3626-4cbd-b39e-01451701b294 admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:13.562342 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e524116c-3626-4cbd-b39e-01451701b294 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:13.563379 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e524116c-3626-4cbd-b39e-01451701b294 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:13.602208 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 920/1817] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 14:56:13 2022] POST /identity/v3/projects => generated 387 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:56:13.605835 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc69dc91-85c1-4137-b51d-0208e14d27c2 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:13.619407 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc69dc91-85c1-4137-b51d-0208e14d27c2 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:13.625778 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:13.715301 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aa1dd9-02c6-4a97-9089-e024628baa8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:13.716078 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa1dd9-02c6-4a97-9089-e024628baa8d admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:13.716459 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa1dd9-02c6-4a97-9089-e024628baa8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:13.716818 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa1dd9-02c6-4a97-9089-e024628baa8d admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:13.717742 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aa1dd9-02c6-4a97-9089-e024628baa8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:13.719831 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aa1dd9-02c6-4a97-9089-e024628baa8d admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:13.760764 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 898/1818] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 14:56:13 2022] POST /identity/v3/users => generated 300 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 14:56:13.765698 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e524116c-3626-4cbd-b39e-01451701b294 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:13.777384 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e524116c-3626-4cbd-b39e-01451701b294 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:13.782152 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19c513c-dfb0-4787-b8b3-2ea9eb0fb4cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:13.782758 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19c513c-dfb0-4787-b8b3-2ea9eb0fb4cd admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:13.783031 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19c513c-dfb0-4787-b8b3-2ea9eb0fb4cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:13.783299 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19c513c-dfb0-4787-b8b3-2ea9eb0fb4cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:13.783947 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19c513c-dfb0-4787-b8b3-2ea9eb0fb4cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:13.785593 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19c513c-dfb0-4787-b8b3-2ea9eb0fb4cd admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:13.797575 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 921/1819] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:56:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:56:13.802920 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aa1dd9-02c6-4a97-9089-e024628baa8d admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:13.821071 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aa1dd9-02c6-4a97-9089-e024628baa8d admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:13.826509 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0240f6eb-16da-4a48-b980-743dfec8c553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:13.827192 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0240f6eb-16da-4a48-b980-743dfec8c553 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:13.827473 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0240f6eb-16da-4a48-b980-743dfec8c553 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:13.827764 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0240f6eb-16da-4a48-b980-743dfec8c553 admin admin] PATH_INFO: `/v3/projects/f37b8129cb824b3d82e65521d1d072c1/users/1f9fb61d1b3d48babd98460f4f5d7943/roles/019bde1756cb40de8ce06cef6b261f79` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:13.858776 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0240f6eb-16da-4a48-b980-743dfec8c553 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f37b8129cb824b3d82e65521d1d072c1, user_id=1f9fb61d1b3d48babd98460f4f5d7943, role_id=019bde1756cb40de8ce06cef6b261f79)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:13.863750 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0240f6eb-16da-4a48-b980-743dfec8c553 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:13.893038 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 899/1820] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 14:56:13 2022] PUT /identity/v3/projects/f37b8129cb824b3d82e65521d1d072c1/users/1f9fb61d1b3d48babd98460f4f5d7943/roles/019bde1756cb40de8ce06cef6b261f79 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 14:56:13.894957 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19c513c-dfb0-4787-b8b3-2ea9eb0fb4cd admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:13.906529 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19c513c-dfb0-4787-b8b3-2ea9eb0fb4cd admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:13.963810 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:14.013901 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afa4300-a4a9-4936-be0a-d79d30ed3ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:14.014699 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa4300-a4a9-4936-be0a-d79d30ed3ef7 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:14.015234 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa4300-a4a9-4936-be0a-d79d30ed3ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:14.015362 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa4300-a4a9-4936-be0a-d79d30ed3ef7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:14.016479 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afa4300-a4a9-4936-be0a-d79d30ed3ef7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:14.018612 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afa4300-a4a9-4936-be0a-d79d30ed3ef7 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:14.030753 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0240f6eb-16da-4a48-b980-743dfec8c553 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:14.032614 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-0240f6eb-16da-4a48-b980-743dfec8c553 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:14.034189 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 922/1821] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:56:13 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:56:14.047072 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afa4300-a4a9-4936-be0a-d79d30ed3ef7 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:14.057659 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0240f6eb-16da-4a48-b980-743dfec8c553 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:14.063873 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040f453a-5e31-46f7-9dd1-141a3d1e2b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:14.064515 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040f453a-5e31-46f7-9dd1-141a3d1e2b73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:14.064794 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040f453a-5e31-46f7-9dd1-141a3d1e2b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:14.065118 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040f453a-5e31-46f7-9dd1-141a3d1e2b73 admin admin] PATH_INFO: `/v3/projects/5b451900a500412d95d64b2179f1eeb5` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:14.066557 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040f453a-5e31-46f7-9dd1-141a3d1e2b73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b451900a500412d95d64b2179f1eeb5)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:14.068852 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040f453a-5e31-46f7-9dd1-141a3d1e2b73 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:14.088511 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afa4300-a4a9-4936-be0a-d79d30ed3ef7 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:14.103630 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1b286e-e4cf-44a4-bcbe-752597b06c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:14.104358 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b286e-e4cf-44a4-bcbe-752597b06c21 admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:14.104664 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b286e-e4cf-44a4-bcbe-752597b06c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:14.105038 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b286e-e4cf-44a4-bcbe-752597b06c21 admin admin] PATH_INFO: `/v3/projects/f37b8129cb824b3d82e65521d1d072c1/users/1f9fb61d1b3d48babd98460f4f5d7943/roles/019bde1756cb40de8ce06cef6b261f79` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:14.108690 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1b286e-e4cf-44a4-bcbe-752597b06c21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f37b8129cb824b3d82e65521d1d072c1, user_id=1f9fb61d1b3d48babd98460f4f5d7943, role_id=019bde1756cb40de8ce06cef6b261f79)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:14.112951 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1b286e-e4cf-44a4-bcbe-752597b06c21 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:14.149500 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 923/1822] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 14:56:14 2022] PUT /identity/v3/projects/f37b8129cb824b3d82e65521d1d072c1/users/1f9fb61d1b3d48babd98460f4f5d7943/roles/019bde1756cb40de8ce06cef6b261f79 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:56:14.163594 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-040f453a-5e31-46f7-9dd1-141a3d1e2b73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b451900a500412d95d64b2179f1eeb5', 'request_id': 'req-040f453a-5e31-46f7-9dd1-141a3d1e2b73'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:14.173052 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccef363-431a-4f70-ab4e-e10a8a963d85 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:14.173543 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccef363-431a-4f70-ab4e-e10a8a963d85 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:14.173938 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccef363-431a-4f70-ab4e-e10a8a963d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:14.178364 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-040f453a-5e31-46f7-9dd1-141a3d1e2b73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b451900a500412d95d64b2179f1eeb5', 'request_id': 'req-040f453a-5e31-46f7-9dd1-141a3d1e2b73'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:14.190689 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-040f453a-5e31-46f7-9dd1-141a3d1e2b73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b451900a500412d95d64b2179f1eeb5', 'request_id': 'req-040f453a-5e31-46f7-9dd1-141a3d1e2b73'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:14.207104 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-040f453a-5e31-46f7-9dd1-141a3d1e2b73 admin admin] The token cache is being invalidate because project 5b451900a500412d95d64b2179f1eeb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:56:14.207513 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-040f453a-5e31-46f7-9dd1-141a3d1e2b73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:14.209542 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-040f453a-5e31-46f7-9dd1-141a3d1e2b73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:14.212749 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 900/1823] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 14:56:14 2022] DELETE /identity/v3/projects/5b451900a500412d95d64b2179f1eeb5 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:56:14.217871 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040f453a-5e31-46f7-9dd1-141a3d1e2b73 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:14.220473 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-040f453a-5e31-46f7-9dd1-141a3d1e2b73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:14.238426 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-7ccef363-431a-4f70-ab4e-e10a8a963d85 None None] MFA Rules not processed for user `1f9fb61d1b3d48babd98460f4f5d7943`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:14.240117 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-7ccef363-431a-4f70-ab4e-e10a8a963d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:14.346481 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:14.353850 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040f453a-5e31-46f7-9dd1-141a3d1e2b73 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:14.388797 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 924/1824] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:56:14 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:56:14.388797 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccef363-431a-4f70-ab4e-e10a8a963d85 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:14.389886 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-7ccef363-431a-4f70-ab4e-e10a8a963d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:14.457944 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6688f17f-9e48-49c9-8c90-f0cd15aa91e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:14.458755 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6688f17f-9e48-49c9-8c90-f0cd15aa91e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:14.459610 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6688f17f-9e48-49c9-8c90-f0cd15aa91e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:14.459952 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6688f17f-9e48-49c9-8c90-f0cd15aa91e0 admin admin] PATH_INFO: `/v3/users/3d7d4bb5b2d845d5b9db3b840197aec2` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:14.461335 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6688f17f-9e48-49c9-8c90-f0cd15aa91e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d7d4bb5b2d845d5b9db3b840197aec2)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:14.463527 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6688f17f-9e48-49c9-8c90-f0cd15aa91e0 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:14.466651 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccef363-431a-4f70-ab4e-e10a8a963d85 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:14.472871 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a3f2a5-b35a-41d8-b25f-098110fab797 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df648c909ddb41418128b43f925f5ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:14.473531 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a3f2a5-b35a-41d8-b25f-098110fab797 service cinder] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:14.473805 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a3f2a5-b35a-41d8-b25f-098110fab797 service cinder] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:14.474066 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a3f2a5-b35a-41d8-b25f-098110fab797 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:14.505965 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a3f2a5-b35a-41d8-b25f-098110fab797 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:14.510109 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a3f2a5-b35a-41d8-b25f-098110fab797 service cinder] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:14.524123 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 925/1825] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:56:14 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 14:56:14.570836 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-6688f17f-9e48-49c9-8c90-f0cd15aa91e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d7d4bb5b2d845d5b9db3b840197aec2'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:14.587934 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-6688f17f-9e48-49c9-8c90-f0cd15aa91e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d7d4bb5b2d845d5b9db3b840197aec2'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:14.588639 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-6688f17f-9e48-49c9-8c90-f0cd15aa91e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d7d4bb5b2d845d5b9db3b840197aec2'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:14.590194 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-6688f17f-9e48-49c9-8c90-f0cd15aa91e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d7d4bb5b2d845d5b9db3b840197aec2'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:14.601530 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-6688f17f-9e48-49c9-8c90-f0cd15aa91e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d7d4bb5b2d845d5b9db3b840197aec2'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:14.635914 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 901/1826] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 14:56:14 2022] DELETE /identity/v3/users/3d7d4bb5b2d845d5b9db3b840197aec2 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 14:56:14.767297 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a3f2a5-b35a-41d8-b25f-098110fab797 service cinder] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:14.769359 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-73a3f2a5-b35a-41d8-b25f-098110fab797 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:14.809215 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5229b-9745-4a3d-9017-bc990803726b None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:14.809410 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5229b-9745-4a3d-9017-bc990803726b None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:14.809671 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5229b-9745-4a3d-9017-bc990803726b None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:14.811206 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 902/1827] 10.222.0.26 () {54 vars in 921 bytes} [Mon Sep 19 14:56:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 14:56:14.823626 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c52ab1e-a5d4-49a0-9f87-f6699357718f None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:14.824340 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c52ab1e-a5d4-49a0-9f87-f6699357718f None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:14.824340 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c52ab1e-a5d4-49a0-9f87-f6699357718f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:14.831849 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a3f2a5-b35a-41d8-b25f-098110fab797 service cinder] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:14.874362 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-8c52ab1e-a5d4-49a0-9f87-f6699357718f None None] MFA Rules not processed for user `3017e5d92bef4cc2aeae4f28c78ba233`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:14.875584 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-8c52ab1e-a5d4-49a0-9f87-f6699357718f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:14.946233 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:14.974406 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02efc455-4131-4bc2-a8fb-09a0a1ec3d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:14.975048 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02efc455-4131-4bc2-a8fb-09a0a1ec3d00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:14.990857 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02efc455-4131-4bc2-a8fb-09a0a1ec3d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:14.991369 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02efc455-4131-4bc2-a8fb-09a0a1ec3d00 admin admin] PATH_INFO: `/v3/users/105ff2bae30549ab8cc7e1dfb3c70c17` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:14.992847 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02efc455-4131-4bc2-a8fb-09a0a1ec3d00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=105ff2bae30549ab8cc7e1dfb3c70c17)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:15.000895 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02efc455-4131-4bc2-a8fb-09a0a1ec3d00 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:15.003232 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 903/1828] 10.222.0.26 () {58 vars in 1018 bytes} [Mon Sep 19 14:56:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 14:56:15.017688 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c52ab1e-a5d4-49a0-9f87-f6699357718f None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:15.019696 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-8c52ab1e-a5d4-49a0-9f87-f6699357718f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:15.035344 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c52ab1e-a5d4-49a0-9f87-f6699357718f None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:15.058900 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96515959-2cfb-4583-8d67-a329e6b3c3c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3017e5d92bef4cc2aeae4f28c78ba233', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:15.059053 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96515959-2cfb-4583-8d67-a329e6b3c3c4 service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:15.061178 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96515959-2cfb-4583-8d67-a329e6b3c3c4 service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:15.061178 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96515959-2cfb-4583-8d67-a329e6b3c3c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:15.074138 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96515959-2cfb-4583-8d67-a329e6b3c3c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:15.076255 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96515959-2cfb-4583-8d67-a329e6b3c3c4 service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:15.094676 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 904/1829] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:56:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:56:15.099468 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-02efc455-4131-4bc2-a8fb-09a0a1ec3d00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '105ff2bae30549ab8cc7e1dfb3c70c17'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:15.113488 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-02efc455-4131-4bc2-a8fb-09a0a1ec3d00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '105ff2bae30549ab8cc7e1dfb3c70c17'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:15.114317 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-02efc455-4131-4bc2-a8fb-09a0a1ec3d00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '105ff2bae30549ab8cc7e1dfb3c70c17'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:15.115056 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-02efc455-4131-4bc2-a8fb-09a0a1ec3d00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '105ff2bae30549ab8cc7e1dfb3c70c17'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:15.133231 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-02efc455-4131-4bc2-a8fb-09a0a1ec3d00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '105ff2bae30549ab8cc7e1dfb3c70c17'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:15.155374 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 926/1830] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 14:56:14 2022] DELETE /identity/v3/users/105ff2bae30549ab8cc7e1dfb3c70c17 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:56:15.161263 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd836d48-40c3-4e24-aa01-91261452802d None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:15.161637 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd836d48-40c3-4e24-aa01-91261452802d None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:15.161980 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd836d48-40c3-4e24-aa01-91261452802d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:15.171999 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:15.202817 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-cd836d48-40c3-4e24-aa01-91261452802d None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:15.204496 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-cd836d48-40c3-4e24-aa01-91261452802d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:15.299673 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 905/1831] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:56:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 14:56:15.311666 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02efc455-4131-4bc2-a8fb-09a0a1ec3d00 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:15.313109 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-02efc455-4131-4bc2-a8fb-09a0a1ec3d00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:15.380254 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02efc455-4131-4bc2-a8fb-09a0a1ec3d00 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:15.390599 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9709a4a5-6e6d-4237-b733-3cb48e61ba2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:15.391333 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9709a4a5-6e6d-4237-b733-3cb48e61ba2f service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:15.391456 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9709a4a5-6e6d-4237-b733-3cb48e61ba2f service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:15.391961 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9709a4a5-6e6d-4237-b733-3cb48e61ba2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:15.409625 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9709a4a5-6e6d-4237-b733-3cb48e61ba2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:15.411616 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9709a4a5-6e6d-4237-b733-3cb48e61ba2f service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:15.429051 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 927/1832] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:56:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:56:15.905622 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd836d48-40c3-4e24-aa01-91261452802d None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:15.907090 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-cd836d48-40c3-4e24-aa01-91261452802d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:15.929876 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd836d48-40c3-4e24-aa01-91261452802d None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:15.940980 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5020b368-7c52-4b90-8338-d69b45fb331e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:15.941653 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5020b368-7c52-4b90-8338-d69b45fb331e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:15.942181 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5020b368-7c52-4b90-8338-d69b45fb331e admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:15.944593 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5020b368-7c52-4b90-8338-d69b45fb331e admin admin] PATH_INFO: `/v3/projects/ff2d36666d7645378d926662f31b1910` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:15.950279 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9709a4a5-6e6d-4237-b733-3cb48e61ba2f service neutron] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:15.952265 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-9709a4a5-6e6d-4237-b733-3cb48e61ba2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:15.963750 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5020b368-7c52-4b90-8338-d69b45fb331e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff2d36666d7645378d926662f31b1910)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:15.968337 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5020b368-7c52-4b90-8338-d69b45fb331e admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:15.981851 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9709a4a5-6e6d-4237-b733-3cb48e61ba2f service neutron] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:16.009038 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7658373-0284-4604-8c03-099516a372c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:16.009483 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7658373-0284-4604-8c03-099516a372c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:16.016231 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7658373-0284-4604-8c03-099516a372c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:16.016547 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7658373-0284-4604-8c03-099516a372c1 admin admin] PATH_INFO: `/v3/projects/e17b4a16eb8240868c6abfd5dcc9b4cc` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:16.021796 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7658373-0284-4604-8c03-099516a372c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e17b4a16eb8240868c6abfd5dcc9b4cc)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:16.026413 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7658373-0284-4604-8c03-099516a372c1 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:16.148118 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5020b368-7c52-4b90-8338-d69b45fb331e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff2d36666d7645378d926662f31b1910', 'request_id': 'req-5020b368-7c52-4b90-8338-d69b45fb331e'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:16.164360 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5020b368-7c52-4b90-8338-d69b45fb331e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff2d36666d7645378d926662f31b1910', 'request_id': 'req-5020b368-7c52-4b90-8338-d69b45fb331e'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:16.169434 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-c7658373-0284-4604-8c03-099516a372c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e17b4a16eb8240868c6abfd5dcc9b4cc', 'request_id': 'req-c7658373-0284-4604-8c03-099516a372c1'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:16.180236 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5020b368-7c52-4b90-8338-d69b45fb331e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff2d36666d7645378d926662f31b1910', 'request_id': 'req-5020b368-7c52-4b90-8338-d69b45fb331e'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:16.194871 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-c7658373-0284-4604-8c03-099516a372c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e17b4a16eb8240868c6abfd5dcc9b4cc', 'request_id': 'req-c7658373-0284-4604-8c03-099516a372c1'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:16.213497 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-c7658373-0284-4604-8c03-099516a372c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e17b4a16eb8240868c6abfd5dcc9b4cc', 'request_id': 'req-c7658373-0284-4604-8c03-099516a372c1'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:16.217532 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5020b368-7c52-4b90-8338-d69b45fb331e admin admin] The token cache is being invalidate because project ff2d36666d7645378d926662f31b1910 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:56:16.222077 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:16.226564 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5020b368-7c52-4b90-8338-d69b45fb331e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:16.232796 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5020b368-7c52-4b90-8338-d69b45fb331e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:16.243281 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 906/1833] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 14:56:15 2022] DELETE /identity/v3/projects/ff2d36666d7645378d926662f31b1910 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:56:16.247446 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5020b368-7c52-4b90-8338-d69b45fb331e admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:16.250479 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-c7658373-0284-4604-8c03-099516a372c1 admin admin] The token cache is being invalidate because project e17b4a16eb8240868c6abfd5dcc9b4cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:56:16.251056 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-c7658373-0284-4604-8c03-099516a372c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:16.251527 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-c7658373-0284-4604-8c03-099516a372c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:16.252095 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-5020b368-7c52-4b90-8338-d69b45fb331e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:16.260684 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 928/1834] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 14:56:15 2022] DELETE /identity/v3/projects/e17b4a16eb8240868c6abfd5dcc9b4cc => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 14:56:16.262924 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c3fa49-333d-4a14-9fb6-06c42c2de893 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:16.263221 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c3fa49-333d-4a14-9fb6-06c42c2de893 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:16.263496 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c3fa49-333d-4a14-9fb6-06c42c2de893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:16.311071 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-17c3fa49-333d-4a14-9fb6-06c42c2de893 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:16.318842 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-17c3fa49-333d-4a14-9fb6-06c42c2de893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:16.423184 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5020b368-7c52-4b90-8338-d69b45fb331e admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:16.522729 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:16.572898 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede66a13-3cbd-4b2a-a300-3b4b6a5c52ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:16.573826 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede66a13-3cbd-4b2a-a300-3b4b6a5c52ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:16.581793 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede66a13-3cbd-4b2a-a300-3b4b6a5c52ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:16.581793 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede66a13-3cbd-4b2a-a300-3b4b6a5c52ae admin admin] PATH_INFO: `/v3/users/1f9fb61d1b3d48babd98460f4f5d7943` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:16.582044 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 929/1835] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:56:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:56:16.582121 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede66a13-3cbd-4b2a-a300-3b4b6a5c52ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f9fb61d1b3d48babd98460f4f5d7943)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:16.582121 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede66a13-3cbd-4b2a-a300-3b4b6a5c52ae admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:16.585683 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5145585f-1afc-42b6-896f-2594eaeaea7b None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:16.585971 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5145585f-1afc-42b6-896f-2594eaeaea7b None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:16.586243 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5145585f-1afc-42b6-896f-2594eaeaea7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:16.645501 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-5145585f-1afc-42b6-896f-2594eaeaea7b None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:16.646926 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-5145585f-1afc-42b6-896f-2594eaeaea7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:16.659047 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 930/1836] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:56:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:56:16.664870 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5145585f-1afc-42b6-896f-2594eaeaea7b None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:16.673351 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ede66a13-3cbd-4b2a-a300-3b4b6a5c52ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f9fb61d1b3d48babd98460f4f5d7943'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:16.684403 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5145585f-1afc-42b6-896f-2594eaeaea7b None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:16.685887 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ede66a13-3cbd-4b2a-a300-3b4b6a5c52ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f9fb61d1b3d48babd98460f4f5d7943'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:16.687894 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ede66a13-3cbd-4b2a-a300-3b4b6a5c52ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f9fb61d1b3d48babd98460f4f5d7943'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:16.688881 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ede66a13-3cbd-4b2a-a300-3b4b6a5c52ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f9fb61d1b3d48babd98460f4f5d7943'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:16.700981 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bd9754-5744-4f5b-8c12-d62cc498ff61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:16.701911 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd9754-5744-4f5b-8c12-d62cc498ff61 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:16.703694 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd9754-5744-4f5b-8c12-d62cc498ff61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:16.703965 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd9754-5744-4f5b-8c12-d62cc498ff61 admin admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:16.704772 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bd9754-5744-4f5b-8c12-d62cc498ff61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:56:16.705098 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bd9754-5744-4f5b-8c12-d62cc498ff61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:16.709619 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bd9754-5744-4f5b-8c12-d62cc498ff61 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:16.712355 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ede66a13-3cbd-4b2a-a300-3b4b6a5c52ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f9fb61d1b3d48babd98460f4f5d7943'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:16.737571 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 931/1837] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 19 14:56:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:56:16.740569 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bd9754-5744-4f5b-8c12-d62cc498ff61 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:16.746594 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-e3bd9754-5744-4f5b-8c12-d62cc498ff61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:16.766594 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 907/1838] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 14:56:16 2022] DELETE /identity/v3/users/1f9fb61d1b3d48babd98460f4f5d7943 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:56:16.781577 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bd9754-5744-4f5b-8c12-d62cc498ff61 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:16.869681 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb740fc-b733-4fa1-800e-d4b252df7575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:16.870380 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb740fc-b733-4fa1-800e-d4b252df7575 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:16.870671 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb740fc-b733-4fa1-800e-d4b252df7575 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:16.870943 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb740fc-b733-4fa1-800e-d4b252df7575 admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:16.871638 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb740fc-b733-4fa1-800e-d4b252df7575 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:16.873682 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb740fc-b733-4fa1-800e-d4b252df7575 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:16.904753 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 932/1839] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 14:56:16 2022] POST /identity/v3/projects => generated 367 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:56:16.909172 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede66a13-3cbd-4b2a-a300-3b4b6a5c52ae admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:16.919929 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede66a13-3cbd-4b2a-a300-3b4b6a5c52ae admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:17.002355 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bef991f-6b8b-4ad7-be3e-665df3d5a429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:17.003621 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef991f-6b8b-4ad7-be3e-665df3d5a429 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:17.003922 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef991f-6b8b-4ad7-be3e-665df3d5a429 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:17.004202 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef991f-6b8b-4ad7-be3e-665df3d5a429 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:17.007064 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bef991f-6b8b-4ad7-be3e-665df3d5a429 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:17.007216 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bef991f-6b8b-4ad7-be3e-665df3d5a429 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:17.042103 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 908/1840] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 14:56:16 2022] POST /identity/v3/users => generated 284 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:56:17.042659 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb740fc-b733-4fa1-800e-d4b252df7575 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:17.054209 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb740fc-b733-4fa1-800e-d4b252df7575 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:17.059152 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bffb68-0b31-47eb-b886-af1034ee0c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:17.059980 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bffb68-0b31-47eb-b886-af1034ee0c0c admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:17.060320 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bffb68-0b31-47eb-b886-af1034ee0c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:17.060897 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bffb68-0b31-47eb-b886-af1034ee0c0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:17.061675 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bffb68-0b31-47eb-b886-af1034ee0c0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:17.063573 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bffb68-0b31-47eb-b886-af1034ee0c0c admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:17.087902 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 933/1841] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:56:17 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 14:56:17.091345 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bef991f-6b8b-4ad7-be3e-665df3d5a429 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:17.102247 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bef991f-6b8b-4ad7-be3e-665df3d5a429 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:17.108981 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bbdcb8-0cc5-4be1-9b57-967fc4606855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:17.109657 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bbdcb8-0cc5-4be1-9b57-967fc4606855 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:17.109936 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bbdcb8-0cc5-4be1-9b57-967fc4606855 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:17.110207 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bbdcb8-0cc5-4be1-9b57-967fc4606855 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:17.110910 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bbdcb8-0cc5-4be1-9b57-967fc4606855 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:17.112583 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bbdcb8-0cc5-4be1-9b57-967fc4606855 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:17.129842 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bffb68-0b31-47eb-b886-af1034ee0c0c admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:17.137070 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 909/1842] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:56:17 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:56:17.141748 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bffb68-0b31-47eb-b886-af1034ee0c0c admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:17.147506 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68cc854-8173-4656-bc67-5e09f2730cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:17.148344 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68cc854-8173-4656-bc67-5e09f2730cc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:17.148556 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68cc854-8173-4656-bc67-5e09f2730cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:17.148837 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68cc854-8173-4656-bc67-5e09f2730cc2 admin admin] PATH_INFO: `/v3/projects/e6caf4ad6fdd4de897545db9e5b3b89a/users/4e5cf9ff039f4e43ae79ac69a38f9aa7/roles/74de6794e3b3422b93d26f993d260c35` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:17.156433 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bbdcb8-0cc5-4be1-9b57-967fc4606855 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:17.158388 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d0bbdcb8-0cc5-4be1-9b57-967fc4606855 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:17.176090 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bbdcb8-0cc5-4be1-9b57-967fc4606855 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:17.180601 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68cc854-8173-4656-bc67-5e09f2730cc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6caf4ad6fdd4de897545db9e5b3b89a, user_id=4e5cf9ff039f4e43ae79ac69a38f9aa7, role_id=74de6794e3b3422b93d26f993d260c35)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:17.184257 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68cc854-8173-4656-bc67-5e09f2730cc2 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:17.192964 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9edd351-151e-4f1a-9f4d-e040de802d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:17.193702 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9edd351-151e-4f1a-9f4d-e040de802d34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:17.194135 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9edd351-151e-4f1a-9f4d-e040de802d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:17.194545 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9edd351-151e-4f1a-9f4d-e040de802d34 admin admin] PATH_INFO: `/v3/projects/f37b8129cb824b3d82e65521d1d072c1` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:17.197330 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9edd351-151e-4f1a-9f4d-e040de802d34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f37b8129cb824b3d82e65521d1d072c1)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:17.199368 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9edd351-151e-4f1a-9f4d-e040de802d34 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:17.223993 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 934/1843] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 14:56:17 2022] PUT /identity/v3/projects/e6caf4ad6fdd4de897545db9e5b3b89a/users/4e5cf9ff039f4e43ae79ac69a38f9aa7/roles/74de6794e3b3422b93d26f993d260c35 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:56:17.234495 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f973b0-39cb-4d40-a9ab-1d999bfd954f None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:17.234785 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f973b0-39cb-4d40-a9ab-1d999bfd954f None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:17.235058 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f973b0-39cb-4d40-a9ab-1d999bfd954f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:17.247461 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:17.285126 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b9edd351-151e-4f1a-9f4d-e040de802d34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f37b8129cb824b3d82e65521d1d072c1', 'request_id': 'req-b9edd351-151e-4f1a-9f4d-e040de802d34'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:17.290338 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-14f973b0-39cb-4d40-a9ab-1d999bfd954f None None] MFA Rules not processed for user `4e5cf9ff039f4e43ae79ac69a38f9aa7`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:17.291616 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-14f973b0-39cb-4d40-a9ab-1d999bfd954f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:17.294706 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b9edd351-151e-4f1a-9f4d-e040de802d34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f37b8129cb824b3d82e65521d1d072c1', 'request_id': 'req-b9edd351-151e-4f1a-9f4d-e040de802d34'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:17.306099 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:17.309728 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b9edd351-151e-4f1a-9f4d-e040de802d34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f37b8129cb824b3d82e65521d1d072c1', 'request_id': 'req-b9edd351-151e-4f1a-9f4d-e040de802d34'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:17.339270 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b9edd351-151e-4f1a-9f4d-e040de802d34 admin admin] The token cache is being invalidate because project f37b8129cb824b3d82e65521d1d072c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:56:17.339544 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b9edd351-151e-4f1a-9f4d-e040de802d34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:17.340288 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b9edd351-151e-4f1a-9f4d-e040de802d34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:17.346830 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 910/1844] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 14:56:17 2022] DELETE /identity/v3/projects/f37b8129cb824b3d82e65521d1d072c1 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:56:17.350283 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d4286-5f7e-4968-ab29-cf95c074276a None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:17.350927 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d4286-5f7e-4968-ab29-cf95c074276a None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:17.351317 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d4286-5f7e-4968-ab29-cf95c074276a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:17.388932 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 935/1845] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:56:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 14:56:17.406857 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f973b0-39cb-4d40-a9ab-1d999bfd954f None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:17.408269 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-14f973b0-39cb-4d40-a9ab-1d999bfd954f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:17.414918 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-982d4286-5f7e-4968-ab29-cf95c074276a None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:17.416299 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-982d4286-5f7e-4968-ab29-cf95c074276a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:17.513445 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 911/1846] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:56:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:56:17.514957 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e718c-5a41-4a1c-a7be-8fb8073332fa None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:17.515242 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e718c-5a41-4a1c-a7be-8fb8073332fa None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:17.515509 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e718c-5a41-4a1c-a7be-8fb8073332fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:17.532616 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f973b0-39cb-4d40-a9ab-1d999bfd954f None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:17.537117 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2710c6a1-8013-4bfb-bb90-6251ce5046f1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d4e9c3da83402dbe7938aaf2dcbb8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:17.537728 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2710c6a1-8013-4bfb-bb90-6251ce5046f1 service glance] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:17.538208 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2710c6a1-8013-4bfb-bb90-6251ce5046f1 service glance] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:17.538437 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2710c6a1-8013-4bfb-bb90-6251ce5046f1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:17.541621 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-204e718c-5a41-4a1c-a7be-8fb8073332fa None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:17.542974 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-204e718c-5a41-4a1c-a7be-8fb8073332fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:17.549666 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2710c6a1-8013-4bfb-bb90-6251ce5046f1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:17.551390 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2710c6a1-8013-4bfb-bb90-6251ce5046f1 service glance] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:17.555535 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 912/1847] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:56:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:56:17.559168 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204e718c-5a41-4a1c-a7be-8fb8073332fa None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:17.562659 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 936/1848] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:56:17 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:56:17.569155 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204e718c-5a41-4a1c-a7be-8fb8073332fa None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:17.574271 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99047729-79e8-44fe-9a80-59a6789f7b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:17.575038 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99047729-79e8-44fe-9a80-59a6789f7b42 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:17.575319 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99047729-79e8-44fe-9a80-59a6789f7b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:17.575591 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99047729-79e8-44fe-9a80-59a6789f7b42 admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:17.576290 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99047729-79e8-44fe-9a80-59a6789f7b42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:56:17.576607 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99047729-79e8-44fe-9a80-59a6789f7b42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:17.578632 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99047729-79e8-44fe-9a80-59a6789f7b42 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:17.593381 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 913/1849] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 19 14:56:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:56:17.598541 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2710c6a1-8013-4bfb-bb90-6251ce5046f1 service glance] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:17.614573 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2710c6a1-8013-4bfb-bb90-6251ce5046f1 service glance] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:17.620085 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4166a552-fbfa-4894-9679-1260b97fc74c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:17.620700 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4166a552-fbfa-4894-9679-1260b97fc74c admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:17.621027 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4166a552-fbfa-4894-9679-1260b97fc74c admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:17.621302 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4166a552-fbfa-4894-9679-1260b97fc74c admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:17.622073 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4166a552-fbfa-4894-9679-1260b97fc74c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:17.629161 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4166a552-fbfa-4894-9679-1260b97fc74c admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:17.662203 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 937/1850] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 14:56:17 2022] POST /identity/v3/projects => generated 377 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:56:17.664140 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99047729-79e8-44fe-9a80-59a6789f7b42 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:17.674940 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99047729-79e8-44fe-9a80-59a6789f7b42 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:17.768171 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cdbe9c-c609-47fc-8800-7331f4d25072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:17.768787 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cdbe9c-c609-47fc-8800-7331f4d25072 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:17.769093 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cdbe9c-c609-47fc-8800-7331f4d25072 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:17.769361 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cdbe9c-c609-47fc-8800-7331f4d25072 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:17.770153 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cdbe9c-c609-47fc-8800-7331f4d25072 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:17.772356 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cdbe9c-c609-47fc-8800-7331f4d25072 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:17.806060 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 914/1851] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 14:56:17 2022] POST /identity/v3/users => generated 289 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:56:17.809826 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4166a552-fbfa-4894-9679-1260b97fc74c admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:17.844396 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4166a552-fbfa-4894-9679-1260b97fc74c admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:17.854805 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37352fce-8178-40d9-951c-4904d736a9c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:17.855500 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37352fce-8178-40d9-951c-4904d736a9c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:17.855903 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37352fce-8178-40d9-951c-4904d736a9c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:17.856038 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37352fce-8178-40d9-951c-4904d736a9c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:17.856739 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37352fce-8178-40d9-951c-4904d736a9c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:17.858740 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37352fce-8178-40d9-951c-4904d736a9c5 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:17.873032 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 938/1852] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:56:17 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:56:17.877342 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cdbe9c-c609-47fc-8800-7331f4d25072 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:17.900928 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cdbe9c-c609-47fc-8800-7331f4d25072 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:17.906779 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991fb401-fa23-47e2-a425-9faa3da74b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:17.907540 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991fb401-fa23-47e2-a425-9faa3da74b06 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:17.907928 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991fb401-fa23-47e2-a425-9faa3da74b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:17.908319 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991fb401-fa23-47e2-a425-9faa3da74b06 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:17.909290 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991fb401-fa23-47e2-a425-9faa3da74b06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:17.911112 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991fb401-fa23-47e2-a425-9faa3da74b06 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:17.935595 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37352fce-8178-40d9-951c-4904d736a9c5 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:17.936071 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 915/1853] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:56:17 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 14:56:17.949859 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37352fce-8178-40d9-951c-4904d736a9c5 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:17.956801 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a76797-5386-4ccd-a011-ed091ed24d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:17.957611 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a76797-5386-4ccd-a011-ed091ed24d4f admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:17.957941 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a76797-5386-4ccd-a011-ed091ed24d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:17.958178 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a76797-5386-4ccd-a011-ed091ed24d4f admin admin] PATH_INFO: `/v3/projects/f8600295b0a149aaa915571ffb778f5c/users/cc40ae0a61a84cd9bdcc5f6802275ad9/roles/74de6794e3b3422b93d26f993d260c35` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:17.980742 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a76797-5386-4ccd-a011-ed091ed24d4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8600295b0a149aaa915571ffb778f5c, user_id=cc40ae0a61a84cd9bdcc5f6802275ad9, role_id=74de6794e3b3422b93d26f993d260c35)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:17.983536 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a76797-5386-4ccd-a011-ed091ed24d4f admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:18.006898 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 939/1854] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 14:56:17 2022] PUT /identity/v3/projects/f8600295b0a149aaa915571ffb778f5c/users/cc40ae0a61a84cd9bdcc5f6802275ad9/roles/74de6794e3b3422b93d26f993d260c35 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:56:18.018344 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5367b676-cd40-4bd2-ab46-416cbce1d58d None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:18.018624 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5367b676-cd40-4bd2-ab46-416cbce1d58d None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:18.018895 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5367b676-cd40-4bd2-ab46-416cbce1d58d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:18.047395 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:18.052584 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-5367b676-cd40-4bd2-ab46-416cbce1d58d None None] MFA Rules not processed for user `cc40ae0a61a84cd9bdcc5f6802275ad9`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:18.057581 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-5367b676-cd40-4bd2-ab46-416cbce1d58d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:18.137174 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 916/1855] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:56:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:56:18.142594 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a76797-5386-4ccd-a011-ed091ed24d4f admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:18.204772 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:18.245562 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a76797-5386-4ccd-a011-ed091ed24d4f admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:18.251460 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec5a85d-4d74-4175-922a-879d61234abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:18.252087 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec5a85d-4d74-4175-922a-879d61234abd admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:18.252436 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec5a85d-4d74-4175-922a-879d61234abd admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:18.253019 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec5a85d-4d74-4175-922a-879d61234abd admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:18.253733 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec5a85d-4d74-4175-922a-879d61234abd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:18.255958 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec5a85d-4d74-4175-922a-879d61234abd admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:18.298533 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 940/1856] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 14:56:18 2022] POST /identity/v3/projects => generated 379 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:56:18.302033 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5367b676-cd40-4bd2-ab46-416cbce1d58d None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:18.314085 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5367b676-cd40-4bd2-ab46-416cbce1d58d None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:18.391985 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae1f6ca-9c30-4a02-bf2d-ff7af4aa5799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:18.393229 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae1f6ca-9c30-4a02-bf2d-ff7af4aa5799 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:18.393577 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae1f6ca-9c30-4a02-bf2d-ff7af4aa5799 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:18.393919 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae1f6ca-9c30-4a02-bf2d-ff7af4aa5799 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:18.394629 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae1f6ca-9c30-4a02-bf2d-ff7af4aa5799 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:18.396930 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae1f6ca-9c30-4a02-bf2d-ff7af4aa5799 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:18.448681 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 917/1857] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 14:56:18 2022] POST /identity/v3/users => generated 290 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:56:18.450005 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec5a85d-4d74-4175-922a-879d61234abd admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:18.463548 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec5a85d-4d74-4175-922a-879d61234abd admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:18.485345 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ee3f4b-be28-4640-abce-d300f0de7ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:18.486419 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee3f4b-be28-4640-abce-d300f0de7ded admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:18.486646 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee3f4b-be28-4640-abce-d300f0de7ded admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:18.486926 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee3f4b-be28-4640-abce-d300f0de7ded admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:18.487740 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ee3f4b-be28-4640-abce-d300f0de7ded admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:18.490445 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ee3f4b-be28-4640-abce-d300f0de7ded admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:18.509470 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 941/1858] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:56:18 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:56:18.510534 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae1f6ca-9c30-4a02-bf2d-ff7af4aa5799 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:18.530732 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae1f6ca-9c30-4a02-bf2d-ff7af4aa5799 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:18.539404 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115ff3c4-391b-4364-bbde-89a9c9643cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:18.540222 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ff3c4-391b-4364-bbde-89a9c9643cda admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:18.540507 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ff3c4-391b-4364-bbde-89a9c9643cda admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:18.540778 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ff3c4-391b-4364-bbde-89a9c9643cda admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:18.541512 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115ff3c4-391b-4364-bbde-89a9c9643cda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:18.543141 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115ff3c4-391b-4364-bbde-89a9c9643cda admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:18.558964 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 918/1859] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:56:18 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:56:18.563411 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ee3f4b-be28-4640-abce-d300f0de7ded admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:18.579107 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ee3f4b-be28-4640-abce-d300f0de7ded admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:18.585829 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b92adb4-7c3c-46af-bd2c-7525c5037f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:18.586666 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b92adb4-7c3c-46af-bd2c-7525c5037f64 admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:18.587141 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b92adb4-7c3c-46af-bd2c-7525c5037f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:18.587843 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b92adb4-7c3c-46af-bd2c-7525c5037f64 admin admin] PATH_INFO: `/v3/projects/7387d19688ea4c7ea2852e312fab40cc/users/525e343c436a43c796d59e75a6cd3c24/roles/74de6794e3b3422b93d26f993d260c35` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:18.619509 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b92adb4-7c3c-46af-bd2c-7525c5037f64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7387d19688ea4c7ea2852e312fab40cc, user_id=525e343c436a43c796d59e75a6cd3c24, role_id=74de6794e3b3422b93d26f993d260c35)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:18.622992 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b92adb4-7c3c-46af-bd2c-7525c5037f64 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:18.651938 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 942/1860] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 14:56:18 2022] PUT /identity/v3/projects/7387d19688ea4c7ea2852e312fab40cc/users/525e343c436a43c796d59e75a6cd3c24/roles/74de6794e3b3422b93d26f993d260c35 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 14:56:18.656428 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d574c2ba-e8d9-4b5b-a3fc-825951d65e72 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:18.657128 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d574c2ba-e8d9-4b5b-a3fc-825951d65e72 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:18.657128 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d574c2ba-e8d9-4b5b-a3fc-825951d65e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:18.725866 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-d574c2ba-e8d9-4b5b-a3fc-825951d65e72 None None] MFA Rules not processed for user `525e343c436a43c796d59e75a6cd3c24`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:18.727202 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d574c2ba-e8d9-4b5b-a3fc-825951d65e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:18.823303 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 919/1861] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:56:18 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:56:18.828081 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b92adb4-7c3c-46af-bd2c-7525c5037f64 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:18.912255 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b92adb4-7c3c-46af-bd2c-7525c5037f64 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:18.918311 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d96bcb-e04c-44af-82e3-708af69f74b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:18.919154 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d96bcb-e04c-44af-82e3-708af69f74b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:18.919510 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d96bcb-e04c-44af-82e3-708af69f74b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:18.919852 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d96bcb-e04c-44af-82e3-708af69f74b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:18.920679 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d96bcb-e04c-44af-82e3-708af69f74b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:18.922877 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d96bcb-e04c-44af-82e3-708af69f74b9 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:18.962567 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 943/1862] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 14:56:18 2022] POST /identity/v3/projects => generated 379 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:56:18.963546 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d574c2ba-e8d9-4b5b-a3fc-825951d65e72 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:18.975179 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d574c2ba-e8d9-4b5b-a3fc-825951d65e72 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:18.990519 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:19.117526 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7420ef1e-36e5-4494-b790-7caaf5e90099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:19.118074 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7420ef1e-36e5-4494-b790-7caaf5e90099 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:19.118352 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7420ef1e-36e5-4494-b790-7caaf5e90099 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:19.118733 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7420ef1e-36e5-4494-b790-7caaf5e90099 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:19.119579 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7420ef1e-36e5-4494-b790-7caaf5e90099 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:19.122425 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7420ef1e-36e5-4494-b790-7caaf5e90099 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:19.193321 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 920/1863] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 14:56:18 2022] POST /identity/v3/users => generated 296 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 14:56:19.206018 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d96bcb-e04c-44af-82e3-708af69f74b9 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:19.226017 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d96bcb-e04c-44af-82e3-708af69f74b9 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:19.235660 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5782f1b-d6ee-4901-a5a7-fd617261f9ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:19.236289 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5782f1b-d6ee-4901-a5a7-fd617261f9ad admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:19.236563 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5782f1b-d6ee-4901-a5a7-fd617261f9ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:19.236832 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5782f1b-d6ee-4901-a5a7-fd617261f9ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:19.237534 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5782f1b-d6ee-4901-a5a7-fd617261f9ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:19.239242 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5782f1b-d6ee-4901-a5a7-fd617261f9ad admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:19.256718 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 944/1864] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:56:19 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:56:19.259310 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7420ef1e-36e5-4494-b790-7caaf5e90099 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:19.275303 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7420ef1e-36e5-4494-b790-7caaf5e90099 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:19.280667 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7b972f-8146-4d99-a2c0-dc5618a89da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:19.283556 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b972f-8146-4d99-a2c0-dc5618a89da4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:19.283844 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b972f-8146-4d99-a2c0-dc5618a89da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:19.284120 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b972f-8146-4d99-a2c0-dc5618a89da4 admin admin] PATH_INFO: `/v3/projects/43155ac1368e4e8d8c50bb3b4b8624af/users/87b4de9375af4d24b3c7f254c5537f09/roles/019bde1756cb40de8ce06cef6b261f79` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:19.301169 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7b972f-8146-4d99-a2c0-dc5618a89da4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43155ac1368e4e8d8c50bb3b4b8624af, user_id=87b4de9375af4d24b3c7f254c5537f09, role_id=019bde1756cb40de8ce06cef6b261f79)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:19.305972 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7b972f-8146-4d99-a2c0-dc5618a89da4 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:19.332208 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 921/1865] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 14:56:19 2022] PUT /identity/v3/projects/43155ac1368e4e8d8c50bb3b4b8624af/users/87b4de9375af4d24b3c7f254c5537f09/roles/019bde1756cb40de8ce06cef6b261f79 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:56:19.345081 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5782f1b-d6ee-4901-a5a7-fd617261f9ad admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:19.368914 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5782f1b-d6ee-4901-a5a7-fd617261f9ad admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:19.487753 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6372edd2-ee57-4a4e-a69c-19c77dea62eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:19.488640 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6372edd2-ee57-4a4e-a69c-19c77dea62eb admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:19.489036 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6372edd2-ee57-4a4e-a69c-19c77dea62eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:19.489406 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6372edd2-ee57-4a4e-a69c-19c77dea62eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:19.490249 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6372edd2-ee57-4a4e-a69c-19c77dea62eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:19.492272 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6372edd2-ee57-4a4e-a69c-19c77dea62eb admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:19.495374 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:19.514179 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7b972f-8146-4d99-a2c0-dc5618a89da4 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:19.526285 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 945/1866] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:56:19 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:56:19.538175 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7b972f-8146-4d99-a2c0-dc5618a89da4 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:19.544564 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadb7384-0d0a-4bcd-9a14-ac5b4e4aac22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:19.545266 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb7384-0d0a-4bcd-9a14-ac5b4e4aac22 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:19.545547 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb7384-0d0a-4bcd-9a14-ac5b4e4aac22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:19.545821 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb7384-0d0a-4bcd-9a14-ac5b4e4aac22 admin admin] PATH_INFO: `/v3/projects/43155ac1368e4e8d8c50bb3b4b8624af/users/87b4de9375af4d24b3c7f254c5537f09/roles/019bde1756cb40de8ce06cef6b261f79` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:19.547759 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadb7384-0d0a-4bcd-9a14-ac5b4e4aac22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43155ac1368e4e8d8c50bb3b4b8624af, user_id=87b4de9375af4d24b3c7f254c5537f09, role_id=019bde1756cb40de8ce06cef6b261f79)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:19.550453 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadb7384-0d0a-4bcd-9a14-ac5b4e4aac22 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:19.574962 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 922/1867] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 14:56:19 2022] PUT /identity/v3/projects/43155ac1368e4e8d8c50bb3b4b8624af/users/87b4de9375af4d24b3c7f254c5537f09/roles/019bde1756cb40de8ce06cef6b261f79 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 14:56:19.586576 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef2017f-9023-4680-9da1-bba2830fabbf None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:19.587242 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef2017f-9023-4680-9da1-bba2830fabbf None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:19.587724 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef2017f-9023-4680-9da1-bba2830fabbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:19.638216 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-eef2017f-9023-4680-9da1-bba2830fabbf None None] MFA Rules not processed for user `87b4de9375af4d24b3c7f254c5537f09`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:19.640052 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-eef2017f-9023-4680-9da1-bba2830fabbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:19.775994 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 946/1868] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:56:19 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:56:19.793898 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadb7384-0d0a-4bcd-9a14-ac5b4e4aac22 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:19.795655 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-aadb7384-0d0a-4bcd-9a14-ac5b4e4aac22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:19.880797 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadb7384-0d0a-4bcd-9a14-ac5b4e4aac22 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:19.884922 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d11b549-56dc-4e71-abe8-d32436f6d239 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df648c909ddb41418128b43f925f5ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:19.885610 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d11b549-56dc-4e71-abe8-d32436f6d239 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:19.885882 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d11b549-56dc-4e71-abe8-d32436f6d239 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:19.886181 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d11b549-56dc-4e71-abe8-d32436f6d239 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:19.919938 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d11b549-56dc-4e71-abe8-d32436f6d239 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:19.922009 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d11b549-56dc-4e71-abe8-d32436f6d239 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:19.951853 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 923/1869] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:56:19 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:56:20.035544 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef2017f-9023-4680-9da1-bba2830fabbf None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:20.037469 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-eef2017f-9023-4680-9da1-bba2830fabbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:20.056298 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef2017f-9023-4680-9da1-bba2830fabbf None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:20.060325 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2aea76-23f5-4562-bb0c-ee08385ca4b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df648c909ddb41418128b43f925f5ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:20.060940 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2aea76-23f5-4562-bb0c-ee08385ca4b4 service cinder] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:20.061244 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2aea76-23f5-4562-bb0c-ee08385ca4b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:20.061514 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2aea76-23f5-4562-bb0c-ee08385ca4b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:20.125212 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2aea76-23f5-4562-bb0c-ee08385ca4b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:20.126734 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2aea76-23f5-4562-bb0c-ee08385ca4b4 service cinder] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:20.136493 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 947/1870] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:56:20 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:56:23.276655 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d11b549-56dc-4e71-abe8-d32436f6d239 service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:23.361010 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d11b549-56dc-4e71-abe8-d32436f6d239 service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:23.366643 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fe8821-c074-4963-8091-d4aa399135cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:23.367284 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fe8821-c074-4963-8091-d4aa399135cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:23.367627 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fe8821-c074-4963-8091-d4aa399135cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:23.367921 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fe8821-c074-4963-8091-d4aa399135cb admin admin] PATH_INFO: `/v3/users/cc40ae0a61a84cd9bdcc5f6802275ad9` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:23.369170 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fe8821-c074-4963-8091-d4aa399135cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc40ae0a61a84cd9bdcc5f6802275ad9)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:23.371454 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fe8821-c074-4963-8091-d4aa399135cb admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:23.384867 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:23.440035 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-91fe8821-c074-4963-8091-d4aa399135cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc40ae0a61a84cd9bdcc5f6802275ad9'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:23.449657 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-91fe8821-c074-4963-8091-d4aa399135cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc40ae0a61a84cd9bdcc5f6802275ad9'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:23.451305 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-91fe8821-c074-4963-8091-d4aa399135cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc40ae0a61a84cd9bdcc5f6802275ad9'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:23.452300 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-91fe8821-c074-4963-8091-d4aa399135cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc40ae0a61a84cd9bdcc5f6802275ad9'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:23.463261 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-91fe8821-c074-4963-8091-d4aa399135cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc40ae0a61a84cd9bdcc5f6802275ad9'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:23.495831 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 924/1871] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 14:56:23 2022] DELETE /identity/v3/users/cc40ae0a61a84cd9bdcc5f6802275ad9 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:56:23.500675 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7927c012-bd82-48f2-bba5-280e4a0ecb82 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:23.501247 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7927c012-bd82-48f2-bba5-280e4a0ecb82 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:23.501366 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7927c012-bd82-48f2-bba5-280e4a0ecb82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:23.522806 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-7927c012-bd82-48f2-bba5-280e4a0ecb82 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:23.524494 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-7927c012-bd82-48f2-bba5-280e4a0ecb82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:23.683306 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 948/1872] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:56:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:56:23.696417 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fe8821-c074-4963-8091-d4aa399135cb admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:23.699236 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-91fe8821-c074-4963-8091-d4aa399135cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:23.801584 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fe8821-c074-4963-8091-d4aa399135cb admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:23.807938 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5459d001-18be-47a6-9376-c41ebf8eeafc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:23.813538 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5459d001-18be-47a6-9376-c41ebf8eeafc service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:23.814020 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5459d001-18be-47a6-9376-c41ebf8eeafc service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:23.814497 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5459d001-18be-47a6-9376-c41ebf8eeafc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:23.831680 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5459d001-18be-47a6-9376-c41ebf8eeafc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:23.837575 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5459d001-18be-47a6-9376-c41ebf8eeafc service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:23.855384 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 925/1873] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:56:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:56:24.303348 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7927c012-bd82-48f2-bba5-280e4a0ecb82 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:24.305762 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-7927c012-bd82-48f2-bba5-280e4a0ecb82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:24.319204 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7927c012-bd82-48f2-bba5-280e4a0ecb82 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:24.325535 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c413f24-bb3b-49e0-8dca-9056e4a2b53a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:24.326402 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c413f24-bb3b-49e0-8dca-9056e4a2b53a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:24.326660 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c413f24-bb3b-49e0-8dca-9056e4a2b53a admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:24.326948 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c413f24-bb3b-49e0-8dca-9056e4a2b53a admin admin] PATH_INFO: `/v3/projects/f8600295b0a149aaa915571ffb778f5c` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:24.328636 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c413f24-bb3b-49e0-8dca-9056e4a2b53a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8600295b0a149aaa915571ffb778f5c)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:24.331083 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c413f24-bb3b-49e0-8dca-9056e4a2b53a admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:24.352492 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:24.402671 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-9c413f24-bb3b-49e0-8dca-9056e4a2b53a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8600295b0a149aaa915571ffb778f5c', 'request_id': 'req-9c413f24-bb3b-49e0-8dca-9056e4a2b53a'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:24.414628 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-9c413f24-bb3b-49e0-8dca-9056e4a2b53a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8600295b0a149aaa915571ffb778f5c', 'request_id': 'req-9c413f24-bb3b-49e0-8dca-9056e4a2b53a'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:24.436675 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-9c413f24-bb3b-49e0-8dca-9056e4a2b53a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8600295b0a149aaa915571ffb778f5c', 'request_id': 'req-9c413f24-bb3b-49e0-8dca-9056e4a2b53a'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:24.458541 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-9c413f24-bb3b-49e0-8dca-9056e4a2b53a admin admin] The token cache is being invalidate because project f8600295b0a149aaa915571ffb778f5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:56:24.459261 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-9c413f24-bb3b-49e0-8dca-9056e4a2b53a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:24.460089 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-9c413f24-bb3b-49e0-8dca-9056e4a2b53a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:24.462629 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 949/1874] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 14:56:24 2022] DELETE /identity/v3/projects/f8600295b0a149aaa915571ffb778f5c => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:56:24.466788 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5459d001-18be-47a6-9376-c41ebf8eeafc service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:24.477837 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5459d001-18be-47a6-9376-c41ebf8eeafc service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:24.576177 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a40e611-a555-4d25-8ec3-1adec841efe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:24.577568 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a40e611-a555-4d25-8ec3-1adec841efe4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:24.578589 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a40e611-a555-4d25-8ec3-1adec841efe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:24.579747 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a40e611-a555-4d25-8ec3-1adec841efe4 admin admin] PATH_INFO: `/v3/users/525e343c436a43c796d59e75a6cd3c24` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:24.581276 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a40e611-a555-4d25-8ec3-1adec841efe4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=525e343c436a43c796d59e75a6cd3c24)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:24.586231 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a40e611-a555-4d25-8ec3-1adec841efe4 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:24.651466 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:24.672693 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5a40e611-a555-4d25-8ec3-1adec841efe4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '525e343c436a43c796d59e75a6cd3c24'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:24.683714 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5a40e611-a555-4d25-8ec3-1adec841efe4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '525e343c436a43c796d59e75a6cd3c24'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:24.684547 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5a40e611-a555-4d25-8ec3-1adec841efe4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '525e343c436a43c796d59e75a6cd3c24'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:24.685519 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5a40e611-a555-4d25-8ec3-1adec841efe4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '525e343c436a43c796d59e75a6cd3c24'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:24.700251 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5a40e611-a555-4d25-8ec3-1adec841efe4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '525e343c436a43c796d59e75a6cd3c24'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:24.723830 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 926/1875] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 14:56:24 2022] DELETE /identity/v3/users/525e343c436a43c796d59e75a6cd3c24 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:56:25.190090 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c413f24-bb3b-49e0-8dca-9056e4a2b53a admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:25.193367 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-9c413f24-bb3b-49e0-8dca-9056e4a2b53a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:25.215716 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c413f24-bb3b-49e0-8dca-9056e4a2b53a admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:25.335438 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb0928c-b194-4dd4-a403-01e5528f45eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:25.336679 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb0928c-b194-4dd4-a403-01e5528f45eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:25.337162 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb0928c-b194-4dd4-a403-01e5528f45eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:25.337723 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb0928c-b194-4dd4-a403-01e5528f45eb admin admin] PATH_INFO: `/v3/projects/7387d19688ea4c7ea2852e312fab40cc` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:25.346100 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb0928c-b194-4dd4-a403-01e5528f45eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=7387d19688ea4c7ea2852e312fab40cc)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:25.349032 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb0928c-b194-4dd4-a403-01e5528f45eb admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:25.481512 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-8fb0928c-b194-4dd4-a403-01e5528f45eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7387d19688ea4c7ea2852e312fab40cc', 'request_id': 'req-8fb0928c-b194-4dd4-a403-01e5528f45eb'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:25.493253 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-8fb0928c-b194-4dd4-a403-01e5528f45eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7387d19688ea4c7ea2852e312fab40cc', 'request_id': 'req-8fb0928c-b194-4dd4-a403-01e5528f45eb'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:25.509091 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-8fb0928c-b194-4dd4-a403-01e5528f45eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7387d19688ea4c7ea2852e312fab40cc', 'request_id': 'req-8fb0928c-b194-4dd4-a403-01e5528f45eb'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:25.524788 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-8fb0928c-b194-4dd4-a403-01e5528f45eb admin admin] The token cache is being invalidate because project 7387d19688ea4c7ea2852e312fab40cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:56:25.525164 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-8fb0928c-b194-4dd4-a403-01e5528f45eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:25.525792 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-8fb0928c-b194-4dd4-a403-01e5528f45eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:25.527724 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 950/1876] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 14:56:25 2022] DELETE /identity/v3/projects/7387d19688ea4c7ea2852e312fab40cc => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:56:25.532569 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a40e611-a555-4d25-8ec3-1adec841efe4 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:25.537129 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-5a40e611-a555-4d25-8ec3-1adec841efe4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:25.551623 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a40e611-a555-4d25-8ec3-1adec841efe4 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:25.626418 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2f4a80-dda1-47b9-9855-25d15362838b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:25.627079 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f4a80-dda1-47b9-9855-25d15362838b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:25.627357 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f4a80-dda1-47b9-9855-25d15362838b admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:25.627630 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f4a80-dda1-47b9-9855-25d15362838b admin admin] PATH_INFO: `/v3/users/87b4de9375af4d24b3c7f254c5537f09` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:25.628832 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2f4a80-dda1-47b9-9855-25d15362838b admin admin] RBAC: Authorizing `identity:delete_user(user_id=87b4de9375af4d24b3c7f254c5537f09)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:25.630846 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2f4a80-dda1-47b9-9855-25d15362838b admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:25.689254 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb0928c-b194-4dd4-a403-01e5528f45eb admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:25.691679 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-8fb0928c-b194-4dd4-a403-01e5528f45eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:25.702591 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0e2f4a80-dda1-47b9-9855-25d15362838b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87b4de9375af4d24b3c7f254c5537f09'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:25.708368 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb0928c-b194-4dd4-a403-01e5528f45eb admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:25.715160 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47166ef-1644-400f-aa1f-630363871720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:25.715946 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47166ef-1644-400f-aa1f-630363871720 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:25.716662 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47166ef-1644-400f-aa1f-630363871720 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:25.716662 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47166ef-1644-400f-aa1f-630363871720 admin admin] PATH_INFO: `/v3/users/e8feb9bb504b46ef973b708a6b1ee7d7` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:25.718099 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47166ef-1644-400f-aa1f-630363871720 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8feb9bb504b46ef973b708a6b1ee7d7)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:25.719174 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0e2f4a80-dda1-47b9-9855-25d15362838b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87b4de9375af4d24b3c7f254c5537f09'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:25.720075 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47166ef-1644-400f-aa1f-630363871720 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:25.720329 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0e2f4a80-dda1-47b9-9855-25d15362838b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87b4de9375af4d24b3c7f254c5537f09'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:25.721178 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0e2f4a80-dda1-47b9-9855-25d15362838b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87b4de9375af4d24b3c7f254c5537f09'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:25.731851 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0e2f4a80-dda1-47b9-9855-25d15362838b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87b4de9375af4d24b3c7f254c5537f09'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:25.759281 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 927/1877] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 14:56:25 2022] DELETE /identity/v3/users/87b4de9375af4d24b3c7f254c5537f09 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:56:25.778951 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:25.816132 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-a47166ef-1644-400f-aa1f-630363871720 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8feb9bb504b46ef973b708a6b1ee7d7'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:25.833063 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-a47166ef-1644-400f-aa1f-630363871720 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8feb9bb504b46ef973b708a6b1ee7d7'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:25.835296 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-a47166ef-1644-400f-aa1f-630363871720 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8feb9bb504b46ef973b708a6b1ee7d7'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:25.836543 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-a47166ef-1644-400f-aa1f-630363871720 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8feb9bb504b46ef973b708a6b1ee7d7'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:25.858499 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-a47166ef-1644-400f-aa1f-630363871720 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8feb9bb504b46ef973b708a6b1ee7d7'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:25.876651 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 951/1878] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 14:56:25 2022] DELETE /identity/v3/users/e8feb9bb504b46ef973b708a6b1ee7d7 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:56:25.881658 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f6dce9-0e47-410d-b8e6-97739f6b7ea3 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:25.885577 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f6dce9-0e47-410d-b8e6-97739f6b7ea3 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:25.886525 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f6dce9-0e47-410d-b8e6-97739f6b7ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:25.941248 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-d4f6dce9-0e47-410d-b8e6-97739f6b7ea3 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:25.946653 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d4f6dce9-0e47-410d-b8e6-97739f6b7ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:26.010618 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:26.077334 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 928/1879] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:56:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:56:26.091276 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47166ef-1644-400f-aa1f-630363871720 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:26.093021 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-a47166ef-1644-400f-aa1f-630363871720 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:26.204095 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47166ef-1644-400f-aa1f-630363871720 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:26.219720 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1bacc5-0937-40d8-8dbc-edd73ccf6a21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:26.220448 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1bacc5-0937-40d8-8dbc-edd73ccf6a21 service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:26.220798 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1bacc5-0937-40d8-8dbc-edd73ccf6a21 service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:26.221760 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1bacc5-0937-40d8-8dbc-edd73ccf6a21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:26.234085 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1bacc5-0937-40d8-8dbc-edd73ccf6a21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:26.235606 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1bacc5-0937-40d8-8dbc-edd73ccf6a21 service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:26.246715 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 952/1880] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:56:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:56:26.304426 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f6dce9-0e47-410d-b8e6-97739f6b7ea3 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:26.306063 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d4f6dce9-0e47-410d-b8e6-97739f6b7ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:26.338344 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f6dce9-0e47-410d-b8e6-97739f6b7ea3 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:26.349362 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a06b1b-77ef-44c5-a77d-3b3e04c69438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:26.350163 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a06b1b-77ef-44c5-a77d-3b3e04c69438 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:26.350429 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a06b1b-77ef-44c5-a77d-3b3e04c69438 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:26.350709 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a06b1b-77ef-44c5-a77d-3b3e04c69438 admin admin] PATH_INFO: `/v3/projects/43155ac1368e4e8d8c50bb3b4b8624af` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:26.351943 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a06b1b-77ef-44c5-a77d-3b3e04c69438 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43155ac1368e4e8d8c50bb3b4b8624af)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:26.353890 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a06b1b-77ef-44c5-a77d-3b3e04c69438 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:26.417583 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a4a06b1b-77ef-44c5-a77d-3b3e04c69438 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43155ac1368e4e8d8c50bb3b4b8624af', 'request_id': 'req-a4a06b1b-77ef-44c5-a77d-3b3e04c69438'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:26.424433 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a4a06b1b-77ef-44c5-a77d-3b3e04c69438 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43155ac1368e4e8d8c50bb3b4b8624af', 'request_id': 'req-a4a06b1b-77ef-44c5-a77d-3b3e04c69438'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:26.441714 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a4a06b1b-77ef-44c5-a77d-3b3e04c69438 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43155ac1368e4e8d8c50bb3b4b8624af', 'request_id': 'req-a4a06b1b-77ef-44c5-a77d-3b3e04c69438'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:26.456761 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a4a06b1b-77ef-44c5-a77d-3b3e04c69438 admin admin] The token cache is being invalidate because project 43155ac1368e4e8d8c50bb3b4b8624af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:56:26.457133 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a4a06b1b-77ef-44c5-a77d-3b3e04c69438 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:26.457896 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a4a06b1b-77ef-44c5-a77d-3b3e04c69438 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:26.460421 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 929/1881] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 14:56:26 2022] DELETE /identity/v3/projects/43155ac1368e4e8d8c50bb3b4b8624af => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:56:26.467850 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e584b33b-b2cd-4334-b0ec-53719e9e712f None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:26.469024 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e584b33b-b2cd-4334-b0ec-53719e9e712f None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:26.469310 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e584b33b-b2cd-4334-b0ec-53719e9e712f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:26.532158 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-e584b33b-b2cd-4334-b0ec-53719e9e712f None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:26.533573 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-e584b33b-b2cd-4334-b0ec-53719e9e712f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:26.642555 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 953/1882] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:56:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:56:26.644560 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f806a-4239-4dda-8a20-24c79e41244b None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:26.645176 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f806a-4239-4dda-8a20-24c79e41244b None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:26.645661 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f806a-4239-4dda-8a20-24c79e41244b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:26.667999 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-d59f806a-4239-4dda-8a20-24c79e41244b None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:26.669371 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d59f806a-4239-4dda-8a20-24c79e41244b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:26.681900 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 930/1883] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:56:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:56:26.683730 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e584b33b-b2cd-4334-b0ec-53719e9e712f None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:26.696602 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e584b33b-b2cd-4334-b0ec-53719e9e712f None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:26.705006 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034dbf8a-a81b-453b-bdec-986c4059e377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:26.705699 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034dbf8a-a81b-453b-bdec-986c4059e377 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:26.705996 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034dbf8a-a81b-453b-bdec-986c4059e377 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:26.706266 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034dbf8a-a81b-453b-bdec-986c4059e377 admin admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:26.706927 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034dbf8a-a81b-453b-bdec-986c4059e377 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:56:26.707234 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034dbf8a-a81b-453b-bdec-986c4059e377 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:26.709354 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034dbf8a-a81b-453b-bdec-986c4059e377 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:26.731969 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 954/1884] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 19 14:56:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:56:26.736285 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59f806a-4239-4dda-8a20-24c79e41244b None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:26.753763 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034dbf8a-a81b-453b-bdec-986c4059e377 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:26.754274 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59f806a-4239-4dda-8a20-24c79e41244b None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:26.755647 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-034dbf8a-a81b-453b-bdec-986c4059e377 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:26.760470 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d1e2e-ac80-40b7-8712-906b03729703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:26.761385 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d1e2e-ac80-40b7-8712-906b03729703 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:26.761852 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d1e2e-ac80-40b7-8712-906b03729703 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:26.762263 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d1e2e-ac80-40b7-8712-906b03729703 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:26.763419 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292d1e2e-ac80-40b7-8712-906b03729703 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:26.765523 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292d1e2e-ac80-40b7-8712-906b03729703 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:26.788807 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034dbf8a-a81b-453b-bdec-986c4059e377 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:26.811206 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220fcfae-c955-4792-93c6-00961aa681e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:26.821944 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220fcfae-c955-4792-93c6-00961aa681e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:26.823688 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220fcfae-c955-4792-93c6-00961aa681e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:26.824145 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220fcfae-c955-4792-93c6-00961aa681e9 admin admin] PATH_INFO: `/v3/projects/abdc1ed269184df1aa62d49a03644d36` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:26.830614 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220fcfae-c955-4792-93c6-00961aa681e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abdc1ed269184df1aa62d49a03644d36)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:26.835109 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220fcfae-c955-4792-93c6-00961aa681e9 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:26.839185 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 931/1885] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 14:56:26 2022] POST /identity/v3/projects => generated 383 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:56:26.845458 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d1e2e-ac80-40b7-8712-906b03729703 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:26.897441 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:26.915429 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-220fcfae-c955-4792-93c6-00961aa681e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abdc1ed269184df1aa62d49a03644d36', 'request_id': 'req-220fcfae-c955-4792-93c6-00961aa681e9'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:26.923486 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-220fcfae-c955-4792-93c6-00961aa681e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abdc1ed269184df1aa62d49a03644d36', 'request_id': 'req-220fcfae-c955-4792-93c6-00961aa681e9'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:26.925251 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d1e2e-ac80-40b7-8712-906b03729703 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:26.933453 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-220fcfae-c955-4792-93c6-00961aa681e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abdc1ed269184df1aa62d49a03644d36', 'request_id': 'req-220fcfae-c955-4792-93c6-00961aa681e9'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:26.945166 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-220fcfae-c955-4792-93c6-00961aa681e9 admin admin] The token cache is being invalidate because project abdc1ed269184df1aa62d49a03644d36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:56:26.945457 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-220fcfae-c955-4792-93c6-00961aa681e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:26.946126 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-220fcfae-c955-4792-93c6-00961aa681e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:26.948542 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 955/1886] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 14:56:26 2022] DELETE /identity/v3/projects/abdc1ed269184df1aa62d49a03644d36 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 14:56:26.952793 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220fcfae-c955-4792-93c6-00961aa681e9 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:26.955230 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-220fcfae-c955-4792-93c6-00961aa681e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:26.957259 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:26.992427 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4178e8f-4abb-4d42-9001-66e71be9f0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:26.993097 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4178e8f-4abb-4d42-9001-66e71be9f0e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:26.993374 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4178e8f-4abb-4d42-9001-66e71be9f0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:26.993642 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4178e8f-4abb-4d42-9001-66e71be9f0e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:26.994271 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4178e8f-4abb-4d42-9001-66e71be9f0e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:26.996539 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4178e8f-4abb-4d42-9001-66e71be9f0e9 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:27.022545 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 932/1887] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 14:56:26 2022] POST /identity/v3/users => generated 292 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 14:56:27.026711 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4178e8f-4abb-4d42-9001-66e71be9f0e9 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:27.028449 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e4178e8f-4abb-4d42-9001-66e71be9f0e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:27.040743 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4178e8f-4abb-4d42-9001-66e71be9f0e9 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:27.049750 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73e67ce-3a80-4476-869a-51a0691f811c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:27.050374 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73e67ce-3a80-4476-869a-51a0691f811c admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:27.050647 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73e67ce-3a80-4476-869a-51a0691f811c admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:27.050916 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73e67ce-3a80-4476-869a-51a0691f811c admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:27.051676 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73e67ce-3a80-4476-869a-51a0691f811c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:27.053598 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73e67ce-3a80-4476-869a-51a0691f811c admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:27.065031 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 933/1888] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:56:27 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 14:56:27.065606 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220fcfae-c955-4792-93c6-00961aa681e9 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:27.072073 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c75fa3f-128d-434a-a517-c9e6e7e09386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:27.072646 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73e67ce-3a80-4476-869a-51a0691f811c admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:27.072826 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c75fa3f-128d-434a-a517-c9e6e7e09386 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:27.073170 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c75fa3f-128d-434a-a517-c9e6e7e09386 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:27.073505 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c75fa3f-128d-434a-a517-c9e6e7e09386 admin admin] PATH_INFO: `/v3/users/b69f2c8681dc4071b3b4c5295bba65a7` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:27.074968 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c75fa3f-128d-434a-a517-c9e6e7e09386 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b69f2c8681dc4071b3b4c5295bba65a7)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:27.077214 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c75fa3f-128d-434a-a517-c9e6e7e09386 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:27.084514 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73e67ce-3a80-4476-869a-51a0691f811c admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:27.090325 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a67200b-f4c5-4ff7-a6ad-71afd002edca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:27.091202 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a67200b-f4c5-4ff7-a6ad-71afd002edca admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:27.091493 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a67200b-f4c5-4ff7-a6ad-71afd002edca admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:27.091885 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a67200b-f4c5-4ff7-a6ad-71afd002edca admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:27.092793 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a67200b-f4c5-4ff7-a6ad-71afd002edca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:27.094662 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a67200b-f4c5-4ff7-a6ad-71afd002edca admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:27.106614 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 934/1889] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:56:27 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 14:56:27.111103 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a67200b-f4c5-4ff7-a6ad-71afd002edca admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:27.124363 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a67200b-f4c5-4ff7-a6ad-71afd002edca admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:27.132961 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f722252e-6967-4315-8406-cec9023e985e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:27.133520 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f722252e-6967-4315-8406-cec9023e985e admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:27.133788 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f722252e-6967-4315-8406-cec9023e985e admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:27.134134 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f722252e-6967-4315-8406-cec9023e985e admin admin] PATH_INFO: `/v3/projects/82257693594c42fd9d6369f1db57bd14/users/27f96d74ed034b76b79f2c0b0ad1d58a/roles/74de6794e3b3422b93d26f993d260c35` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:27.151790 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-0c75fa3f-128d-434a-a517-c9e6e7e09386 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b69f2c8681dc4071b3b4c5295bba65a7'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:27.154829 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f722252e-6967-4315-8406-cec9023e985e admin admin] RBAC: Authorizing `identity:create_grant(project_id=82257693594c42fd9d6369f1db57bd14, user_id=27f96d74ed034b76b79f2c0b0ad1d58a, role_id=74de6794e3b3422b93d26f993d260c35)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:27.157598 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f722252e-6967-4315-8406-cec9023e985e admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:27.161890 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-0c75fa3f-128d-434a-a517-c9e6e7e09386 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b69f2c8681dc4071b3b4c5295bba65a7'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:27.162677 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-0c75fa3f-128d-434a-a517-c9e6e7e09386 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b69f2c8681dc4071b3b4c5295bba65a7'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:27.163536 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-0c75fa3f-128d-434a-a517-c9e6e7e09386 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b69f2c8681dc4071b3b4c5295bba65a7'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:27.172366 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 935/1890] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 14:56:27 2022] PUT /identity/v3/projects/82257693594c42fd9d6369f1db57bd14/users/27f96d74ed034b76b79f2c0b0ad1d58a/roles/74de6794e3b3422b93d26f993d260c35 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 14:56:27.190428 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-0c75fa3f-128d-434a-a517-c9e6e7e09386 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b69f2c8681dc4071b3b4c5295bba65a7'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:27.190645 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44808705-230a-4bc8-a0c2-1bd3988a3478 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:27.190645 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44808705-230a-4bc8-a0c2-1bd3988a3478 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:27.190645 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44808705-230a-4bc8-a0c2-1bd3988a3478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:27.197755 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 956/1891] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 14:56:26 2022] DELETE /identity/v3/users/b69f2c8681dc4071b3b4c5295bba65a7 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 14:56:27.226483 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-44808705-230a-4bc8-a0c2-1bd3988a3478 None None] MFA Rules not processed for user `27f96d74ed034b76b79f2c0b0ad1d58a`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:27.228105 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-44808705-230a-4bc8-a0c2-1bd3988a3478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:27.337451 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 936/1892] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:56:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 14:56:27.338839 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c75fa3f-128d-434a-a517-c9e6e7e09386 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:27.340519 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-0c75fa3f-128d-434a-a517-c9e6e7e09386 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:27.400145 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:27.433431 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c75fa3f-128d-434a-a517-c9e6e7e09386 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:27.439538 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ab4c7e-3a37-4122-aff8-60d42ebe244c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:27.440419 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ab4c7e-3a37-4122-aff8-60d42ebe244c admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:27.440876 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ab4c7e-3a37-4122-aff8-60d42ebe244c admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:27.441359 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ab4c7e-3a37-4122-aff8-60d42ebe244c admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:27.442167 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ab4c7e-3a37-4122-aff8-60d42ebe244c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:27.445020 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ab4c7e-3a37-4122-aff8-60d42ebe244c admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:27.491227 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 957/1893] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 14:56:27 2022] POST /identity/v3/projects => generated 383 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:56:27.492897 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44808705-230a-4bc8-a0c2-1bd3988a3478 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:27.521437 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44808705-230a-4bc8-a0c2-1bd3988a3478 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:27.603828 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c62b2ee-2aa5-4f34-bc0a-451cb375275a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:27.604449 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c62b2ee-2aa5-4f34-bc0a-451cb375275a admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:27.604725 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c62b2ee-2aa5-4f34-bc0a-451cb375275a admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:27.605013 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c62b2ee-2aa5-4f34-bc0a-451cb375275a admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:27.605654 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c62b2ee-2aa5-4f34-bc0a-451cb375275a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:27.607697 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c62b2ee-2aa5-4f34-bc0a-451cb375275a admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:27.619783 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:27.639069 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 937/1894] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 14:56:27 2022] POST /identity/v3/users => generated 298 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:56:27.643200 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ab4c7e-3a37-4122-aff8-60d42ebe244c admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:27.654072 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ab4c7e-3a37-4122-aff8-60d42ebe244c admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:27.660043 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcc6761-cab1-4081-a40f-97ee83657a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:27.660630 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc6761-cab1-4081-a40f-97ee83657a83 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:27.661193 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc6761-cab1-4081-a40f-97ee83657a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:27.661193 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc6761-cab1-4081-a40f-97ee83657a83 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:27.661874 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcc6761-cab1-4081-a40f-97ee83657a83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:27.663967 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcc6761-cab1-4081-a40f-97ee83657a83 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:27.677609 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 958/1895] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:56:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:56:27.682061 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c62b2ee-2aa5-4f34-bc0a-451cb375275a admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:27.693624 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c62b2ee-2aa5-4f34-bc0a-451cb375275a admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:27.701959 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fec218-c5be-4239-84ab-2420411d83a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:27.702834 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fec218-c5be-4239-84ab-2420411d83a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:27.703096 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fec218-c5be-4239-84ab-2420411d83a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:27.703363 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fec218-c5be-4239-84ab-2420411d83a6 admin admin] PATH_INFO: `/v3/projects/13cb5e8ea48a4e84bb921145aaa4dbc1/users/dffa29edfaee4108ab57394cc1c07c77/roles/019bde1756cb40de8ce06cef6b261f79` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:27.720052 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fec218-c5be-4239-84ab-2420411d83a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13cb5e8ea48a4e84bb921145aaa4dbc1, user_id=dffa29edfaee4108ab57394cc1c07c77, role_id=019bde1756cb40de8ce06cef6b261f79)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:27.723258 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fec218-c5be-4239-84ab-2420411d83a6 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:27.730764 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcc6761-cab1-4081-a40f-97ee83657a83 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:27.732533 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-cbcc6761-cab1-4081-a40f-97ee83657a83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:27.744327 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 938/1896] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 14:56:27 2022] PUT /identity/v3/projects/13cb5e8ea48a4e84bb921145aaa4dbc1/users/dffa29edfaee4108ab57394cc1c07c77/roles/019bde1756cb40de8ce06cef6b261f79 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:56:27.748034 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fec218-c5be-4239-84ab-2420411d83a6 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:27.759837 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcc6761-cab1-4081-a40f-97ee83657a83 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:27.823617 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fec218-c5be-4239-84ab-2420411d83a6 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:27.832269 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69c523d-19e2-4245-b0ce-b8b99e4e999e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:27.832930 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69c523d-19e2-4245-b0ce-b8b99e4e999e admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:27.833253 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69c523d-19e2-4245-b0ce-b8b99e4e999e admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:27.833530 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69c523d-19e2-4245-b0ce-b8b99e4e999e admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:27.834612 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69c523d-19e2-4245-b0ce-b8b99e4e999e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:27.836960 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69c523d-19e2-4245-b0ce-b8b99e4e999e admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:27.843763 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254b4287-c47f-4b88-b601-6cfc459e4251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:27.844598 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b4287-c47f-4b88-b601-6cfc459e4251 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:27.844918 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b4287-c47f-4b88-b601-6cfc459e4251 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:27.845314 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b4287-c47f-4b88-b601-6cfc459e4251 admin admin] PATH_INFO: `/v3/projects/55e9fceb3cbc4c9593d74693726dfce2` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:27.846602 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254b4287-c47f-4b88-b601-6cfc459e4251 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55e9fceb3cbc4c9593d74693726dfce2)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:27.848268 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 939/1897] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:56:27 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:56:27.848744 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254b4287-c47f-4b88-b601-6cfc459e4251 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:27.852551 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69c523d-19e2-4245-b0ce-b8b99e4e999e admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:27.867195 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69c523d-19e2-4245-b0ce-b8b99e4e999e admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:27.872510 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40166ddd-5b29-4fd7-b8cf-c9a823aeee3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:27.873226 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40166ddd-5b29-4fd7-b8cf-c9a823aeee3f admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:27.873510 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40166ddd-5b29-4fd7-b8cf-c9a823aeee3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:27.873779 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40166ddd-5b29-4fd7-b8cf-c9a823aeee3f admin admin] PATH_INFO: `/v3/projects/13cb5e8ea48a4e84bb921145aaa4dbc1/users/dffa29edfaee4108ab57394cc1c07c77/roles/019bde1756cb40de8ce06cef6b261f79` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:27.876237 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40166ddd-5b29-4fd7-b8cf-c9a823aeee3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=13cb5e8ea48a4e84bb921145aaa4dbc1, user_id=dffa29edfaee4108ab57394cc1c07c77, role_id=019bde1756cb40de8ce06cef6b261f79)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:27.878584 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40166ddd-5b29-4fd7-b8cf-c9a823aeee3f admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:27.894929 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 940/1898] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 14:56:27 2022] PUT /identity/v3/projects/13cb5e8ea48a4e84bb921145aaa4dbc1/users/dffa29edfaee4108ab57394cc1c07c77/roles/019bde1756cb40de8ce06cef6b261f79 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 14:56:27.906020 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd9fdaa-d548-466c-a12f-b246492ba03b None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:27.906466 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd9fdaa-d548-466c-a12f-b246492ba03b None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:27.906864 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd9fdaa-d548-466c-a12f-b246492ba03b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:27.916921 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-254b4287-c47f-4b88-b601-6cfc459e4251 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55e9fceb3cbc4c9593d74693726dfce2', 'request_id': 'req-254b4287-c47f-4b88-b601-6cfc459e4251'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:27.925808 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-254b4287-c47f-4b88-b601-6cfc459e4251 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55e9fceb3cbc4c9593d74693726dfce2', 'request_id': 'req-254b4287-c47f-4b88-b601-6cfc459e4251'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:27.937521 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-254b4287-c47f-4b88-b601-6cfc459e4251 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55e9fceb3cbc4c9593d74693726dfce2', 'request_id': 'req-254b4287-c47f-4b88-b601-6cfc459e4251'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:27.944264 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-2cd9fdaa-d548-466c-a12f-b246492ba03b None None] MFA Rules not processed for user `dffa29edfaee4108ab57394cc1c07c77`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:27.945890 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2cd9fdaa-d548-466c-a12f-b246492ba03b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:27.950759 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-254b4287-c47f-4b88-b601-6cfc459e4251 admin admin] The token cache is being invalidate because project 55e9fceb3cbc4c9593d74693726dfce2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:56:27.951264 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-254b4287-c47f-4b88-b601-6cfc459e4251 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:27.952047 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-254b4287-c47f-4b88-b601-6cfc459e4251 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:27.957081 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 959/1899] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 14:56:27 2022] DELETE /identity/v3/projects/55e9fceb3cbc4c9593d74693726dfce2 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:56:27.960805 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5689f7-d369-48b6-84f9-8925279ff604 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:27.961301 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5689f7-d369-48b6-84f9-8925279ff604 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:27.961587 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5689f7-d369-48b6-84f9-8925279ff604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:27.989781 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-4d5689f7-d369-48b6-84f9-8925279ff604 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:27.991111 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-4d5689f7-d369-48b6-84f9-8925279ff604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:28.032619 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 941/1900] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:56:27 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 14:56:28.039499 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:28.044582 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd9fdaa-d548-466c-a12f-b246492ba03b None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:28.046129 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2cd9fdaa-d548-466c-a12f-b246492ba03b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:28.066329 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 960/1901] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:56:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:56:28.075241 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de32d2-860c-4e6a-8160-82630196dade None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:28.075600 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de32d2-860c-4e6a-8160-82630196dade None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:28.075758 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de32d2-860c-4e6a-8160-82630196dade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:28.098126 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:28.099358 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-88de32d2-860c-4e6a-8160-82630196dade None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:28.102323 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-88de32d2-860c-4e6a-8160-82630196dade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:28.112711 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 961/1902] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:56:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:56:28.116313 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd9fdaa-d548-466c-a12f-b246492ba03b None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:28.117418 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88de32d2-860c-4e6a-8160-82630196dade None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:28.120440 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dca86f-5377-4806-9b5c-19085ed47cb1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df648c909ddb41418128b43f925f5ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:28.121103 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dca86f-5377-4806-9b5c-19085ed47cb1 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:28.121424 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dca86f-5377-4806-9b5c-19085ed47cb1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:28.121667 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dca86f-5377-4806-9b5c-19085ed47cb1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:28.123691 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-52dca86f-5377-4806-9b5c-19085ed47cb1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:28.128391 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88de32d2-860c-4e6a-8160-82630196dade None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:28.133307 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410c6b01-43e1-4d34-ada2-bb3f5d67439c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:28.133928 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c6b01-43e1-4d34-ada2-bb3f5d67439c admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:28.134193 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c6b01-43e1-4d34-ada2-bb3f5d67439c admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:28.134479 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c6b01-43e1-4d34-ada2-bb3f5d67439c admin admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:28.135127 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410c6b01-43e1-4d34-ada2-bb3f5d67439c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:56:28.135422 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410c6b01-43e1-4d34-ada2-bb3f5d67439c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:28.137032 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410c6b01-43e1-4d34-ada2-bb3f5d67439c admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:28.149322 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 962/1903] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 19 14:56:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:56:28.154097 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410c6b01-43e1-4d34-ada2-bb3f5d67439c admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:28.164048 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410c6b01-43e1-4d34-ada2-bb3f5d67439c admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:28.168591 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb855dc7-d8d4-417e-ab6c-b91fdd090c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:28.169131 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb855dc7-d8d4-417e-ab6c-b91fdd090c06 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:28.169407 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb855dc7-d8d4-417e-ab6c-b91fdd090c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:28.169671 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb855dc7-d8d4-417e-ab6c-b91fdd090c06 admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:28.170289 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb855dc7-d8d4-417e-ab6c-b91fdd090c06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:28.172214 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb855dc7-d8d4-417e-ab6c-b91fdd090c06 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:28.188977 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dca86f-5377-4806-9b5c-19085ed47cb1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:28.190833 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dca86f-5377-4806-9b5c-19085ed47cb1 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:28.201651 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 942/1904] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:56:28 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 14:56:28.206856 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 963/1905] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 14:56:28 2022] POST /identity/v3/projects => generated 381 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 14:56:28.212199 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dca86f-5377-4806-9b5c-19085ed47cb1 service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:28.223159 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dca86f-5377-4806-9b5c-19085ed47cb1 service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:28.291657 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a9f3e0-d36c-4405-b4af-669842330311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:28.292279 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a9f3e0-d36c-4405-b4af-669842330311 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:28.292573 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a9f3e0-d36c-4405-b4af-669842330311 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:28.293083 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a9f3e0-d36c-4405-b4af-669842330311 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:28.293773 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a9f3e0-d36c-4405-b4af-669842330311 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:28.295711 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a9f3e0-d36c-4405-b4af-669842330311 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:28.328188 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 943/1906] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 14:56:28 2022] POST /identity/v3/users => generated 291 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 14:56:28.330155 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb855dc7-d8d4-417e-ab6c-b91fdd090c06 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:28.357382 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb855dc7-d8d4-417e-ab6c-b91fdd090c06 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:28.358060 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e658ca-a3ad-4609-9f2f-0d46a9c19d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:28.358323 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e658ca-a3ad-4609-9f2f-0d46a9c19d08 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:28.358602 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e658ca-a3ad-4609-9f2f-0d46a9c19d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:28.358875 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e658ca-a3ad-4609-9f2f-0d46a9c19d08 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:28.359525 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e658ca-a3ad-4609-9f2f-0d46a9c19d08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:28.361604 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e658ca-a3ad-4609-9f2f-0d46a9c19d08 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:28.372538 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 964/1907] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:56:28 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:56:28.379104 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a9f3e0-d36c-4405-b4af-669842330311 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:28.390635 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a9f3e0-d36c-4405-b4af-669842330311 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:28.396171 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d741932-086d-4063-bf5e-777972ab8e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:28.396810 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d741932-086d-4063-bf5e-777972ab8e78 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:28.397277 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d741932-086d-4063-bf5e-777972ab8e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:28.397737 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d741932-086d-4063-bf5e-777972ab8e78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:28.398492 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d741932-086d-4063-bf5e-777972ab8e78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:28.400133 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d741932-086d-4063-bf5e-777972ab8e78 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:28.411194 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 944/1908] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:56:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:56:28.415528 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e658ca-a3ad-4609-9f2f-0d46a9c19d08 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:28.426546 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e658ca-a3ad-4609-9f2f-0d46a9c19d08 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:28.432983 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df429a9c-5150-4c73-b8d8-236b7947d369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:28.433725 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df429a9c-5150-4c73-b8d8-236b7947d369 admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:28.434034 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df429a9c-5150-4c73-b8d8-236b7947d369 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:28.434316 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df429a9c-5150-4c73-b8d8-236b7947d369 admin admin] PATH_INFO: `/v3/projects/a35e3ce8318440db8336cad1d66a1a00/users/74b0aa536aff44b98bbfd48d0910d25b/roles/74de6794e3b3422b93d26f993d260c35` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:28.452094 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df429a9c-5150-4c73-b8d8-236b7947d369 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a35e3ce8318440db8336cad1d66a1a00, user_id=74b0aa536aff44b98bbfd48d0910d25b, role_id=74de6794e3b3422b93d26f993d260c35)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:28.455019 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df429a9c-5150-4c73-b8d8-236b7947d369 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:28.470587 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 965/1909] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 14:56:28 2022] PUT /identity/v3/projects/a35e3ce8318440db8336cad1d66a1a00/users/74b0aa536aff44b98bbfd48d0910d25b/roles/74de6794e3b3422b93d26f993d260c35 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:56:28.484948 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04befef-99ba-482c-9011-7fcaebb5c15a None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:28.485345 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04befef-99ba-482c-9011-7fcaebb5c15a None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:28.485603 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04befef-99ba-482c-9011-7fcaebb5c15a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:28.518447 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-c04befef-99ba-482c-9011-7fcaebb5c15a None None] MFA Rules not processed for user `74b0aa536aff44b98bbfd48d0910d25b`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:28.519706 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-c04befef-99ba-482c-9011-7fcaebb5c15a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:28.628378 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:28.641645 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 945/1910] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:56:28 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:56:28.647535 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df429a9c-5150-4c73-b8d8-236b7947d369 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:28.737171 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df429a9c-5150-4c73-b8d8-236b7947d369 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:28.743100 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3e860d-204d-4668-ac55-3678be372cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:28.743820 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e860d-204d-4668-ac55-3678be372cda admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:28.743986 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e860d-204d-4668-ac55-3678be372cda admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:28.744252 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e860d-204d-4668-ac55-3678be372cda admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:28.745031 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3e860d-204d-4668-ac55-3678be372cda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:28.746979 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3e860d-204d-4668-ac55-3678be372cda admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:28.779906 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 966/1911] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 14:56:28 2022] POST /identity/v3/projects => generated 379 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:56:28.784027 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04befef-99ba-482c-9011-7fcaebb5c15a None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:28.796250 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04befef-99ba-482c-9011-7fcaebb5c15a None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:28.857148 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273686b8-1ba8-488d-92db-1e13a8c385f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:28.857763 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273686b8-1ba8-488d-92db-1e13a8c385f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:28.858045 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273686b8-1ba8-488d-92db-1e13a8c385f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:28.858312 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273686b8-1ba8-488d-92db-1e13a8c385f4 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:28.858933 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273686b8-1ba8-488d-92db-1e13a8c385f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:28.860841 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273686b8-1ba8-488d-92db-1e13a8c385f4 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:28.885942 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 946/1912] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 14:56:28 2022] POST /identity/v3/users => generated 296 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:56:28.889712 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3e860d-204d-4668-ac55-3678be372cda admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:28.900615 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3e860d-204d-4668-ac55-3678be372cda admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:28.906693 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d944ec64-c54d-4a48-892a-629511cc27b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:28.907392 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d944ec64-c54d-4a48-892a-629511cc27b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:28.907822 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d944ec64-c54d-4a48-892a-629511cc27b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:28.908189 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d944ec64-c54d-4a48-892a-629511cc27b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:28.908933 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d944ec64-c54d-4a48-892a-629511cc27b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:28.910674 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d944ec64-c54d-4a48-892a-629511cc27b5 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:28.923053 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 967/1913] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:56:28 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:56:28.927421 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273686b8-1ba8-488d-92db-1e13a8c385f4 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:28.938553 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273686b8-1ba8-488d-92db-1e13a8c385f4 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:28.944903 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984a287e-6f7f-4bdd-a55d-285158ee5eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:28.945545 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984a287e-6f7f-4bdd-a55d-285158ee5eea admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:28.945825 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984a287e-6f7f-4bdd-a55d-285158ee5eea admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:28.946098 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984a287e-6f7f-4bdd-a55d-285158ee5eea admin admin] PATH_INFO: `/v3/projects/2bad2490a04b44338106616f1a02afeb/users/59f1e67012a74bb2bed4a74edb9b699f/roles/019bde1756cb40de8ce06cef6b261f79` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:28.964557 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984a287e-6f7f-4bdd-a55d-285158ee5eea admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bad2490a04b44338106616f1a02afeb, user_id=59f1e67012a74bb2bed4a74edb9b699f, role_id=019bde1756cb40de8ce06cef6b261f79)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:28.968305 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984a287e-6f7f-4bdd-a55d-285158ee5eea admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:28.994424 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 947/1914] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 14:56:28 2022] PUT /identity/v3/projects/2bad2490a04b44338106616f1a02afeb/users/59f1e67012a74bb2bed4a74edb9b699f/roles/019bde1756cb40de8ce06cef6b261f79 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:56:28.998911 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d944ec64-c54d-4a48-892a-629511cc27b5 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:29.009806 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d944ec64-c54d-4a48-892a-629511cc27b5 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:29.059745 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:29.080045 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edab360c-8335-423c-b0db-99634d95c847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:29.080666 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab360c-8335-423c-b0db-99634d95c847 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:29.081101 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab360c-8335-423c-b0db-99634d95c847 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:29.081374 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab360c-8335-423c-b0db-99634d95c847 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:29.082026 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edab360c-8335-423c-b0db-99634d95c847 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:29.083627 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edab360c-8335-423c-b0db-99634d95c847 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:29.102520 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 968/1915] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:56:28 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:56:29.103687 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984a287e-6f7f-4bdd-a55d-285158ee5eea admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:29.114364 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984a287e-6f7f-4bdd-a55d-285158ee5eea admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:29.119827 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdff7cfd-994a-4b01-a6b0-80cc904bd820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:29.120488 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff7cfd-994a-4b01-a6b0-80cc904bd820 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:29.120761 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff7cfd-994a-4b01-a6b0-80cc904bd820 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:29.121193 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff7cfd-994a-4b01-a6b0-80cc904bd820 admin admin] PATH_INFO: `/v3/projects/2bad2490a04b44338106616f1a02afeb/users/59f1e67012a74bb2bed4a74edb9b699f/roles/019bde1756cb40de8ce06cef6b261f79` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:29.123271 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdff7cfd-994a-4b01-a6b0-80cc904bd820 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bad2490a04b44338106616f1a02afeb, user_id=59f1e67012a74bb2bed4a74edb9b699f, role_id=019bde1756cb40de8ce06cef6b261f79)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:29.125925 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdff7cfd-994a-4b01-a6b0-80cc904bd820 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:29.140429 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 948/1916] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 14:56:29 2022] PUT /identity/v3/projects/2bad2490a04b44338106616f1a02afeb/users/59f1e67012a74bb2bed4a74edb9b699f/roles/019bde1756cb40de8ce06cef6b261f79 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:56:29.151540 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff602b06-34f9-4d33-a4d6-7e9c26df1e81 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:29.151827 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff602b06-34f9-4d33-a4d6-7e9c26df1e81 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:29.152101 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff602b06-34f9-4d33-a4d6-7e9c26df1e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:29.185968 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-ff602b06-34f9-4d33-a4d6-7e9c26df1e81 None None] MFA Rules not processed for user `59f1e67012a74bb2bed4a74edb9b699f`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:29.187198 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-ff602b06-34f9-4d33-a4d6-7e9c26df1e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:29.272605 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 969/1917] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:56:29 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 14:56:29.284531 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdff7cfd-994a-4b01-a6b0-80cc904bd820 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:29.341072 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdff7cfd-994a-4b01-a6b0-80cc904bd820 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:29.345454 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2a8b65-e410-4218-85c3-255b7cc529c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df648c909ddb41418128b43f925f5ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:29.346072 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a8b65-e410-4218-85c3-255b7cc529c7 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:29.346350 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a8b65-e410-4218-85c3-255b7cc529c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:29.346618 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a8b65-e410-4218-85c3-255b7cc529c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:29.358251 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2a8b65-e410-4218-85c3-255b7cc529c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:29.359691 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2a8b65-e410-4218-85c3-255b7cc529c7 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:29.371451 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 949/1918] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:56:29 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:56:29.464573 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff602b06-34f9-4d33-a4d6-7e9c26df1e81 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:29.474604 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff602b06-34f9-4d33-a4d6-7e9c26df1e81 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:29.478949 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdaca95-91b4-4dd6-95f9-dc2191622f94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df648c909ddb41418128b43f925f5ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:29.479731 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdaca95-91b4-4dd6-95f9-dc2191622f94 service cinder] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:29.480024 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdaca95-91b4-4dd6-95f9-dc2191622f94 service cinder] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:29.480420 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdaca95-91b4-4dd6-95f9-dc2191622f94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:29.541808 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdaca95-91b4-4dd6-95f9-dc2191622f94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:29.543168 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdaca95-91b4-4dd6-95f9-dc2191622f94 service cinder] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:29.553446 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 970/1919] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:56:29 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:56:32.735823 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2a8b65-e410-4218-85c3-255b7cc529c7 service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:32.737978 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-6c2a8b65-e410-4218-85c3-255b7cc529c7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:32.751548 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2a8b65-e410-4218-85c3-255b7cc529c7 service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:32.756150 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7385da-9648-4b1c-8943-5cb9b46f3ff4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df648c909ddb41418128b43f925f5ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:32.757753 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7385da-9648-4b1c-8943-5cb9b46f3ff4 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:32.758195 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7385da-9648-4b1c-8943-5cb9b46f3ff4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:32.758828 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7385da-9648-4b1c-8943-5cb9b46f3ff4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:32.833293 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:32.834898 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7385da-9648-4b1c-8943-5cb9b46f3ff4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:32.836678 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7385da-9648-4b1c-8943-5cb9b46f3ff4 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:32.857158 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 950/1920] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:56:32 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:56:37.006573 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdaca95-91b4-4dd6-95f9-dc2191622f94 service cinder] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:37.082061 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdaca95-91b4-4dd6-95f9-dc2191622f94 service cinder] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:37.088937 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2625b5-bca2-4bb1-accb-14e5d18c1bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:37.088937 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2625b5-bca2-4bb1-accb-14e5d18c1bfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:37.089263 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2625b5-bca2-4bb1-accb-14e5d18c1bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:37.089461 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2625b5-bca2-4bb1-accb-14e5d18c1bfc admin admin] PATH_INFO: `/v3/users/74b0aa536aff44b98bbfd48d0910d25b` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:37.090702 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2625b5-bca2-4bb1-accb-14e5d18c1bfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=74b0aa536aff44b98bbfd48d0910d25b)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:37.092702 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2625b5-bca2-4bb1-accb-14e5d18c1bfc admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:37.095544 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:37.148221 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-bf2625b5-bca2-4bb1-accb-14e5d18c1bfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74b0aa536aff44b98bbfd48d0910d25b'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:37.158778 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-bf2625b5-bca2-4bb1-accb-14e5d18c1bfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74b0aa536aff44b98bbfd48d0910d25b'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:37.159390 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-bf2625b5-bca2-4bb1-accb-14e5d18c1bfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74b0aa536aff44b98bbfd48d0910d25b'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:37.159999 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-bf2625b5-bca2-4bb1-accb-14e5d18c1bfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74b0aa536aff44b98bbfd48d0910d25b'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:37.173425 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-bf2625b5-bca2-4bb1-accb-14e5d18c1bfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74b0aa536aff44b98bbfd48d0910d25b'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:37.186595 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 971/1921] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 14:56:37 2022] DELETE /identity/v3/users/74b0aa536aff44b98bbfd48d0910d25b => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:56:37.191291 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c44fe-d6b6-4927-b5f3-9e6f52760006 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:37.191776 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c44fe-d6b6-4927-b5f3-9e6f52760006 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:37.191860 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c44fe-d6b6-4927-b5f3-9e6f52760006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:37.213544 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-bd7c44fe-d6b6-4927-b5f3-9e6f52760006 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:37.214867 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-bd7c44fe-d6b6-4927-b5f3-9e6f52760006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:37.279827 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 951/1922] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:56:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 14:56:37.290099 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2625b5-bca2-4bb1-accb-14e5d18c1bfc admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:37.291728 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-bf2625b5-bca2-4bb1-accb-14e5d18c1bfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:37.362461 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2625b5-bca2-4bb1-accb-14e5d18c1bfc admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:37.366316 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484921ea-66f1-4273-a6d8-3486e97a23f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:37.367047 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484921ea-66f1-4273-a6d8-3486e97a23f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:37.367395 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484921ea-66f1-4273-a6d8-3486e97a23f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:37.367782 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484921ea-66f1-4273-a6d8-3486e97a23f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:37.380839 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484921ea-66f1-4273-a6d8-3486e97a23f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:37.382364 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484921ea-66f1-4273-a6d8-3486e97a23f8 service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:37.393528 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 972/1923] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:56:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:56:37.783027 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7c44fe-d6b6-4927-b5f3-9e6f52760006 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:37.785035 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-bd7c44fe-d6b6-4927-b5f3-9e6f52760006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:37.805868 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7c44fe-d6b6-4927-b5f3-9e6f52760006 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:37.811464 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f641de05-c315-4990-b093-c283ae4c3128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:37.812258 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641de05-c315-4990-b093-c283ae4c3128 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:37.812539 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641de05-c315-4990-b093-c283ae4c3128 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:37.812802 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641de05-c315-4990-b093-c283ae4c3128 admin admin] PATH_INFO: `/v3/projects/a35e3ce8318440db8336cad1d66a1a00` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:37.814199 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f641de05-c315-4990-b093-c283ae4c3128 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a35e3ce8318440db8336cad1d66a1a00)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:37.816130 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f641de05-c315-4990-b093-c283ae4c3128 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:37.861617 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484921ea-66f1-4273-a6d8-3486e97a23f8 service neutron] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:37.863004 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-484921ea-66f1-4273-a6d8-3486e97a23f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:37.873539 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f641de05-c315-4990-b093-c283ae4c3128 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a35e3ce8318440db8336cad1d66a1a00', 'request_id': 'req-f641de05-c315-4990-b093-c283ae4c3128'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:37.880190 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f641de05-c315-4990-b093-c283ae4c3128 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a35e3ce8318440db8336cad1d66a1a00', 'request_id': 'req-f641de05-c315-4990-b093-c283ae4c3128'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:37.881702 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484921ea-66f1-4273-a6d8-3486e97a23f8 service neutron] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:37.889673 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f641de05-c315-4990-b093-c283ae4c3128 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a35e3ce8318440db8336cad1d66a1a00', 'request_id': 'req-f641de05-c315-4990-b093-c283ae4c3128'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:37.901633 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f641de05-c315-4990-b093-c283ae4c3128 admin admin] The token cache is being invalidate because project a35e3ce8318440db8336cad1d66a1a00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:56:37.901917 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f641de05-c315-4990-b093-c283ae4c3128 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:37.902546 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f641de05-c315-4990-b093-c283ae4c3128 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:37.904140 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 952/1924] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 14:56:37 2022] DELETE /identity/v3/projects/a35e3ce8318440db8336cad1d66a1a00 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:56:37.908529 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f641de05-c315-4990-b093-c283ae4c3128 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:37.910424 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f641de05-c315-4990-b093-c283ae4c3128 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:37.957194 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3d0e0f-e344-4101-bbfb-229ee0387306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:37.957841 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3d0e0f-e344-4101-bbfb-229ee0387306 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:37.958117 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3d0e0f-e344-4101-bbfb-229ee0387306 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:37.958387 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3d0e0f-e344-4101-bbfb-229ee0387306 admin admin] PATH_INFO: `/v3/users/27f96d74ed034b76b79f2c0b0ad1d58a` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:37.959839 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3d0e0f-e344-4101-bbfb-229ee0387306 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27f96d74ed034b76b79f2c0b0ad1d58a)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:37.962462 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3d0e0f-e344-4101-bbfb-229ee0387306 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:38.002227 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f641de05-c315-4990-b093-c283ae4c3128 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:38.009544 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:38.010727 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc823593-3c6d-4670-9b9b-5650133dad68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:38.011553 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc823593-3c6d-4670-9b9b-5650133dad68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:38.011857 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc823593-3c6d-4670-9b9b-5650133dad68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:38.012338 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc823593-3c6d-4670-9b9b-5650133dad68 admin admin] PATH_INFO: `/v3/users/59f1e67012a74bb2bed4a74edb9b699f` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:38.013658 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc823593-3c6d-4670-9b9b-5650133dad68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59f1e67012a74bb2bed4a74edb9b699f)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:38.015832 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc823593-3c6d-4670-9b9b-5650133dad68 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:38.034379 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:38.043348 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-ed3d0e0f-e344-4101-bbfb-229ee0387306 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27f96d74ed034b76b79f2c0b0ad1d58a'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:38.055825 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-ed3d0e0f-e344-4101-bbfb-229ee0387306 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27f96d74ed034b76b79f2c0b0ad1d58a'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:38.056719 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-ed3d0e0f-e344-4101-bbfb-229ee0387306 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27f96d74ed034b76b79f2c0b0ad1d58a'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:38.057567 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-ed3d0e0f-e344-4101-bbfb-229ee0387306 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27f96d74ed034b76b79f2c0b0ad1d58a'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:38.077162 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-ed3d0e0f-e344-4101-bbfb-229ee0387306 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27f96d74ed034b76b79f2c0b0ad1d58a'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:38.080263 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-fc823593-3c6d-4670-9b9b-5650133dad68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59f1e67012a74bb2bed4a74edb9b699f'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:38.090374 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-fc823593-3c6d-4670-9b9b-5650133dad68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59f1e67012a74bb2bed4a74edb9b699f'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:38.091256 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-fc823593-3c6d-4670-9b9b-5650133dad68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59f1e67012a74bb2bed4a74edb9b699f'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:38.092230 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-fc823593-3c6d-4670-9b9b-5650133dad68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59f1e67012a74bb2bed4a74edb9b699f'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:38.099443 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 973/1925] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 14:56:37 2022] DELETE /identity/v3/users/27f96d74ed034b76b79f2c0b0ad1d58a => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 14:56:38.110280 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-fc823593-3c6d-4670-9b9b-5650133dad68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59f1e67012a74bb2bed4a74edb9b699f'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:38.110668 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36bd5e7-4173-47a7-9385-ad3718e0a41e None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:38.110979 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36bd5e7-4173-47a7-9385-ad3718e0a41e None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:38.111258 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36bd5e7-4173-47a7-9385-ad3718e0a41e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:38.132380 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 953/1926] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 14:56:37 2022] DELETE /identity/v3/users/59f1e67012a74bb2bed4a74edb9b699f => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:56:38.143111 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-c36bd5e7-4173-47a7-9385-ad3718e0a41e None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:38.144924 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-c36bd5e7-4173-47a7-9385-ad3718e0a41e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:38.235125 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 974/1927] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:56:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 14:56:38.250552 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc823593-3c6d-4670-9b9b-5650133dad68 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:38.252029 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-fc823593-3c6d-4670-9b9b-5650133dad68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:38.326418 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc823593-3c6d-4670-9b9b-5650133dad68 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:38.331622 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb04da4-b3a9-4a90-90e8-8f946941889e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:38.332704 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb04da4-b3a9-4a90-90e8-8f946941889e service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:38.333032 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb04da4-b3a9-4a90-90e8-8f946941889e service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:38.334039 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb04da4-b3a9-4a90-90e8-8f946941889e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:38.349233 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb04da4-b3a9-4a90-90e8-8f946941889e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:38.350975 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb04da4-b3a9-4a90-90e8-8f946941889e service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:38.365570 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 954/1928] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:56:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:56:38.921324 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36bd5e7-4173-47a7-9385-ad3718e0a41e None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:38.922908 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-c36bd5e7-4173-47a7-9385-ad3718e0a41e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:38.943549 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36bd5e7-4173-47a7-9385-ad3718e0a41e None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:38.974544 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdd83ec-26fe-442a-8000-2314f72a070a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:38.976356 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd83ec-26fe-442a-8000-2314f72a070a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:38.980620 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd83ec-26fe-442a-8000-2314f72a070a admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:38.981910 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd83ec-26fe-442a-8000-2314f72a070a admin admin] PATH_INFO: `/v3/projects/2bad2490a04b44338106616f1a02afeb` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:38.987512 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdd83ec-26fe-442a-8000-2314f72a070a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bad2490a04b44338106616f1a02afeb)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:38.991699 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdd83ec-26fe-442a-8000-2314f72a070a admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:39.104050 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-1cdd83ec-26fe-442a-8000-2314f72a070a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bad2490a04b44338106616f1a02afeb', 'request_id': 'req-1cdd83ec-26fe-442a-8000-2314f72a070a'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:39.114588 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-1cdd83ec-26fe-442a-8000-2314f72a070a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bad2490a04b44338106616f1a02afeb', 'request_id': 'req-1cdd83ec-26fe-442a-8000-2314f72a070a'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:39.125391 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-1cdd83ec-26fe-442a-8000-2314f72a070a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bad2490a04b44338106616f1a02afeb', 'request_id': 'req-1cdd83ec-26fe-442a-8000-2314f72a070a'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:39.151814 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-1cdd83ec-26fe-442a-8000-2314f72a070a admin admin] The token cache is being invalidate because project 2bad2490a04b44338106616f1a02afeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:56:39.152437 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-1cdd83ec-26fe-442a-8000-2314f72a070a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:39.154337 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-1cdd83ec-26fe-442a-8000-2314f72a070a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:39.156449 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 975/1929] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 14:56:38 2022] DELETE /identity/v3/projects/2bad2490a04b44338106616f1a02afeb => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:56:39.161330 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588cb814-dfb9-449c-9a47-0ab25dae9d1a None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:39.162185 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588cb814-dfb9-449c-9a47-0ab25dae9d1a None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:39.162185 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588cb814-dfb9-449c-9a47-0ab25dae9d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:39.183313 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-588cb814-dfb9-449c-9a47-0ab25dae9d1a None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:39.184433 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-588cb814-dfb9-449c-9a47-0ab25dae9d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:39.237255 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdd83ec-26fe-442a-8000-2314f72a070a admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:39.238549 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-1cdd83ec-26fe-442a-8000-2314f72a070a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:39.303741 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 955/1930] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:56:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:56:39.306656 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26feb26-4410-4713-947e-9a563df94076 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:39.307080 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26feb26-4410-4713-947e-9a563df94076 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:39.307350 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26feb26-4410-4713-947e-9a563df94076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:39.320636 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:39.335144 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-e26feb26-4410-4713-947e-9a563df94076 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:39.346470 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e26feb26-4410-4713-947e-9a563df94076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:39.369153 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 956/1931] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:56:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 14:56:39.374099 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26feb26-4410-4713-947e-9a563df94076 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:39.376797 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdd83ec-26fe-442a-8000-2314f72a070a admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:39.384337 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05126306-fb20-4282-8dfa-abf209c720e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:39.385054 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05126306-fb20-4282-8dfa-abf209c720e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:39.385398 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05126306-fb20-4282-8dfa-abf209c720e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:39.385679 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05126306-fb20-4282-8dfa-abf209c720e7 admin admin] PATH_INFO: `/v3/projects/82257693594c42fd9d6369f1db57bd14` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:39.386537 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26feb26-4410-4713-947e-9a563df94076 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:39.386862 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05126306-fb20-4282-8dfa-abf209c720e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82257693594c42fd9d6369f1db57bd14)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:39.388807 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05126306-fb20-4282-8dfa-abf209c720e7 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:39.393536 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8373f1c3-f1e6-42ee-965e-d134edebd7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:39.394279 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8373f1c3-f1e6-42ee-965e-d134edebd7da admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:39.394646 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8373f1c3-f1e6-42ee-965e-d134edebd7da admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:39.395004 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8373f1c3-f1e6-42ee-965e-d134edebd7da admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:39.396634 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8373f1c3-f1e6-42ee-965e-d134edebd7da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:56:39.397060 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8373f1c3-f1e6-42ee-965e-d134edebd7da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:39.399065 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8373f1c3-f1e6-42ee-965e-d134edebd7da admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:39.419250 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 957/1932] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 19 14:56:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:56:39.420888 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8373f1c3-f1e6-42ee-965e-d134edebd7da admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:39.440609 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8373f1c3-f1e6-42ee-965e-d134edebd7da admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:39.455618 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-05126306-fb20-4282-8dfa-abf209c720e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82257693594c42fd9d6369f1db57bd14', 'request_id': 'req-05126306-fb20-4282-8dfa-abf209c720e7'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:39.456160 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:39.481586 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-05126306-fb20-4282-8dfa-abf209c720e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82257693594c42fd9d6369f1db57bd14', 'request_id': 'req-05126306-fb20-4282-8dfa-abf209c720e7'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:39.494412 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-05126306-fb20-4282-8dfa-abf209c720e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82257693594c42fd9d6369f1db57bd14', 'request_id': 'req-05126306-fb20-4282-8dfa-abf209c720e7'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:39.526287 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-05126306-fb20-4282-8dfa-abf209c720e7 admin admin] The token cache is being invalidate because project 82257693594c42fd9d6369f1db57bd14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:56:39.526287 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-05126306-fb20-4282-8dfa-abf209c720e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:39.526287 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-05126306-fb20-4282-8dfa-abf209c720e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:39.526287 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 976/1933] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 14:56:39 2022] DELETE /identity/v3/projects/82257693594c42fd9d6369f1db57bd14 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 14:56:39.526287 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05126306-fb20-4282-8dfa-abf209c720e7 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:39.526911 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-05126306-fb20-4282-8dfa-abf209c720e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:39.559023 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83420c79-6f2f-4300-8ed4-218d2ab2a022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:39.560287 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83420c79-6f2f-4300-8ed4-218d2ab2a022 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:39.560566 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83420c79-6f2f-4300-8ed4-218d2ab2a022 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:39.560899 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83420c79-6f2f-4300-8ed4-218d2ab2a022 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:39.561720 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83420c79-6f2f-4300-8ed4-218d2ab2a022 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:39.564466 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83420c79-6f2f-4300-8ed4-218d2ab2a022 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:39.610421 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 958/1934] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 14:56:39 2022] POST /identity/v3/projects => generated 365 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:56:39.614696 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83420c79-6f2f-4300-8ed4-218d2ab2a022 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:39.617961 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-83420c79-6f2f-4300-8ed4-218d2ab2a022 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:39.620122 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05126306-fb20-4282-8dfa-abf209c720e7 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:39.712046 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83420c79-6f2f-4300-8ed4-218d2ab2a022 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:39.715162 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac7ad1-e633-40c2-b891-3d0dde920e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:39.715889 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac7ad1-e633-40c2-b891-3d0dde920e44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:39.716176 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac7ad1-e633-40c2-b891-3d0dde920e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:39.716447 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac7ad1-e633-40c2-b891-3d0dde920e44 admin admin] PATH_INFO: `/v3/users/dffa29edfaee4108ab57394cc1c07c77` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:39.717693 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ac7ad1-e633-40c2-b891-3d0dde920e44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dffa29edfaee4108ab57394cc1c07c77)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:39.719858 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ac7ad1-e633-40c2-b891-3d0dde920e44 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:39.722344 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f07450-9a52-4225-bbdb-789bb562b7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:39.723524 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f07450-9a52-4225-bbdb-789bb562b7ff admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:39.724500 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f07450-9a52-4225-bbdb-789bb562b7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:39.724500 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f07450-9a52-4225-bbdb-789bb562b7ff admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:39.725889 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f07450-9a52-4225-bbdb-789bb562b7ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:39.729273 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:39.733886 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f07450-9a52-4225-bbdb-789bb562b7ff admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:39.783622 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 959/1935] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 14:56:39 2022] POST /identity/v3/users => generated 283 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 14:56:39.788497 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f07450-9a52-4225-bbdb-789bb562b7ff admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:39.804009 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-12ac7ad1-e633-40c2-b891-3d0dde920e44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dffa29edfaee4108ab57394cc1c07c77'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:39.804662 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f07450-9a52-4225-bbdb-789bb562b7ff admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:39.813939 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbd7af1-dd9c-40b7-ad89-2741845e7b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:39.814750 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd7af1-dd9c-40b7-ad89-2741845e7b68 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:39.815028 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd7af1-dd9c-40b7-ad89-2741845e7b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:39.815345 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd7af1-dd9c-40b7-ad89-2741845e7b68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:39.817321 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbd7af1-dd9c-40b7-ad89-2741845e7b68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:39.828402 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbd7af1-dd9c-40b7-ad89-2741845e7b68 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:39.830841 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-12ac7ad1-e633-40c2-b891-3d0dde920e44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dffa29edfaee4108ab57394cc1c07c77'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:39.834220 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-12ac7ad1-e633-40c2-b891-3d0dde920e44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dffa29edfaee4108ab57394cc1c07c77'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:39.835292 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-12ac7ad1-e633-40c2-b891-3d0dde920e44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dffa29edfaee4108ab57394cc1c07c77'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:39.846744 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 960/1936] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:56:39 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:56:39.855578 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-12ac7ad1-e633-40c2-b891-3d0dde920e44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dffa29edfaee4108ab57394cc1c07c77'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:39.856413 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbd7af1-dd9c-40b7-ad89-2741845e7b68 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:39.858326 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-cbbd7af1-dd9c-40b7-ad89-2741845e7b68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:39.872539 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 977/1937] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 14:56:39 2022] DELETE /identity/v3/users/dffa29edfaee4108ab57394cc1c07c77 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 14:56:39.874698 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbd7af1-dd9c-40b7-ad89-2741845e7b68 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:39.940399 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b54b33e-a31f-4648-9fa1-30a610fe8271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:39.941212 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b54b33e-a31f-4648-9fa1-30a610fe8271 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:39.941529 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b54b33e-a31f-4648-9fa1-30a610fe8271 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:39.941886 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b54b33e-a31f-4648-9fa1-30a610fe8271 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:39.942591 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b54b33e-a31f-4648-9fa1-30a610fe8271 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:39.944281 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b54b33e-a31f-4648-9fa1-30a610fe8271 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:39.957524 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 961/1938] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:56:39 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:56:39.962559 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac7ad1-e633-40c2-b891-3d0dde920e44 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:39.973866 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac7ad1-e633-40c2-b891-3d0dde920e44 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:39.980683 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c08516-0a64-43f7-9d02-454c52f0cd76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:39.981377 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c08516-0a64-43f7-9d02-454c52f0cd76 admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:39.981667 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c08516-0a64-43f7-9d02-454c52f0cd76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:39.982080 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c08516-0a64-43f7-9d02-454c52f0cd76 admin admin] PATH_INFO: `/v3/projects/87656a8d83534640ab95baaad87b33af/users/26a953c1ab5c4c26af304b325f489928/roles/74de6794e3b3422b93d26f993d260c35` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:40.009210 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c08516-0a64-43f7-9d02-454c52f0cd76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87656a8d83534640ab95baaad87b33af, user_id=26a953c1ab5c4c26af304b325f489928, role_id=74de6794e3b3422b93d26f993d260c35)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:40.011976 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c08516-0a64-43f7-9d02-454c52f0cd76 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:40.027290 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 978/1939] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 14:56:39 2022] PUT /identity/v3/projects/87656a8d83534640ab95baaad87b33af/users/26a953c1ab5c4c26af304b325f489928/roles/74de6794e3b3422b93d26f993d260c35 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:56:40.038167 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a174e3-9cc9-4221-91d9-6f45b6831d3e None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:40.038449 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a174e3-9cc9-4221-91d9-6f45b6831d3e None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:40.039021 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a174e3-9cc9-4221-91d9-6f45b6831d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:40.069495 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:40.073511 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-76a174e3-9cc9-4221-91d9-6f45b6831d3e None None] MFA Rules not processed for user `26a953c1ab5c4c26af304b325f489928`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:40.075465 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-76a174e3-9cc9-4221-91d9-6f45b6831d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:40.152759 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 962/1940] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:56:40 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:56:40.158561 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c08516-0a64-43f7-9d02-454c52f0cd76 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:40.259302 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c08516-0a64-43f7-9d02-454c52f0cd76 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:40.267820 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e2f97b-39ea-48de-9b6c-2d54128d985d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:40.268551 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e2f97b-39ea-48de-9b6c-2d54128d985d admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:40.274466 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e2f97b-39ea-48de-9b6c-2d54128d985d admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:40.274755 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e2f97b-39ea-48de-9b6c-2d54128d985d admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:40.275449 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e2f97b-39ea-48de-9b6c-2d54128d985d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:40.277564 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e2f97b-39ea-48de-9b6c-2d54128d985d admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:40.339636 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 979/1941] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 14:56:40 2022] POST /identity/v3/projects => generated 365 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:56:40.343554 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a174e3-9cc9-4221-91d9-6f45b6831d3e None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:40.363090 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a174e3-9cc9-4221-91d9-6f45b6831d3e None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:40.455822 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea56c89b-7236-44a3-aaac-afa13464ae4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:40.456879 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea56c89b-7236-44a3-aaac-afa13464ae4c admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:40.457401 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea56c89b-7236-44a3-aaac-afa13464ae4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:40.457873 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea56c89b-7236-44a3-aaac-afa13464ae4c admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:40.459046 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea56c89b-7236-44a3-aaac-afa13464ae4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:40.462207 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea56c89b-7236-44a3-aaac-afa13464ae4c admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:40.513872 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 963/1942] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 14:56:40 2022] POST /identity/v3/users => generated 289 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:56:40.518251 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e2f97b-39ea-48de-9b6c-2d54128d985d admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:40.530951 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e2f97b-39ea-48de-9b6c-2d54128d985d admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:40.537477 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17365117-ed03-488b-8cba-ecd46695678d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:40.538215 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17365117-ed03-488b-8cba-ecd46695678d admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:40.539876 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17365117-ed03-488b-8cba-ecd46695678d admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:40.540366 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17365117-ed03-488b-8cba-ecd46695678d admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:40.541499 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17365117-ed03-488b-8cba-ecd46695678d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:40.543962 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17365117-ed03-488b-8cba-ecd46695678d admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:40.561236 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 980/1943] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:56:40 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:56:40.565532 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea56c89b-7236-44a3-aaac-afa13464ae4c admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:40.577020 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea56c89b-7236-44a3-aaac-afa13464ae4c admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:40.581954 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bec88d1-94f8-4083-bef5-0967bce44f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:40.582622 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bec88d1-94f8-4083-bef5-0967bce44f8c admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:40.582999 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bec88d1-94f8-4083-bef5-0967bce44f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:40.583272 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bec88d1-94f8-4083-bef5-0967bce44f8c admin admin] PATH_INFO: `/v3/projects/4eeaad0b7aa54055998de3ba8d0119f8/users/c132315a32794f34b413640977433405/roles/019bde1756cb40de8ce06cef6b261f79` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:40.605532 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bec88d1-94f8-4083-bef5-0967bce44f8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4eeaad0b7aa54055998de3ba8d0119f8, user_id=c132315a32794f34b413640977433405, role_id=019bde1756cb40de8ce06cef6b261f79)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:40.608682 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bec88d1-94f8-4083-bef5-0967bce44f8c admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:40.631135 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 964/1944] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 14:56:40 2022] PUT /identity/v3/projects/4eeaad0b7aa54055998de3ba8d0119f8/users/c132315a32794f34b413640977433405/roles/019bde1756cb40de8ce06cef6b261f79 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:56:40.635809 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17365117-ed03-488b-8cba-ecd46695678d admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:40.654359 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17365117-ed03-488b-8cba-ecd46695678d admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:40.718020 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:40.777392 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae4ad24-c94f-4857-82f2-9101a75490c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:40.778120 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae4ad24-c94f-4857-82f2-9101a75490c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:40.778671 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae4ad24-c94f-4857-82f2-9101a75490c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:40.778976 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae4ad24-c94f-4857-82f2-9101a75490c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:40.782116 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae4ad24-c94f-4857-82f2-9101a75490c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:40.794166 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae4ad24-c94f-4857-82f2-9101a75490c1 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:40.806994 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 981/1945] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:56:40 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 14:56:40.811580 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bec88d1-94f8-4083-bef5-0967bce44f8c admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:40.827672 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bec88d1-94f8-4083-bef5-0967bce44f8c admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:40.837538 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaab65b-b9d3-493e-987b-0a990d38e91f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:40.838242 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaab65b-b9d3-493e-987b-0a990d38e91f admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:40.838519 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaab65b-b9d3-493e-987b-0a990d38e91f admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:40.838788 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaab65b-b9d3-493e-987b-0a990d38e91f admin admin] PATH_INFO: `/v3/projects/4eeaad0b7aa54055998de3ba8d0119f8/users/c132315a32794f34b413640977433405/roles/019bde1756cb40de8ce06cef6b261f79` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:40.843140 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaab65b-b9d3-493e-987b-0a990d38e91f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4eeaad0b7aa54055998de3ba8d0119f8, user_id=c132315a32794f34b413640977433405, role_id=019bde1756cb40de8ce06cef6b261f79)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:40.848872 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaab65b-b9d3-493e-987b-0a990d38e91f admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:40.888661 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 965/1946] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 14:56:40 2022] PUT /identity/v3/projects/4eeaad0b7aa54055998de3ba8d0119f8/users/c132315a32794f34b413640977433405/roles/019bde1756cb40de8ce06cef6b261f79 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:56:40.890660 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1103e4a8-7e95-4f67-b02e-909be3c68bf6 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:40.891122 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1103e4a8-7e95-4f67-b02e-909be3c68bf6 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:40.891405 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1103e4a8-7e95-4f67-b02e-909be3c68bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:40.935292 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-1103e4a8-7e95-4f67-b02e-909be3c68bf6 None None] MFA Rules not processed for user `c132315a32794f34b413640977433405`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:40.936682 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-1103e4a8-7e95-4f67-b02e-909be3c68bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:41.050049 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 982/1947] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:56:40 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:56:41.065104 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaab65b-b9d3-493e-987b-0a990d38e91f admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:41.067027 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-dfaab65b-b9d3-493e-987b-0a990d38e91f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:41.168161 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaab65b-b9d3-493e-987b-0a990d38e91f admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:41.173527 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1253a9ca-153a-4829-9d98-734e142a66af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df648c909ddb41418128b43f925f5ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:41.175412 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1253a9ca-153a-4829-9d98-734e142a66af service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:41.175734 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1253a9ca-153a-4829-9d98-734e142a66af service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:41.176016 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1253a9ca-153a-4829-9d98-734e142a66af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:41.191494 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1253a9ca-153a-4829-9d98-734e142a66af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:41.193244 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1253a9ca-153a-4829-9d98-734e142a66af service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:41.198124 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:41.213085 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 966/1948] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:56:41 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:56:41.294267 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1103e4a8-7e95-4f67-b02e-909be3c68bf6 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:41.306434 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1103e4a8-7e95-4f67-b02e-909be3c68bf6 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:41.311916 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c353e3-eb96-432c-b807-96b77e83086a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df648c909ddb41418128b43f925f5ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:41.312543 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c353e3-eb96-432c-b807-96b77e83086a service cinder] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:41.312867 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c353e3-eb96-432c-b807-96b77e83086a service cinder] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:41.313191 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c353e3-eb96-432c-b807-96b77e83086a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:41.379229 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c353e3-eb96-432c-b807-96b77e83086a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:41.380733 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c353e3-eb96-432c-b807-96b77e83086a service cinder] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:41.391016 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 983/1949] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:56:41 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 14:56:41.600697 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1253a9ca-153a-4829-9d98-734e142a66af service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:41.604281 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-1253a9ca-153a-4829-9d98-734e142a66af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:41.717492 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1253a9ca-153a-4829-9d98-734e142a66af service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:41.722782 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb95f80c-c4ad-42f9-91fc-5e0feb948387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:41.723428 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb95f80c-c4ad-42f9-91fc-5e0feb948387 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:41.724155 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb95f80c-c4ad-42f9-91fc-5e0feb948387 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:41.724155 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb95f80c-c4ad-42f9-91fc-5e0feb948387 admin admin] PATH_INFO: `/v3/projects/13cb5e8ea48a4e84bb921145aaa4dbc1` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:41.725238 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb95f80c-c4ad-42f9-91fc-5e0feb948387 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13cb5e8ea48a4e84bb921145aaa4dbc1)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:41.728826 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb95f80c-c4ad-42f9-91fc-5e0feb948387 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:41.798168 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-cb95f80c-c4ad-42f9-91fc-5e0feb948387 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13cb5e8ea48a4e84bb921145aaa4dbc1', 'request_id': 'req-cb95f80c-c4ad-42f9-91fc-5e0feb948387'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:41.810954 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-cb95f80c-c4ad-42f9-91fc-5e0feb948387 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13cb5e8ea48a4e84bb921145aaa4dbc1', 'request_id': 'req-cb95f80c-c4ad-42f9-91fc-5e0feb948387'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:41.834926 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-cb95f80c-c4ad-42f9-91fc-5e0feb948387 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13cb5e8ea48a4e84bb921145aaa4dbc1', 'request_id': 'req-cb95f80c-c4ad-42f9-91fc-5e0feb948387'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:41.862517 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-cb95f80c-c4ad-42f9-91fc-5e0feb948387 admin admin] The token cache is being invalidate because project 13cb5e8ea48a4e84bb921145aaa4dbc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:56:41.862858 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-cb95f80c-c4ad-42f9-91fc-5e0feb948387 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:41.863836 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-cb95f80c-c4ad-42f9-91fc-5e0feb948387 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:41.866985 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 967/1950] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 14:56:41 2022] DELETE /identity/v3/projects/13cb5e8ea48a4e84bb921145aaa4dbc1 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:56:41.873193 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab7ab4f-aa04-41ac-bc8e-ae99ed2823ed None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:41.873695 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab7ab4f-aa04-41ac-bc8e-ae99ed2823ed None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:41.874157 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab7ab4f-aa04-41ac-bc8e-ae99ed2823ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:41.924347 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-2ab7ab4f-aa04-41ac-bc8e-ae99ed2823ed None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:41.926291 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-2ab7ab4f-aa04-41ac-bc8e-ae99ed2823ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:42.019180 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:42.046778 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 984/1951] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:56:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:56:42.050812 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e88b41-2ba9-4cdf-aaef-d582d10f40d3 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:42.053368 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e88b41-2ba9-4cdf-aaef-d582d10f40d3 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:42.053831 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e88b41-2ba9-4cdf-aaef-d582d10f40d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:42.137191 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-02e88b41-2ba9-4cdf-aaef-d582d10f40d3 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:42.139688 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-02e88b41-2ba9-4cdf-aaef-d582d10f40d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:42.169679 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 968/1952] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:56:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:56:42.173936 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab7ab4f-aa04-41ac-bc8e-ae99ed2823ed None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:42.197128 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab7ab4f-aa04-41ac-bc8e-ae99ed2823ed None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:42.212796 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca5b175-291e-4060-a89e-a52efa8f8723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:42.213800 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca5b175-291e-4060-a89e-a52efa8f8723 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:42.214075 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca5b175-291e-4060-a89e-a52efa8f8723 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:42.214394 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca5b175-291e-4060-a89e-a52efa8f8723 admin admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:42.215047 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca5b175-291e-4060-a89e-a52efa8f8723 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:56:42.215363 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca5b175-291e-4060-a89e-a52efa8f8723 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:42.218714 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca5b175-291e-4060-a89e-a52efa8f8723 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:42.254459 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 985/1953] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 19 14:56:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:56:42.256033 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e88b41-2ba9-4cdf-aaef-d582d10f40d3 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:42.275251 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e88b41-2ba9-4cdf-aaef-d582d10f40d3 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:42.282207 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2f6918-2a07-4e44-95a5-5f4bdad0902f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:42.284084 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2f6918-2a07-4e44-95a5-5f4bdad0902f admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:42.284691 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2f6918-2a07-4e44-95a5-5f4bdad0902f admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:42.285192 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2f6918-2a07-4e44-95a5-5f4bdad0902f admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:42.286058 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2f6918-2a07-4e44-95a5-5f4bdad0902f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:42.288594 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2f6918-2a07-4e44-95a5-5f4bdad0902f admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:42.350415 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 969/1954] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 14:56:42 2022] POST /identity/v3/projects => generated 375 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:56:42.367575 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca5b175-291e-4060-a89e-a52efa8f8723 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:42.373540 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca5b175-291e-4060-a89e-a52efa8f8723 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:42.476429 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34698215-b6a1-429c-9be4-0e11edd8a51e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:42.477362 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34698215-b6a1-429c-9be4-0e11edd8a51e admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:42.477707 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34698215-b6a1-429c-9be4-0e11edd8a51e admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:42.478063 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34698215-b6a1-429c-9be4-0e11edd8a51e admin admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:42.479417 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34698215-b6a1-429c-9be4-0e11edd8a51e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:42.481754 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34698215-b6a1-429c-9be4-0e11edd8a51e admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:42.525409 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 986/1955] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 14:56:42 2022] POST /identity/v3/users => generated 288 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:56:42.528179 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2f6918-2a07-4e44-95a5-5f4bdad0902f admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:42.539253 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2f6918-2a07-4e44-95a5-5f4bdad0902f admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:42.544848 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cf025f-e113-4f29-9c79-32b5679ad0d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:42.545612 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cf025f-e113-4f29-9c79-32b5679ad0d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:42.545962 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cf025f-e113-4f29-9c79-32b5679ad0d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:42.546304 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cf025f-e113-4f29-9c79-32b5679ad0d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:42.547049 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cf025f-e113-4f29-9c79-32b5679ad0d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:42.548715 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cf025f-e113-4f29-9c79-32b5679ad0d8 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:42.566945 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34698215-b6a1-429c-9be4-0e11edd8a51e admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:42.567379 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 970/1956] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:56:42 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:56:42.578451 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34698215-b6a1-429c-9be4-0e11edd8a51e admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:42.583325 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb937ab-840f-4d23-90b0-6b57aa70bc0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:42.584368 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb937ab-840f-4d23-90b0-6b57aa70bc0c admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:42.584717 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb937ab-840f-4d23-90b0-6b57aa70bc0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:42.585107 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb937ab-840f-4d23-90b0-6b57aa70bc0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:42.585948 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb937ab-840f-4d23-90b0-6b57aa70bc0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:42.587860 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb937ab-840f-4d23-90b0-6b57aa70bc0c admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:42.610360 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cf025f-e113-4f29-9c79-32b5679ad0d8 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:42.611632 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 987/1957] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:56:42 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:56:42.623329 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cf025f-e113-4f29-9c79-32b5679ad0d8 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:42.628302 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562e35ab-14b9-4bfb-a475-7ff2aa39f006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:42.629140 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e35ab-14b9-4bfb-a475-7ff2aa39f006 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:42.629284 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e35ab-14b9-4bfb-a475-7ff2aa39f006 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:42.629701 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e35ab-14b9-4bfb-a475-7ff2aa39f006 admin admin] PATH_INFO: `/v3/projects/4315d4b3e77240efb4848f03f3af5021/users/def97d6603c64c79993dbf6c7ceaa431/roles/74de6794e3b3422b93d26f993d260c35` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:42.647697 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562e35ab-14b9-4bfb-a475-7ff2aa39f006 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4315d4b3e77240efb4848f03f3af5021, user_id=def97d6603c64c79993dbf6c7ceaa431, role_id=74de6794e3b3422b93d26f993d260c35)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:42.650926 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562e35ab-14b9-4bfb-a475-7ff2aa39f006 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:42.675798 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 971/1958] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 14:56:42 2022] PUT /identity/v3/projects/4315d4b3e77240efb4848f03f3af5021/users/def97d6603c64c79993dbf6c7ceaa431/roles/74de6794e3b3422b93d26f993d260c35 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 14:56:42.690981 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a2fd88-059c-4ad2-828e-3ea211ac1bba None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:42.691266 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a2fd88-059c-4ad2-828e-3ea211ac1bba None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:42.691561 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a2fd88-059c-4ad2-828e-3ea211ac1bba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:42.747635 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-33a2fd88-059c-4ad2-828e-3ea211ac1bba None None] MFA Rules not processed for user `def97d6603c64c79993dbf6c7ceaa431`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:42.749150 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-33a2fd88-059c-4ad2-828e-3ea211ac1bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:42.893886 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 988/1959] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:56:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:56:42.959234 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562e35ab-14b9-4bfb-a475-7ff2aa39f006 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:42.961322 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-562e35ab-14b9-4bfb-a475-7ff2aa39f006 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:43.016685 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:43.070712 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562e35ab-14b9-4bfb-a475-7ff2aa39f006 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:43.075937 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57524cac-09d6-4f27-a725-a795dace38b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df648c909ddb41418128b43f925f5ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:43.076874 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57524cac-09d6-4f27-a725-a795dace38b0 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:43.077304 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57524cac-09d6-4f27-a725-a795dace38b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:43.077958 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57524cac-09d6-4f27-a725-a795dace38b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:43.111261 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57524cac-09d6-4f27-a725-a795dace38b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:43.118456 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57524cac-09d6-4f27-a725-a795dace38b0 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:43.151095 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 972/1960] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:56:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:56:44.842314 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a2fd88-059c-4ad2-828e-3ea211ac1bba None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:44.843798 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-33a2fd88-059c-4ad2-828e-3ea211ac1bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:44.961108 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:45.003013 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a2fd88-059c-4ad2-828e-3ea211ac1bba None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:45.017389 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec941e06-492f-48cd-89aa-757a38e52eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:45.018187 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec941e06-492f-48cd-89aa-757a38e52eca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:45.018526 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec941e06-492f-48cd-89aa-757a38e52eca admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:45.019084 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec941e06-492f-48cd-89aa-757a38e52eca admin admin] PATH_INFO: `/v3/users/26a953c1ab5c4c26af304b325f489928` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:45.026529 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec941e06-492f-48cd-89aa-757a38e52eca admin admin] RBAC: Authorizing `identity:delete_user(user_id=26a953c1ab5c4c26af304b325f489928)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:45.033646 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec941e06-492f-48cd-89aa-757a38e52eca admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:45.149529 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-ec941e06-492f-48cd-89aa-757a38e52eca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26a953c1ab5c4c26af304b325f489928'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:45.163256 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-ec941e06-492f-48cd-89aa-757a38e52eca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26a953c1ab5c4c26af304b325f489928'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:45.164161 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-ec941e06-492f-48cd-89aa-757a38e52eca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26a953c1ab5c4c26af304b325f489928'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:45.165657 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-ec941e06-492f-48cd-89aa-757a38e52eca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26a953c1ab5c4c26af304b325f489928'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:45.196357 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-ec941e06-492f-48cd-89aa-757a38e52eca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26a953c1ab5c4c26af304b325f489928'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:45.240465 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 989/1961] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 14:56:44 2022] DELETE /identity/v3/users/26a953c1ab5c4c26af304b325f489928 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:56:45.243329 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e9a694-07a7-4185-9259-a97255d26e31 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:45.244398 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e9a694-07a7-4185-9259-a97255d26e31 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:45.245237 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e9a694-07a7-4185-9259-a97255d26e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:45.299405 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-a9e9a694-07a7-4185-9259-a97255d26e31 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:45.302567 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a9e9a694-07a7-4185-9259-a97255d26e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:45.456915 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 973/1962] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:56:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:56:45.502933 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec941e06-492f-48cd-89aa-757a38e52eca admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:45.504727 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-ec941e06-492f-48cd-89aa-757a38e52eca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:45.664922 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec941e06-492f-48cd-89aa-757a38e52eca admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:45.670237 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34ebb38-ecb4-4d64-9d47-0f74d9d0f351 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:45.673474 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ebb38-ecb4-4d64-9d47-0f74d9d0f351 service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:45.675452 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ebb38-ecb4-4d64-9d47-0f74d9d0f351 service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:45.675914 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ebb38-ecb4-4d64-9d47-0f74d9d0f351 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:45.697168 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34ebb38-ecb4-4d64-9d47-0f74d9d0f351 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:45.698605 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34ebb38-ecb4-4d64-9d47-0f74d9d0f351 service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:45.710227 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 990/1963] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:56:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:56:46.377591 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e9a694-07a7-4185-9259-a97255d26e31 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:46.379219 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a9e9a694-07a7-4185-9259-a97255d26e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:46.402659 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e9a694-07a7-4185-9259-a97255d26e31 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:46.410364 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dd0567-f8a7-49b2-bc55-ce26b9d721c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:46.411145 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dd0567-f8a7-49b2-bc55-ce26b9d721c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:46.411412 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dd0567-f8a7-49b2-bc55-ce26b9d721c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:46.411738 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dd0567-f8a7-49b2-bc55-ce26b9d721c0 admin admin] PATH_INFO: `/v3/projects/87656a8d83534640ab95baaad87b33af` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:46.413471 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dd0567-f8a7-49b2-bc55-ce26b9d721c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87656a8d83534640ab95baaad87b33af)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:46.417587 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dd0567-f8a7-49b2-bc55-ce26b9d721c0 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:46.503808 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f3dd0567-f8a7-49b2-bc55-ce26b9d721c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87656a8d83534640ab95baaad87b33af', 'request_id': 'req-f3dd0567-f8a7-49b2-bc55-ce26b9d721c0'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:46.527354 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f3dd0567-f8a7-49b2-bc55-ce26b9d721c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87656a8d83534640ab95baaad87b33af', 'request_id': 'req-f3dd0567-f8a7-49b2-bc55-ce26b9d721c0'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:46.546247 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f3dd0567-f8a7-49b2-bc55-ce26b9d721c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87656a8d83534640ab95baaad87b33af', 'request_id': 'req-f3dd0567-f8a7-49b2-bc55-ce26b9d721c0'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:46.560697 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f3dd0567-f8a7-49b2-bc55-ce26b9d721c0 admin admin] The token cache is being invalidate because project 87656a8d83534640ab95baaad87b33af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:56:46.561226 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f3dd0567-f8a7-49b2-bc55-ce26b9d721c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:46.562632 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f3dd0567-f8a7-49b2-bc55-ce26b9d721c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:46.567974 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 974/1964] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 14:56:46 2022] DELETE /identity/v3/projects/87656a8d83534640ab95baaad87b33af => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:56:46.569422 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34ebb38-ecb4-4d64-9d47-0f74d9d0f351 service neutron] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:46.580442 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34ebb38-ecb4-4d64-9d47-0f74d9d0f351 service neutron] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:46.645887 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5833382-71b8-4656-aeb3-a5ddea8b80b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:46.646537 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5833382-71b8-4656-aeb3-a5ddea8b80b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:46.646814 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5833382-71b8-4656-aeb3-a5ddea8b80b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:46.647081 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5833382-71b8-4656-aeb3-a5ddea8b80b5 admin admin] PATH_INFO: `/v3/users/c132315a32794f34b413640977433405` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:46.649725 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5833382-71b8-4656-aeb3-a5ddea8b80b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c132315a32794f34b413640977433405)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:46.651686 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5833382-71b8-4656-aeb3-a5ddea8b80b5 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:46.677321 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:46.747731 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-e5833382-71b8-4656-aeb3-a5ddea8b80b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c132315a32794f34b413640977433405'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:46.757359 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-e5833382-71b8-4656-aeb3-a5ddea8b80b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c132315a32794f34b413640977433405'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:46.758165 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-e5833382-71b8-4656-aeb3-a5ddea8b80b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c132315a32794f34b413640977433405'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:46.758929 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-e5833382-71b8-4656-aeb3-a5ddea8b80b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c132315a32794f34b413640977433405'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:46.776050 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-e5833382-71b8-4656-aeb3-a5ddea8b80b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c132315a32794f34b413640977433405'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:46.792704 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 991/1965] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 14:56:46 2022] DELETE /identity/v3/users/c132315a32794f34b413640977433405 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:56:47.137400 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dd0567-f8a7-49b2-bc55-ce26b9d721c0 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:47.139388 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f3dd0567-f8a7-49b2-bc55-ce26b9d721c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:47.151275 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5833382-71b8-4656-aeb3-a5ddea8b80b5 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:47.153066 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-e5833382-71b8-4656-aeb3-a5ddea8b80b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:47.158545 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dd0567-f8a7-49b2-bc55-ce26b9d721c0 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:47.215202 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:47.226922 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bd8d03-e14f-4b64-b21f-71d01ba4481d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:47.227800 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd8d03-e14f-4b64-b21f-71d01ba4481d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:47.228182 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd8d03-e14f-4b64-b21f-71d01ba4481d admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:47.228628 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd8d03-e14f-4b64-b21f-71d01ba4481d admin admin] PATH_INFO: `/v3/projects/4eeaad0b7aa54055998de3ba8d0119f8` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:47.230039 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bd8d03-e14f-4b64-b21f-71d01ba4481d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4eeaad0b7aa54055998de3ba8d0119f8)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:47.232141 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bd8d03-e14f-4b64-b21f-71d01ba4481d admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:47.236206 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5833382-71b8-4656-aeb3-a5ddea8b80b5 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:47.241555 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014ab4d3-14d4-4578-8f5c-86d6a258ca5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:47.242416 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014ab4d3-14d4-4578-8f5c-86d6a258ca5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:47.242652 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014ab4d3-14d4-4578-8f5c-86d6a258ca5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:47.242970 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014ab4d3-14d4-4578-8f5c-86d6a258ca5d admin admin] PATH_INFO: `/v3/users/def97d6603c64c79993dbf6c7ceaa431` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:47.244074 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014ab4d3-14d4-4578-8f5c-86d6a258ca5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=def97d6603c64c79993dbf6c7ceaa431)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:47.246315 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014ab4d3-14d4-4578-8f5c-86d6a258ca5d admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:47.285509 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-77bd8d03-e14f-4b64-b21f-71d01ba4481d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4eeaad0b7aa54055998de3ba8d0119f8', 'request_id': 'req-77bd8d03-e14f-4b64-b21f-71d01ba4481d'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:47.293147 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-77bd8d03-e14f-4b64-b21f-71d01ba4481d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4eeaad0b7aa54055998de3ba8d0119f8', 'request_id': 'req-77bd8d03-e14f-4b64-b21f-71d01ba4481d'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:47.302782 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-77bd8d03-e14f-4b64-b21f-71d01ba4481d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4eeaad0b7aa54055998de3ba8d0119f8', 'request_id': 'req-77bd8d03-e14f-4b64-b21f-71d01ba4481d'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:47.303914 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-014ab4d3-14d4-4578-8f5c-86d6a258ca5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'def97d6603c64c79993dbf6c7ceaa431'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:47.312209 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-014ab4d3-14d4-4578-8f5c-86d6a258ca5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'def97d6603c64c79993dbf6c7ceaa431'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:47.313570 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-014ab4d3-14d4-4578-8f5c-86d6a258ca5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'def97d6603c64c79993dbf6c7ceaa431'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:47.314234 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-014ab4d3-14d4-4578-8f5c-86d6a258ca5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'def97d6603c64c79993dbf6c7ceaa431'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:47.316425 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-77bd8d03-e14f-4b64-b21f-71d01ba4481d admin admin] The token cache is being invalidate because project 4eeaad0b7aa54055998de3ba8d0119f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:56:47.316713 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-77bd8d03-e14f-4b64-b21f-71d01ba4481d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:47.317359 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-77bd8d03-e14f-4b64-b21f-71d01ba4481d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:47.321074 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 975/1966] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 14:56:47 2022] DELETE /identity/v3/projects/4eeaad0b7aa54055998de3ba8d0119f8 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:56:47.324513 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7947c24a-fd6d-4bc6-8759-5753079bb547 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:47.324788 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7947c24a-fd6d-4bc6-8759-5753079bb547 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:47.325113 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7947c24a-fd6d-4bc6-8759-5753079bb547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:47.328538 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-014ab4d3-14d4-4578-8f5c-86d6a258ca5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'def97d6603c64c79993dbf6c7ceaa431'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:47.343309 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 992/1967] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 14:56:47 2022] DELETE /identity/v3/users/def97d6603c64c79993dbf6c7ceaa431 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:56:47.347084 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-7947c24a-fd6d-4bc6-8759-5753079bb547 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:47.347870 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4314f6c-f766-483c-99ba-127d6f206a2d None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:47.348002 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4314f6c-f766-483c-99ba-127d6f206a2d None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:47.348172 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4314f6c-f766-483c-99ba-127d6f206a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:47.348549 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-7947c24a-fd6d-4bc6-8759-5753079bb547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:47.369552 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-d4314f6c-f766-483c-99ba-127d6f206a2d None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:47.370822 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-d4314f6c-f766-483c-99ba-127d6f206a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:47.375506 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:47.420426 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 976/1968] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:56:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 14:56:47.428238 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51263033-50d9-4e45-b111-97617741765a None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:47.428761 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51263033-50d9-4e45-b111-97617741765a None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:47.429234 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51263033-50d9-4e45-b111-97617741765a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:47.452199 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-51263033-50d9-4e45-b111-97617741765a None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:47.453533 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-51263033-50d9-4e45-b111-97617741765a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:47.458958 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 993/1969] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:56:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 14:56:47.462312 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 977/1970] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:56:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 14:56:47.466809 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4314f6c-f766-483c-99ba-127d6f206a2d None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:47.469964 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51263033-50d9-4e45-b111-97617741765a None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:47.471953 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-51263033-50d9-4e45-b111-97617741765a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:47.476762 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4314f6c-f766-483c-99ba-127d6f206a2d None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:47.482164 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53fb99c-9b9c-4535-85b4-17746137f10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:47.482858 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53fb99c-9b9c-4535-85b4-17746137f10b admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:47.483198 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53fb99c-9b9c-4535-85b4-17746137f10b admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:47.483791 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53fb99c-9b9c-4535-85b4-17746137f10b admin admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:47.484365 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53fb99c-9b9c-4535-85b4-17746137f10b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:56:47.484757 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53fb99c-9b9c-4535-85b4-17746137f10b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:47.486702 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53fb99c-9b9c-4535-85b4-17746137f10b admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:47.499338 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 994/1971] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 19 14:56:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:56:47.503586 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53fb99c-9b9c-4535-85b4-17746137f10b admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:47.517009 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53fb99c-9b9c-4535-85b4-17746137f10b admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:47.522456 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be69700a-805b-40eb-9181-5753875175e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:47.523549 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69700a-805b-40eb-9181-5753875175e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:47.523952 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69700a-805b-40eb-9181-5753875175e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:47.524288 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69700a-805b-40eb-9181-5753875175e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:47.526328 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be69700a-805b-40eb-9181-5753875175e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:47.526933 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be69700a-805b-40eb-9181-5753875175e3 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:47.545575 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51263033-50d9-4e45-b111-97617741765a None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:47.550920 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76390300-ddfd-4f2a-b5a5-7ce91ad38a6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:47.551808 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76390300-ddfd-4f2a-b5a5-7ce91ad38a6c service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:47.552630 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76390300-ddfd-4f2a-b5a5-7ce91ad38a6c service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:47.553096 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76390300-ddfd-4f2a-b5a5-7ce91ad38a6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:47.568916 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76390300-ddfd-4f2a-b5a5-7ce91ad38a6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:47.570759 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76390300-ddfd-4f2a-b5a5-7ce91ad38a6c service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:47.584247 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 978/1972] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:56:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:56:47.589444 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 995/1973] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 14:56:47 2022] POST /identity/v3/projects => generated 391 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 14:56:47.593360 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76390300-ddfd-4f2a-b5a5-7ce91ad38a6c service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:47.609736 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76390300-ddfd-4f2a-b5a5-7ce91ad38a6c service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:47.635076 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:47.709622 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5311dc8f-cde3-4fab-92b1-55a1a409270b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:47.710322 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5311dc8f-cde3-4fab-92b1-55a1a409270b admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:47.710822 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5311dc8f-cde3-4fab-92b1-55a1a409270b admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:47.711385 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5311dc8f-cde3-4fab-92b1-55a1a409270b admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:47.712363 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5311dc8f-cde3-4fab-92b1-55a1a409270b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:47.715320 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5311dc8f-cde3-4fab-92b1-55a1a409270b admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:47.743415 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 979/1974] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 14:56:47 2022] POST /identity/v3/users => generated 296 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 14:56:47.745722 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be69700a-805b-40eb-9181-5753875175e3 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:47.769169 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be69700a-805b-40eb-9181-5753875175e3 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:47.775590 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c07fd3-3a78-49a9-a345-d3eb0b83e93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:47.776260 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c07fd3-3a78-49a9-a345-d3eb0b83e93e admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:47.776544 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c07fd3-3a78-49a9-a345-d3eb0b83e93e admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:47.776818 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c07fd3-3a78-49a9-a345-d3eb0b83e93e admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:47.777727 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c07fd3-3a78-49a9-a345-d3eb0b83e93e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:47.779957 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c07fd3-3a78-49a9-a345-d3eb0b83e93e admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:47.794625 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 996/1975] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:56:47 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 14:56:47.798629 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5311dc8f-cde3-4fab-92b1-55a1a409270b admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:47.810322 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5311dc8f-cde3-4fab-92b1-55a1a409270b admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:47.814911 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7653c03-525b-46f6-9322-3a8390ae760d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:47.815514 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7653c03-525b-46f6-9322-3a8390ae760d admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:47.815789 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7653c03-525b-46f6-9322-3a8390ae760d admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:47.816054 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7653c03-525b-46f6-9322-3a8390ae760d admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:47.816869 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7653c03-525b-46f6-9322-3a8390ae760d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:47.818564 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7653c03-525b-46f6-9322-3a8390ae760d admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:47.833012 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 980/1976] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:56:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:56:47.834447 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c07fd3-3a78-49a9-a345-d3eb0b83e93e admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:47.857580 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c07fd3-3a78-49a9-a345-d3eb0b83e93e admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:47.863392 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e1dfb3-d42c-43b7-80b0-445845e41d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:47.864228 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e1dfb3-d42c-43b7-80b0-445845e41d63 admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:47.865119 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e1dfb3-d42c-43b7-80b0-445845e41d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:47.865396 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e1dfb3-d42c-43b7-80b0-445845e41d63 admin admin] PATH_INFO: `/v3/projects/0ac59d24f4034c149f00b3e7e7fa371f/users/2251fc23021742a4ab597fac69e8f0c8/roles/74de6794e3b3422b93d26f993d260c35` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:47.885388 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e1dfb3-d42c-43b7-80b0-445845e41d63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ac59d24f4034c149f00b3e7e7fa371f, user_id=2251fc23021742a4ab597fac69e8f0c8, role_id=74de6794e3b3422b93d26f993d260c35)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:47.888407 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e1dfb3-d42c-43b7-80b0-445845e41d63 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:47.917939 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 997/1977] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 14:56:47 2022] PUT /identity/v3/projects/0ac59d24f4034c149f00b3e7e7fa371f/users/2251fc23021742a4ab597fac69e8f0c8/roles/74de6794e3b3422b93d26f993d260c35 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:56:47.936026 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed45d4fd-7073-47ae-90cf-70ef4213687f None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:47.936700 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed45d4fd-7073-47ae-90cf-70ef4213687f None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:47.937111 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed45d4fd-7073-47ae-90cf-70ef4213687f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:48.002538 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-ed45d4fd-7073-47ae-90cf-70ef4213687f None None] MFA Rules not processed for user `2251fc23021742a4ab597fac69e8f0c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:48.005351 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ed45d4fd-7073-47ae-90cf-70ef4213687f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:48.108944 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 981/1978] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:56:47 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:56:48.115724 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e1dfb3-d42c-43b7-80b0-445845e41d63 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:48.178280 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed45d4fd-7073-47ae-90cf-70ef4213687f None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:48.183950 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ed45d4fd-7073-47ae-90cf-70ef4213687f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:48.262517 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e1dfb3-d42c-43b7-80b0-445845e41d63 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:48.270576 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baec71b-2d60-4096-a95b-b716cadcb4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:48.271263 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baec71b-2d60-4096-a95b-b716cadcb4c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:48.273305 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baec71b-2d60-4096-a95b-b716cadcb4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:48.273575 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baec71b-2d60-4096-a95b-b716cadcb4c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:48.274205 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baec71b-2d60-4096-a95b-b716cadcb4c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:48.277927 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baec71b-2d60-4096-a95b-b716cadcb4c4 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:48.295868 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed45d4fd-7073-47ae-90cf-70ef4213687f None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:48.302759 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cb606f-99b1-47c9-8360-24eff8713626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:48.303607 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb606f-99b1-47c9-8360-24eff8713626 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:48.304493 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb606f-99b1-47c9-8360-24eff8713626 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:48.305030 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb606f-99b1-47c9-8360-24eff8713626 admin admin] PATH_INFO: `/v3/projects/4315d4b3e77240efb4848f03f3af5021` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:48.306731 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cb606f-99b1-47c9-8360-24eff8713626 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4315d4b3e77240efb4848f03f3af5021)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:48.309130 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cb606f-99b1-47c9-8360-24eff8713626 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:48.337989 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 998/1979] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 14:56:48 2022] POST /identity/v3/projects => generated 393 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:56:48.339989 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baec71b-2d60-4096-a95b-b716cadcb4c4 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:48.354489 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:48.374303 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:48.386312 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-95cb606f-99b1-47c9-8360-24eff8713626 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4315d4b3e77240efb4848f03f3af5021', 'request_id': 'req-95cb606f-99b1-47c9-8360-24eff8713626'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:48.398263 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-95cb606f-99b1-47c9-8360-24eff8713626 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4315d4b3e77240efb4848f03f3af5021', 'request_id': 'req-95cb606f-99b1-47c9-8360-24eff8713626'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:48.412155 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-95cb606f-99b1-47c9-8360-24eff8713626 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4315d4b3e77240efb4848f03f3af5021', 'request_id': 'req-95cb606f-99b1-47c9-8360-24eff8713626'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:48.418540 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baec71b-2d60-4096-a95b-b716cadcb4c4 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:48.426601 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-95cb606f-99b1-47c9-8360-24eff8713626 admin admin] The token cache is being invalidate because project 4315d4b3e77240efb4848f03f3af5021 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:56:48.427200 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-95cb606f-99b1-47c9-8360-24eff8713626 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:48.427740 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-95cb606f-99b1-47c9-8360-24eff8713626 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:48.433642 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 982/1980] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 14:56:48 2022] DELETE /identity/v3/projects/4315d4b3e77240efb4848f03f3af5021 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:56:48.435656 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540bcc3e-1b93-4449-a95e-76db878df488 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:48.435939 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540bcc3e-1b93-4449-a95e-76db878df488 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:48.436214 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540bcc3e-1b93-4449-a95e-76db878df488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:48.460123 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-540bcc3e-1b93-4449-a95e-76db878df488 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:48.461598 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-540bcc3e-1b93-4449-a95e-76db878df488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:48.490250 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b938b36f-0171-4016-9100-0ed7d83a7f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:48.490928 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b938b36f-0171-4016-9100-0ed7d83a7f48 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:48.491208 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b938b36f-0171-4016-9100-0ed7d83a7f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:48.491542 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b938b36f-0171-4016-9100-0ed7d83a7f48 admin admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:48.492751 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b938b36f-0171-4016-9100-0ed7d83a7f48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:48.494393 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b938b36f-0171-4016-9100-0ed7d83a7f48 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:48.522402 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 999/1981] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 14:56:48 2022] POST /identity/v3/users => generated 303 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:56:48.524565 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b938b36f-0171-4016-9100-0ed7d83a7f48 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:48.526659 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-b938b36f-0171-4016-9100-0ed7d83a7f48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:48.536830 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 983/1982] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:56:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:56:48.540850 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b938b36f-0171-4016-9100-0ed7d83a7f48 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:48.545698 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f175e2e-c7f7-4a79-a013-57bb69214778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:48.546421 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f175e2e-c7f7-4a79-a013-57bb69214778 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:48.546755 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f175e2e-c7f7-4a79-a013-57bb69214778 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:48.546997 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b748f2-b892-492b-a5b3-29f469231acc None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:48.547158 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f175e2e-c7f7-4a79-a013-57bb69214778 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:48.547425 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b748f2-b892-492b-a5b3-29f469231acc None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:48.547568 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b748f2-b892-492b-a5b3-29f469231acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:48.547807 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f175e2e-c7f7-4a79-a013-57bb69214778 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:48.550341 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f175e2e-c7f7-4a79-a013-57bb69214778 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:48.564236 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1000/1983] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:56:48.565991 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f175e2e-c7f7-4a79-a013-57bb69214778 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:48.578052 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f175e2e-c7f7-4a79-a013-57bb69214778 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:48.579757 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-87b748f2-b892-492b-a5b3-29f469231acc None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:48.581082 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-87b748f2-b892-492b-a5b3-29f469231acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:48.584360 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826030ee-8f56-48f8-ad23-c094589b4985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:48.585056 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826030ee-8f56-48f8-ad23-c094589b4985 admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:48.585390 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826030ee-8f56-48f8-ad23-c094589b4985 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:48.585653 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826030ee-8f56-48f8-ad23-c094589b4985 admin admin] PATH_INFO: `/v3/projects/6851148740854545bd3f3d19ff413c68/users/747aff475dab40b49c08b54083cb4544/roles/019bde1756cb40de8ce06cef6b261f79` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:48.592007 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 984/1984] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:56:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:56:48.596398 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b748f2-b892-492b-a5b3-29f469231acc None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:48.602189 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826030ee-8f56-48f8-ad23-c094589b4985 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6851148740854545bd3f3d19ff413c68, user_id=747aff475dab40b49c08b54083cb4544, role_id=019bde1756cb40de8ce06cef6b261f79)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:48.605524 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826030ee-8f56-48f8-ad23-c094589b4985 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:48.608352 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b748f2-b892-492b-a5b3-29f469231acc None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:48.614884 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bcf779-17c8-429f-a1b8-9287173ced3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:48.615722 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bcf779-17c8-429f-a1b8-9287173ced3a admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:48.616151 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bcf779-17c8-429f-a1b8-9287173ced3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:48.616446 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bcf779-17c8-429f-a1b8-9287173ced3a admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:48.617528 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bcf779-17c8-429f-a1b8-9287173ced3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:56:48.617871 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bcf779-17c8-429f-a1b8-9287173ced3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:48.619765 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bcf779-17c8-429f-a1b8-9287173ced3a admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:48.630886 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1001/1985] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 14:56:48 2022] PUT /identity/v3/projects/6851148740854545bd3f3d19ff413c68/users/747aff475dab40b49c08b54083cb4544/roles/019bde1756cb40de8ce06cef6b261f79 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:56:48.633546 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 985/1986] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 19 14:56:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:56:48.637479 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826030ee-8f56-48f8-ad23-c094589b4985 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:48.637632 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bcf779-17c8-429f-a1b8-9287173ced3a admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:48.652896 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bcf779-17c8-429f-a1b8-9287173ced3a admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:48.717344 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826030ee-8f56-48f8-ad23-c094589b4985 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:48.722686 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265714f9-8baa-4d2a-b428-e2cea6e0edf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:48.723303 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265714f9-8baa-4d2a-b428-e2cea6e0edf5 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:48.723610 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265714f9-8baa-4d2a-b428-e2cea6e0edf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:48.723881 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265714f9-8baa-4d2a-b428-e2cea6e0edf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:48.724529 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265714f9-8baa-4d2a-b428-e2cea6e0edf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:48.726301 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265714f9-8baa-4d2a-b428-e2cea6e0edf5 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:48.728771 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7846e2-1613-4ec5-8762-052d80e16c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:48.730034 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7846e2-1613-4ec5-8762-052d80e16c0f admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:48.730416 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7846e2-1613-4ec5-8762-052d80e16c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:48.730802 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7846e2-1613-4ec5-8762-052d80e16c0f admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:48.731631 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7846e2-1613-4ec5-8762-052d80e16c0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:48.734328 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7846e2-1613-4ec5-8762-052d80e16c0f admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:48.738535 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1002/1987] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:56:48.739536 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265714f9-8baa-4d2a-b428-e2cea6e0edf5 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:48.741950 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-265714f9-8baa-4d2a-b428-e2cea6e0edf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:48.756734 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265714f9-8baa-4d2a-b428-e2cea6e0edf5 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:48.761822 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05169da-e56d-42bb-8a05-5f4b199ca608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:48.762450 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05169da-e56d-42bb-8a05-5f4b199ca608 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:48.762726 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05169da-e56d-42bb-8a05-5f4b199ca608 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:48.762993 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05169da-e56d-42bb-8a05-5f4b199ca608 admin admin] PATH_INFO: `/v3/users/4e5cf9ff039f4e43ae79ac69a38f9aa7` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:48.764117 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05169da-e56d-42bb-8a05-5f4b199ca608 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e5cf9ff039f4e43ae79ac69a38f9aa7)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:48.766078 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05169da-e56d-42bb-8a05-5f4b199ca608 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:48.772410 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 986/1988] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 14:56:48 2022] POST /identity/v3/projects => generated 363 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:56:48.774067 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7846e2-1613-4ec5-8762-052d80e16c0f admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:48.786545 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:48.807239 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:48.832896 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-d05169da-e56d-42bb-8a05-5f4b199ca608 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e5cf9ff039f4e43ae79ac69a38f9aa7'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:48.843980 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-d05169da-e56d-42bb-8a05-5f4b199ca608 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e5cf9ff039f4e43ae79ac69a38f9aa7'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:48.844782 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-d05169da-e56d-42bb-8a05-5f4b199ca608 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e5cf9ff039f4e43ae79ac69a38f9aa7'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:48.845392 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-d05169da-e56d-42bb-8a05-5f4b199ca608 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e5cf9ff039f4e43ae79ac69a38f9aa7'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:48.856951 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7846e2-1613-4ec5-8762-052d80e16c0f admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:48.859076 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-d05169da-e56d-42bb-8a05-5f4b199ca608 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e5cf9ff039f4e43ae79ac69a38f9aa7'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:48.862522 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bcad96-0b0a-4026-b760-716fff93447b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:48.863292 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bcad96-0b0a-4026-b760-716fff93447b admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:48.863639 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bcad96-0b0a-4026-b760-716fff93447b admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:48.863975 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bcad96-0b0a-4026-b760-716fff93447b admin admin] PATH_INFO: `/v3/projects/6851148740854545bd3f3d19ff413c68/users/747aff475dab40b49c08b54083cb4544/roles/019bde1756cb40de8ce06cef6b261f79` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:48.865978 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bcad96-0b0a-4026-b760-716fff93447b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6851148740854545bd3f3d19ff413c68, user_id=747aff475dab40b49c08b54083cb4544, role_id=019bde1756cb40de8ce06cef6b261f79)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:48.869051 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bcad96-0b0a-4026-b760-716fff93447b admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:48.877288 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1003/1989] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 14:56:48 2022] DELETE /identity/v3/users/4e5cf9ff039f4e43ae79ac69a38f9aa7 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:56:48.878479 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05169da-e56d-42bb-8a05-5f4b199ca608 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:48.879962 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-d05169da-e56d-42bb-8a05-5f4b199ca608 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:48.882005 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 987/1990] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 14:56:48 2022] PUT /identity/v3/projects/6851148740854545bd3f3d19ff413c68/users/747aff475dab40b49c08b54083cb4544/roles/019bde1756cb40de8ce06cef6b261f79 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:56:48.883507 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b42e52-773a-4e2a-8068-a83b53036aae None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:48.883769 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b42e52-773a-4e2a-8068-a83b53036aae None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:48.884043 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b42e52-773a-4e2a-8068-a83b53036aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:48.904971 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-18b42e52-773a-4e2a-8068-a83b53036aae None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:48.906222 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-18b42e52-773a-4e2a-8068-a83b53036aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:48.972847 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05169da-e56d-42bb-8a05-5f4b199ca608 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:48.979908 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1962059d-de12-4c1e-9297-c1d2c99767a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:48.980637 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1962059d-de12-4c1e-9297-c1d2c99767a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:48.980915 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1962059d-de12-4c1e-9297-c1d2c99767a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:48.981210 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1962059d-de12-4c1e-9297-c1d2c99767a9 admin admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:48.981840 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1962059d-de12-4c1e-9297-c1d2c99767a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:48.983894 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1962059d-de12-4c1e-9297-c1d2c99767a9 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:49.000757 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 988/1991] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:56:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:56:49.003518 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b491cde-e7c3-4510-b3d8-a53c319fdfe7 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:49.006278 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b491cde-e7c3-4510-b3d8-a53c319fdfe7 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:49.007354 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b491cde-e7c3-4510-b3d8-a53c319fdfe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:49.018607 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1004/1992] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 14:56:48 2022] POST /identity/v3/users => generated 282 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:56:49.019597 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1962059d-de12-4c1e-9297-c1d2c99767a9 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:49.021302 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-1962059d-de12-4c1e-9297-c1d2c99767a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:49.080327 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-1b491cde-e7c3-4510-b3d8-a53c319fdfe7 None None] MFA Rules not processed for user `747aff475dab40b49c08b54083cb4544`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:49.081896 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-1b491cde-e7c3-4510-b3d8-a53c319fdfe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:49.091398 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1962059d-de12-4c1e-9297-c1d2c99767a9 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:49.096583 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451ce658-c911-4903-a216-f39cd3a3f181 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:49.097358 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ce658-c911-4903-a216-f39cd3a3f181 service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:49.097635 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ce658-c911-4903-a216-f39cd3a3f181 service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:49.098008 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ce658-c911-4903-a216-f39cd3a3f181 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:49.109249 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451ce658-c911-4903-a216-f39cd3a3f181 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:49.110971 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451ce658-c911-4903-a216-f39cd3a3f181 service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:49.136840 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1005/1993] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:56:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:56:49.137877 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451ce658-c911-4903-a216-f39cd3a3f181 service neutron] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:49.161752 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451ce658-c911-4903-a216-f39cd3a3f181 service neutron] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:49.175005 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c6d327-6e54-4d2b-adfa-c0bab7ef5dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:49.176062 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c6d327-6e54-4d2b-adfa-c0bab7ef5dbe admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:49.176479 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c6d327-6e54-4d2b-adfa-c0bab7ef5dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:49.177477 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c6d327-6e54-4d2b-adfa-c0bab7ef5dbe admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:49.178265 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c6d327-6e54-4d2b-adfa-c0bab7ef5dbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:49.180871 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c6d327-6e54-4d2b-adfa-c0bab7ef5dbe admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:49.198680 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1006/1994] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:56:49 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:56:49.203382 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c6d327-6e54-4d2b-adfa-c0bab7ef5dbe admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:49.209910 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 989/1995] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:56:49 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:56:49.229408 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b491cde-e7c3-4510-b3d8-a53c319fdfe7 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:49.230857 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-1b491cde-e7c3-4510-b3d8-a53c319fdfe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:49.242480 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c6d327-6e54-4d2b-adfa-c0bab7ef5dbe admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:49.254705 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c693eb-427f-4013-b3af-46be14637344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:49.255332 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c693eb-427f-4013-b3af-46be14637344 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:49.255873 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c693eb-427f-4013-b3af-46be14637344 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:49.255873 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c693eb-427f-4013-b3af-46be14637344 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:49.256578 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c693eb-427f-4013-b3af-46be14637344 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:49.258610 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c693eb-427f-4013-b3af-46be14637344 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:49.275518 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1007/1996] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:56:49 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:56:49.285220 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c693eb-427f-4013-b3af-46be14637344 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:49.297781 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:49.305071 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c693eb-427f-4013-b3af-46be14637344 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:49.319028 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36d303c-cbdf-4a23-94c6-f3c35a0f74aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:49.319772 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d303c-cbdf-4a23-94c6-f3c35a0f74aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:49.320060 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d303c-cbdf-4a23-94c6-f3c35a0f74aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:49.320637 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d303c-cbdf-4a23-94c6-f3c35a0f74aa admin admin] PATH_INFO: `/v3/projects/2178b1cf56cc476fb97295f4ed9b6f80/users/d65b64ac6eaf4ababb473816cd40cf01/roles/74de6794e3b3422b93d26f993d260c35` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:49.323159 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:49.347273 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b491cde-e7c3-4510-b3d8-a53c319fdfe7 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:49.352857 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7c1218-1e38-481b-9c8a-91b7ddc5ed6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df648c909ddb41418128b43f925f5ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:49.353649 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c1218-1e38-481b-9c8a-91b7ddc5ed6d service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:49.354016 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c1218-1e38-481b-9c8a-91b7ddc5ed6d service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:49.354362 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c1218-1e38-481b-9c8a-91b7ddc5ed6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:49.355700 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36d303c-cbdf-4a23-94c6-f3c35a0f74aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=2178b1cf56cc476fb97295f4ed9b6f80, user_id=d65b64ac6eaf4ababb473816cd40cf01, role_id=74de6794e3b3422b93d26f993d260c35)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:49.358633 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36d303c-cbdf-4a23-94c6-f3c35a0f74aa admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:49.369122 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7c1218-1e38-481b-9c8a-91b7ddc5ed6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:49.372302 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7c1218-1e38-481b-9c8a-91b7ddc5ed6d service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:49.386282 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1008/1997] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 14:56:49 2022] PUT /identity/v3/projects/2178b1cf56cc476fb97295f4ed9b6f80/users/d65b64ac6eaf4ababb473816cd40cf01/roles/74de6794e3b3422b93d26f993d260c35 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:56:49.397928 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca48ee-0b42-418a-9235-45edf922f2fb None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:49.398253 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca48ee-0b42-418a-9235-45edf922f2fb None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:49.398519 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca48ee-0b42-418a-9235-45edf922f2fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:49.410774 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 990/1998] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:56:49 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 14:56:49.441963 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-beca48ee-0b42-418a-9235-45edf922f2fb None None] MFA Rules not processed for user `d65b64ac6eaf4ababb473816cd40cf01`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:49.443781 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-beca48ee-0b42-418a-9235-45edf922f2fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:49.481341 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7c1218-1e38-481b-9c8a-91b7ddc5ed6d service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:49.483417 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-bd7c1218-1e38-481b-9c8a-91b7ddc5ed6d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:49.504435 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7c1218-1e38-481b-9c8a-91b7ddc5ed6d service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:49.578108 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1009/1999] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:56:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 14:56:49.588307 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e016996e-5039-4b6e-9264-e1c2af325e61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df648c909ddb41418128b43f925f5ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:49.588940 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e016996e-5039-4b6e-9264-e1c2af325e61 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:49.589250 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e016996e-5039-4b6e-9264-e1c2af325e61 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:49.589524 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e016996e-5039-4b6e-9264-e1c2af325e61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:49.593738 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e016996e-5039-4b6e-9264-e1c2af325e61 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:49.594015 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beca48ee-0b42-418a-9235-45edf922f2fb None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:49.615271 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beca48ee-0b42-418a-9235-45edf922f2fb None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:49.625223 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db579e0-df2e-4685-b3a2-fae53602fda9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df648c909ddb41418128b43f925f5ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:49.626010 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db579e0-df2e-4685-b3a2-fae53602fda9 service cinder] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:49.626519 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db579e0-df2e-4685-b3a2-fae53602fda9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:49.635987 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db579e0-df2e-4685-b3a2-fae53602fda9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:49.666769 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db579e0-df2e-4685-b3a2-fae53602fda9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:49.668365 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db579e0-df2e-4685-b3a2-fae53602fda9 service cinder] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:49.680231 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1010/2000] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:56:49 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:56:49.681224 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db579e0-df2e-4685-b3a2-fae53602fda9 service cinder] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:49.682691 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-5db579e0-df2e-4685-b3a2-fae53602fda9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:49.711851 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e016996e-5039-4b6e-9264-e1c2af325e61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:49.713696 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e016996e-5039-4b6e-9264-e1c2af325e61 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:49.733275 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 991/2001] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:56:49 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:56:49.799395 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db579e0-df2e-4685-b3a2-fae53602fda9 service cinder] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:49.814613 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115987f7-1064-48a9-adb2-b3cf786a25b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:49.816233 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115987f7-1064-48a9-adb2-b3cf786a25b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:49.816233 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115987f7-1064-48a9-adb2-b3cf786a25b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:49.816233 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115987f7-1064-48a9-adb2-b3cf786a25b6 admin admin] PATH_INFO: `/v3/projects/e6caf4ad6fdd4de897545db9e5b3b89a` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:49.819704 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115987f7-1064-48a9-adb2-b3cf786a25b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6caf4ad6fdd4de897545db9e5b3b89a)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:49.819704 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115987f7-1064-48a9-adb2-b3cf786a25b6 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:49.891133 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-115987f7-1064-48a9-adb2-b3cf786a25b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6caf4ad6fdd4de897545db9e5b3b89a', 'request_id': 'req-115987f7-1064-48a9-adb2-b3cf786a25b6'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:49.899413 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-115987f7-1064-48a9-adb2-b3cf786a25b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6caf4ad6fdd4de897545db9e5b3b89a', 'request_id': 'req-115987f7-1064-48a9-adb2-b3cf786a25b6'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:49.903994 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:49.912801 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-115987f7-1064-48a9-adb2-b3cf786a25b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6caf4ad6fdd4de897545db9e5b3b89a', 'request_id': 'req-115987f7-1064-48a9-adb2-b3cf786a25b6'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:49.930591 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-115987f7-1064-48a9-adb2-b3cf786a25b6 admin admin] The token cache is being invalidate because project e6caf4ad6fdd4de897545db9e5b3b89a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:56:49.931184 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-115987f7-1064-48a9-adb2-b3cf786a25b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:49.932114 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-115987f7-1064-48a9-adb2-b3cf786a25b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:49.937043 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1011/2002] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 14:56:49 2022] DELETE /identity/v3/projects/e6caf4ad6fdd4de897545db9e5b3b89a => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:56:49.940306 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc95be06-aed4-4611-95c5-ea9e9b713cf1 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:49.941388 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc95be06-aed4-4611-95c5-ea9e9b713cf1 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:49.941817 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc95be06-aed4-4611-95c5-ea9e9b713cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:49.975670 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-fc95be06-aed4-4611-95c5-ea9e9b713cf1 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:49.977586 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-fc95be06-aed4-4611-95c5-ea9e9b713cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:50.085254 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 992/2003] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:56:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 14:56:50.095350 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e0f881-c97a-45cf-8b3d-906d48a7a02f None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:50.095638 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e0f881-c97a-45cf-8b3d-906d48a7a02f None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:50.095915 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e0f881-c97a-45cf-8b3d-906d48a7a02f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:50.128669 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-60e0f881-c97a-45cf-8b3d-906d48a7a02f None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:50.129922 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-60e0f881-c97a-45cf-8b3d-906d48a7a02f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:50.162426 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1012/2004] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:56:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:56:50.165915 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc95be06-aed4-4611-95c5-ea9e9b713cf1 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:50.202777 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc95be06-aed4-4611-95c5-ea9e9b713cf1 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:50.210325 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c81a6b-2731-4c14-b80b-29e796951789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:50.210957 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c81a6b-2731-4c14-b80b-29e796951789 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:50.211227 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c81a6b-2731-4c14-b80b-29e796951789 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:50.211477 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c81a6b-2731-4c14-b80b-29e796951789 admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:50.212127 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c81a6b-2731-4c14-b80b-29e796951789 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:56:50.212425 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c81a6b-2731-4c14-b80b-29e796951789 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:50.221820 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c81a6b-2731-4c14-b80b-29e796951789 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:50.256681 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 993/2005] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 19 14:56:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:56:50.258249 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e0f881-c97a-45cf-8b3d-906d48a7a02f None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:50.272829 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e0f881-c97a-45cf-8b3d-906d48a7a02f None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:50.285956 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1799cdd-fd4e-40bc-bac1-14afdab69a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:50.286647 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1799cdd-fd4e-40bc-bac1-14afdab69a6e admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:50.286914 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1799cdd-fd4e-40bc-bac1-14afdab69a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:50.287189 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1799cdd-fd4e-40bc-bac1-14afdab69a6e admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:50.287836 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1799cdd-fd4e-40bc-bac1-14afdab69a6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:50.290082 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1799cdd-fd4e-40bc-bac1-14afdab69a6e admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:50.357383 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1013/2006] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 14:56:50 2022] POST /identity/v3/projects => generated 373 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:56:50.360553 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c81a6b-2731-4c14-b80b-29e796951789 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:50.373021 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c81a6b-2731-4c14-b80b-29e796951789 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:50.415771 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:50.454504 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5497543-a963-458f-9723-2bbaa117b84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:50.455121 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5497543-a963-458f-9723-2bbaa117b84a admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:50.455428 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5497543-a963-458f-9723-2bbaa117b84a admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:50.455690 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5497543-a963-458f-9723-2bbaa117b84a admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:50.456350 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5497543-a963-458f-9723-2bbaa117b84a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:50.458672 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5497543-a963-458f-9723-2bbaa117b84a admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:50.485569 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 994/2007] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 14:56:50 2022] POST /identity/v3/users => generated 287 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:56:50.486896 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1799cdd-fd4e-40bc-bac1-14afdab69a6e admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:50.502158 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1799cdd-fd4e-40bc-bac1-14afdab69a6e admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:50.515306 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c71b9e-25ae-4836-8af4-76dbcd913d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:50.516156 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c71b9e-25ae-4836-8af4-76dbcd913d02 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:50.516902 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c71b9e-25ae-4836-8af4-76dbcd913d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:50.517380 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c71b9e-25ae-4836-8af4-76dbcd913d02 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:50.518271 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c71b9e-25ae-4836-8af4-76dbcd913d02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:50.531429 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c71b9e-25ae-4836-8af4-76dbcd913d02 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:50.549188 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1014/2008] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:56:50 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:56:50.552050 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5497543-a963-458f-9723-2bbaa117b84a admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:50.565047 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5497543-a963-458f-9723-2bbaa117b84a admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:50.574302 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55422803-b3de-4135-a342-15bc1f6baf14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:50.574939 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55422803-b3de-4135-a342-15bc1f6baf14 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:50.575238 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55422803-b3de-4135-a342-15bc1f6baf14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:50.575487 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55422803-b3de-4135-a342-15bc1f6baf14 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:50.576179 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55422803-b3de-4135-a342-15bc1f6baf14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:50.578579 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55422803-b3de-4135-a342-15bc1f6baf14 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:50.592660 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 995/2009] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:56:50 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:56:50.596752 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c71b9e-25ae-4836-8af4-76dbcd913d02 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:50.618303 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c71b9e-25ae-4836-8af4-76dbcd913d02 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:50.628686 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa17523a-1033-49ab-86d9-6d41a2779cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:50.629595 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17523a-1033-49ab-86d9-6d41a2779cbd admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:50.629875 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17523a-1033-49ab-86d9-6d41a2779cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:50.630147 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17523a-1033-49ab-86d9-6d41a2779cbd admin admin] PATH_INFO: `/v3/projects/1adc5cf927a54bc9b8c4cb5f9edc7bf1/users/278fef191e3f4f2db5e86955879393fb/roles/74de6794e3b3422b93d26f993d260c35` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:50.647183 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa17523a-1033-49ab-86d9-6d41a2779cbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=1adc5cf927a54bc9b8c4cb5f9edc7bf1, user_id=278fef191e3f4f2db5e86955879393fb, role_id=74de6794e3b3422b93d26f993d260c35)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:50.650167 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa17523a-1033-49ab-86d9-6d41a2779cbd admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:50.666045 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1015/2010] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 14:56:50 2022] PUT /identity/v3/projects/1adc5cf927a54bc9b8c4cb5f9edc7bf1/users/278fef191e3f4f2db5e86955879393fb/roles/74de6794e3b3422b93d26f993d260c35 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:56:50.676532 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdecd187-3992-476b-9b3e-a64174033c05 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:50.676917 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdecd187-3992-476b-9b3e-a64174033c05 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:50.677294 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdecd187-3992-476b-9b3e-a64174033c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:50.725367 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-cdecd187-3992-476b-9b3e-a64174033c05 None None] MFA Rules not processed for user `278fef191e3f4f2db5e86955879393fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:50.726762 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-cdecd187-3992-476b-9b3e-a64174033c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:50.843450 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 996/2011] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:56:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:56:50.856494 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa17523a-1033-49ab-86d9-6d41a2779cbd admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:50.858456 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-aa17523a-1033-49ab-86d9-6d41a2779cbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:50.948622 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa17523a-1033-49ab-86d9-6d41a2779cbd admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:50.952753 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132d9444-c046-4b30-ba82-296696df93f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df648c909ddb41418128b43f925f5ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:50.953406 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d9444-c046-4b30-ba82-296696df93f0 service cinder] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:50.953838 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d9444-c046-4b30-ba82-296696df93f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:50.953953 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d9444-c046-4b30-ba82-296696df93f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:50.965724 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132d9444-c046-4b30-ba82-296696df93f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:50.967807 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132d9444-c046-4b30-ba82-296696df93f0 service cinder] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:50.994365 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1016/2012] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:56:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:56:51.013076 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdecd187-3992-476b-9b3e-a64174033c05 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:51.104765 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdecd187-3992-476b-9b3e-a64174033c05 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:51.111264 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b13a32-33b1-4971-8c70-9e675ddfc38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:51.113127 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b13a32-33b1-4971-8c70-9e675ddfc38c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:51.113513 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b13a32-33b1-4971-8c70-9e675ddfc38c admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:51.114373 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b13a32-33b1-4971-8c70-9e675ddfc38c admin admin] PATH_INFO: `/v3/users/278fef191e3f4f2db5e86955879393fb` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:51.116238 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b13a32-33b1-4971-8c70-9e675ddfc38c admin admin] RBAC: Authorizing `identity:delete_user(user_id=278fef191e3f4f2db5e86955879393fb)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:51.120273 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b13a32-33b1-4971-8c70-9e675ddfc38c admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:51.164433 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:51.175587 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b0b13a32-33b1-4971-8c70-9e675ddfc38c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '278fef191e3f4f2db5e86955879393fb'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:51.184362 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b0b13a32-33b1-4971-8c70-9e675ddfc38c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '278fef191e3f4f2db5e86955879393fb'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:51.185561 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b0b13a32-33b1-4971-8c70-9e675ddfc38c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '278fef191e3f4f2db5e86955879393fb'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:51.186265 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b0b13a32-33b1-4971-8c70-9e675ddfc38c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '278fef191e3f4f2db5e86955879393fb'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:51.201443 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b0b13a32-33b1-4971-8c70-9e675ddfc38c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '278fef191e3f4f2db5e86955879393fb'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:51.231287 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 997/2013] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 14:56:51 2022] DELETE /identity/v3/users/278fef191e3f4f2db5e86955879393fb => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:56:51.235744 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae58dd-b24c-4ae9-a80f-835579ab3cce None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:51.236150 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae58dd-b24c-4ae9-a80f-835579ab3cce None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:51.236670 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae58dd-b24c-4ae9-a80f-835579ab3cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:51.261197 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-efae58dd-b24c-4ae9-a80f-835579ab3cce None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:51.262410 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-efae58dd-b24c-4ae9-a80f-835579ab3cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:51.329933 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1017/2014] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:56:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:56:51.342249 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b13a32-33b1-4971-8c70-9e675ddfc38c admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:51.344007 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b0b13a32-33b1-4971-8c70-9e675ddfc38c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:51.432388 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ac493-a44f-4fc8-8a6a-d1148e9a55cb None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:51.432889 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ac493-a44f-4fc8-8a6a-d1148e9a55cb None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:51.433264 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ac493-a44f-4fc8-8a6a-d1148e9a55cb None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:51.435164 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1018/2015] 10.222.0.26 () {54 vars in 921 bytes} [Mon Sep 19 14:56:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:56:51.439611 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b13a32-33b1-4971-8c70-9e675ddfc38c admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:51.450124 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9b8a45-b943-41ef-a4d4-38c98e15a9d4 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:51.450482 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9b8a45-b943-41ef-a4d4-38c98e15a9d4 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:51.450852 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9b8a45-b943-41ef-a4d4-38c98e15a9d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:51.463936 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132dd27d-c55a-4a41-ae76-af28819bc742 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:51.466272 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132dd27d-c55a-4a41-ae76-af28819bc742 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:51.466645 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132dd27d-c55a-4a41-ae76-af28819bc742 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:51.470112 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132dd27d-c55a-4a41-ae76-af28819bc742 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:51.481328 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-ee9b8a45-b943-41ef-a4d4-38c98e15a9d4 None None] MFA Rules not processed for user `da0a58c526f34afda909e4ede2b1e1c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:51.483342 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-ee9b8a45-b943-41ef-a4d4-38c98e15a9d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:51.489368 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132dd27d-c55a-4a41-ae76-af28819bc742 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:51.491282 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132dd27d-c55a-4a41-ae76-af28819bc742 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:51.501696 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 998/2016] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:56:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:56:51.552728 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132dd27d-c55a-4a41-ae76-af28819bc742 service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:51.554538 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-132dd27d-c55a-4a41-ae76-af28819bc742 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:51.572196 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:51.574521 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132dd27d-c55a-4a41-ae76-af28819bc742 service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:51.592032 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144e65e1-ed3e-48dd-9275-165463893ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:51.592677 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144e65e1-ed3e-48dd-9275-165463893ed8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:51.592953 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144e65e1-ed3e-48dd-9275-165463893ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:51.593255 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144e65e1-ed3e-48dd-9275-165463893ed8 admin admin] PATH_INFO: `/v3/users/34c0f151ec0940449a2fb3e68b33925f` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:51.596291 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144e65e1-ed3e-48dd-9275-165463893ed8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34c0f151ec0940449a2fb3e68b33925f)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:51.601405 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144e65e1-ed3e-48dd-9275-165463893ed8 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:51.673785 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1019/2017] 10.222.0.26 () {58 vars in 1018 bytes} [Mon Sep 19 14:56:51 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 14:56:51.686588 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9b8a45-b943-41ef-a4d4-38c98e15a9d4 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:51.689312 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-ee9b8a45-b943-41ef-a4d4-38c98e15a9d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:51.706715 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-144e65e1-ed3e-48dd-9275-165463893ed8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34c0f151ec0940449a2fb3e68b33925f'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:51.709095 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9b8a45-b943-41ef-a4d4-38c98e15a9d4 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:51.716844 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcdf7bc-e360-4ba7-b071-a5f1acb97461 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da0a58c526f34afda909e4ede2b1e1c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:51.718114 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcdf7bc-e360-4ba7-b071-a5f1acb97461 service placement] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:51.718781 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcdf7bc-e360-4ba7-b071-a5f1acb97461 service placement] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:51.719431 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcdf7bc-e360-4ba7-b071-a5f1acb97461 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:51.724409 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-144e65e1-ed3e-48dd-9275-165463893ed8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34c0f151ec0940449a2fb3e68b33925f'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:51.726042 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-144e65e1-ed3e-48dd-9275-165463893ed8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34c0f151ec0940449a2fb3e68b33925f'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:51.727207 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-144e65e1-ed3e-48dd-9275-165463893ed8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34c0f151ec0940449a2fb3e68b33925f'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:51.736674 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcdf7bc-e360-4ba7-b071-a5f1acb97461 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:51.740127 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcdf7bc-e360-4ba7-b071-a5f1acb97461 service placement] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:51.741143 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-144e65e1-ed3e-48dd-9275-165463893ed8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34c0f151ec0940449a2fb3e68b33925f'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:51.777299 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 999/2018] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 14:56:51 2022] DELETE /identity/v3/users/34c0f151ec0940449a2fb3e68b33925f => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:56:51.779203 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1020/2019] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:56:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 14:56:51.956369 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144e65e1-ed3e-48dd-9275-165463893ed8 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:51.959730 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-144e65e1-ed3e-48dd-9275-165463893ed8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:52.044443 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:52.098614 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144e65e1-ed3e-48dd-9275-165463893ed8 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:52.106399 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b0a761-561e-4ad2-98be-df31cb032c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:52.107169 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b0a761-561e-4ad2-98be-df31cb032c8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:52.107548 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b0a761-561e-4ad2-98be-df31cb032c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:52.108619 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b0a761-561e-4ad2-98be-df31cb032c8a admin admin] PATH_INFO: `/v3/projects/1adc5cf927a54bc9b8c4cb5f9edc7bf1` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:52.110352 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b0a761-561e-4ad2-98be-df31cb032c8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1adc5cf927a54bc9b8c4cb5f9edc7bf1)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:52.118179 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b0a761-561e-4ad2-98be-df31cb032c8a admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:52.201792 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcdf7bc-e360-4ba7-b071-a5f1acb97461 service placement] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:52.213921 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-30b0a761-561e-4ad2-98be-df31cb032c8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1adc5cf927a54bc9b8c4cb5f9edc7bf1', 'request_id': 'req-30b0a761-561e-4ad2-98be-df31cb032c8a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:52.219329 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcdf7bc-e360-4ba7-b071-a5f1acb97461 service placement] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:52.234869 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-30b0a761-561e-4ad2-98be-df31cb032c8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1adc5cf927a54bc9b8c4cb5f9edc7bf1', 'request_id': 'req-30b0a761-561e-4ad2-98be-df31cb032c8a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:52.244683 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-30b0a761-561e-4ad2-98be-df31cb032c8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1adc5cf927a54bc9b8c4cb5f9edc7bf1', 'request_id': 'req-30b0a761-561e-4ad2-98be-df31cb032c8a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:52.263669 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-30b0a761-561e-4ad2-98be-df31cb032c8a admin admin] The token cache is being invalidate because project 1adc5cf927a54bc9b8c4cb5f9edc7bf1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:56:52.263958 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-30b0a761-561e-4ad2-98be-df31cb032c8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:52.264606 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-30b0a761-561e-4ad2-98be-df31cb032c8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:52.266888 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1000/2020] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 14:56:51 2022] DELETE /identity/v3/projects/1adc5cf927a54bc9b8c4cb5f9edc7bf1 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:56:52.272285 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc6731-e0a4-4650-994b-37a602b8a733 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:52.273197 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc6731-e0a4-4650-994b-37a602b8a733 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:52.274036 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc6731-e0a4-4650-994b-37a602b8a733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:52.299197 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-acfc6731-e0a4-4650-994b-37a602b8a733 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:52.300434 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-acfc6731-e0a4-4650-994b-37a602b8a733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:52.310905 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04254c0b-3177-4bb0-ba3b-ed8037b8d4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:52.311687 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04254c0b-3177-4bb0-ba3b-ed8037b8d4a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:52.311990 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04254c0b-3177-4bb0-ba3b-ed8037b8d4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:52.312234 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04254c0b-3177-4bb0-ba3b-ed8037b8d4a3 admin admin] PATH_INFO: `/v3/projects/2e76bceadd264ae898111a05b4a42216` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:52.313606 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04254c0b-3177-4bb0-ba3b-ed8037b8d4a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e76bceadd264ae898111a05b4a42216)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:52.315513 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04254c0b-3177-4bb0-ba3b-ed8037b8d4a3 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:52.371250 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1001/2021] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:56:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 14:56:52.377402 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-04254c0b-3177-4bb0-ba3b-ed8037b8d4a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e76bceadd264ae898111a05b4a42216', 'request_id': 'req-04254c0b-3177-4bb0-ba3b-ed8037b8d4a3'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:52.381284 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11f63b5-c635-49cd-a9ee-edff412193db None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:52.381566 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11f63b5-c635-49cd-a9ee-edff412193db None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:52.381834 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11f63b5-c635-49cd-a9ee-edff412193db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:52.385677 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-04254c0b-3177-4bb0-ba3b-ed8037b8d4a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e76bceadd264ae898111a05b4a42216', 'request_id': 'req-04254c0b-3177-4bb0-ba3b-ed8037b8d4a3'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:52.394758 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-04254c0b-3177-4bb0-ba3b-ed8037b8d4a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e76bceadd264ae898111a05b4a42216', 'request_id': 'req-04254c0b-3177-4bb0-ba3b-ed8037b8d4a3'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:52.403442 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-d11f63b5-c635-49cd-a9ee-edff412193db None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:52.404651 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d11f63b5-c635-49cd-a9ee-edff412193db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:52.408454 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-04254c0b-3177-4bb0-ba3b-ed8037b8d4a3 admin admin] The token cache is being invalidate because project 2e76bceadd264ae898111a05b4a42216 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:56:52.409160 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-04254c0b-3177-4bb0-ba3b-ed8037b8d4a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:52.410232 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-04254c0b-3177-4bb0-ba3b-ed8037b8d4a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:52.411932 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1021/2022] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 14:56:52 2022] DELETE /identity/v3/projects/2e76bceadd264ae898111a05b4a42216 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:56:52.416822 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a8d06-a679-4709-81ed-de6ae3308bb7 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:52.417149 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a8d06-a679-4709-81ed-de6ae3308bb7 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:52.417428 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a8d06-a679-4709-81ed-de6ae3308bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:52.439305 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-406a8d06-a679-4709-81ed-de6ae3308bb7 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:52.440653 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-406a8d06-a679-4709-81ed-de6ae3308bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:52.466140 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:52.475818 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1002/2023] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:56:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:56:52.480139 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11f63b5-c635-49cd-a9ee-edff412193db None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:52.481774 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:52.491095 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11f63b5-c635-49cd-a9ee-edff412193db None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:52.498070 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbec5706-6bf4-4016-a3d8-5be3dd81eb0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:52.498843 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec5706-6bf4-4016-a3d8-5be3dd81eb0c admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:52.499125 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec5706-6bf4-4016-a3d8-5be3dd81eb0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:52.499434 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec5706-6bf4-4016-a3d8-5be3dd81eb0c admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:52.500206 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbec5706-6bf4-4016-a3d8-5be3dd81eb0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:56:52.500530 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbec5706-6bf4-4016-a3d8-5be3dd81eb0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:52.502586 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbec5706-6bf4-4016-a3d8-5be3dd81eb0c admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:52.513254 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1022/2024] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:56:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 14:56:52.520310 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1003/2025] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 19 14:56:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:56:52.523937 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b73f4b-5edc-4e5f-b6ff-7fe1a2e22809 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:52.524173 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b73f4b-5edc-4e5f-b6ff-7fe1a2e22809 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:52.524448 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b73f4b-5edc-4e5f-b6ff-7fe1a2e22809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:52.526181 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbec5706-6bf4-4016-a3d8-5be3dd81eb0c admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:52.536832 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbec5706-6bf4-4016-a3d8-5be3dd81eb0c admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:52.542651 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989f07b6-c436-4a9e-98e2-9d6f67f37deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:52.543300 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f07b6-c436-4a9e-98e2-9d6f67f37deb admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:52.543577 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f07b6-c436-4a9e-98e2-9d6f67f37deb admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:52.543850 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f07b6-c436-4a9e-98e2-9d6f67f37deb admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:52.544494 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989f07b6-c436-4a9e-98e2-9d6f67f37deb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:52.546534 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989f07b6-c436-4a9e-98e2-9d6f67f37deb admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:52.547244 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-00b73f4b-5edc-4e5f-b6ff-7fe1a2e22809 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:52.548824 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-00b73f4b-5edc-4e5f-b6ff-7fe1a2e22809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:52.557365 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1023/2026] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:56:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:56:52.562080 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b73f4b-5edc-4e5f-b6ff-7fe1a2e22809 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:52.573093 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b73f4b-5edc-4e5f-b6ff-7fe1a2e22809 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:52.579165 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4621e7cd-af6f-487f-9d83-431dd265a303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:52.579793 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4621e7cd-af6f-487f-9d83-431dd265a303 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:52.580077 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4621e7cd-af6f-487f-9d83-431dd265a303 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:52.580344 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4621e7cd-af6f-487f-9d83-431dd265a303 admin admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:52.581287 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4621e7cd-af6f-487f-9d83-431dd265a303 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:56:52.581590 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4621e7cd-af6f-487f-9d83-431dd265a303 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:52.582568 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1004/2027] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 14:56:52 2022] POST /identity/v3/projects => generated 389 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 14:56:52.583198 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4621e7cd-af6f-487f-9d83-431dd265a303 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:52.587146 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989f07b6-c436-4a9e-98e2-9d6f67f37deb admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:52.601038 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1024/2028] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 19 14:56:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:56:52.605777 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4621e7cd-af6f-487f-9d83-431dd265a303 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:52.617605 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4621e7cd-af6f-487f-9d83-431dd265a303 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:52.688393 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989f07b6-c436-4a9e-98e2-9d6f67f37deb admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:52.697151 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7bbb56-4019-44ec-bac2-583b3313012a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:52.697817 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7bbb56-4019-44ec-bac2-583b3313012a admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:52.701061 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7bbb56-4019-44ec-bac2-583b3313012a admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:52.701061 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7bbb56-4019-44ec-bac2-583b3313012a admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:52.701061 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7bbb56-4019-44ec-bac2-583b3313012a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:52.703299 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7bbb56-4019-44ec-bac2-583b3313012a admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:52.705043 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1806b599-15ad-4ce0-85dd-970f905e9ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:52.705798 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1806b599-15ad-4ce0-85dd-970f905e9ef0 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:52.706071 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1806b599-15ad-4ce0-85dd-970f905e9ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:52.706342 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1806b599-15ad-4ce0-85dd-970f905e9ef0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:52.706978 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1806b599-15ad-4ce0-85dd-970f905e9ef0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:52.710791 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1806b599-15ad-4ce0-85dd-970f905e9ef0 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:52.731255 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1005/2029] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 14:56:52 2022] POST /identity/v3/users => generated 295 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:56:52.736493 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7bbb56-4019-44ec-bac2-583b3313012a admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:52.746773 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1025/2030] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 14:56:52 2022] POST /identity/v3/projects => generated 403 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:56:52.750089 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7bbb56-4019-44ec-bac2-583b3313012a admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:52.750792 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1806b599-15ad-4ce0-85dd-970f905e9ef0 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:52.826116 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128fe555-338c-43a7-9c2d-734c0cd49ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:52.826972 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128fe555-338c-43a7-9c2d-734c0cd49ca2 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:52.827334 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128fe555-338c-43a7-9c2d-734c0cd49ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:52.827688 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128fe555-338c-43a7-9c2d-734c0cd49ca2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:52.828578 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128fe555-338c-43a7-9c2d-734c0cd49ca2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:52.831200 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128fe555-338c-43a7-9c2d-734c0cd49ca2 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:52.838893 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1806b599-15ad-4ce0-85dd-970f905e9ef0 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:52.843880 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea67ece-f45c-4bf2-94d5-969db1b587f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:52.844459 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea67ece-f45c-4bf2-94d5-969db1b587f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:52.844609 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1006/2031] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:56:52 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 14:56:52.844751 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea67ece-f45c-4bf2-94d5-969db1b587f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:52.845025 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea67ece-f45c-4bf2-94d5-969db1b587f0 admin admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:52.845658 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea67ece-f45c-4bf2-94d5-969db1b587f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:52.847588 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea67ece-f45c-4bf2-94d5-969db1b587f0 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:52.850906 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128fe555-338c-43a7-9c2d-734c0cd49ca2 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:52.862461 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128fe555-338c-43a7-9c2d-734c0cd49ca2 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:52.867490 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1fdede-2a7c-4b9e-9f6c-3e482a55fb62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:52.868281 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1fdede-2a7c-4b9e-9f6c-3e482a55fb62 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:52.868567 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1fdede-2a7c-4b9e-9f6c-3e482a55fb62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:52.869019 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1fdede-2a7c-4b9e-9f6c-3e482a55fb62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:52.869723 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1fdede-2a7c-4b9e-9f6c-3e482a55fb62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:52.871436 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1fdede-2a7c-4b9e-9f6c-3e482a55fb62 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:52.882556 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1026/2032] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 14:56:52 2022] POST /identity/v3/users => generated 302 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 14:56:52.883352 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1007/2033] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:56:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 14:56:52.887254 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea67ece-f45c-4bf2-94d5-969db1b587f0 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:52.887559 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1fdede-2a7c-4b9e-9f6c-3e482a55fb62 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:52.898474 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1fdede-2a7c-4b9e-9f6c-3e482a55fb62 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:52.903741 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd56523b-a593-47df-8fb3-5d44b183dc6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:52.904412 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd56523b-a593-47df-8fb3-5d44b183dc6d admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:52.904705 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd56523b-a593-47df-8fb3-5d44b183dc6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:52.904974 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd56523b-a593-47df-8fb3-5d44b183dc6d admin admin] PATH_INFO: `/v3/projects/15c5c5204adf4936bd3cc96393dac724/users/da8075adad894e84ac862671d5db30a8/roles/74de6794e3b3422b93d26f993d260c35` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:52.908388 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea67ece-f45c-4bf2-94d5-969db1b587f0 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:52.919102 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4cd3ec-c0a2-482e-86bd-6304a5f505cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:52.919883 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4cd3ec-c0a2-482e-86bd-6304a5f505cb admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:52.920158 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4cd3ec-c0a2-482e-86bd-6304a5f505cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:52.920436 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4cd3ec-c0a2-482e-86bd-6304a5f505cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:52.921188 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4cd3ec-c0a2-482e-86bd-6304a5f505cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:52.922849 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4cd3ec-c0a2-482e-86bd-6304a5f505cb admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:52.924072 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd56523b-a593-47df-8fb3-5d44b183dc6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=15c5c5204adf4936bd3cc96393dac724, user_id=da8075adad894e84ac862671d5db30a8, role_id=74de6794e3b3422b93d26f993d260c35)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:52.927080 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd56523b-a593-47df-8fb3-5d44b183dc6d admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:52.935520 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1027/2034] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:56:52 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 14:56:52.939559 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4cd3ec-c0a2-482e-86bd-6304a5f505cb admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:52.945619 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1008/2035] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 14:56:52 2022] PUT /identity/v3/projects/15c5c5204adf4936bd3cc96393dac724/users/da8075adad894e84ac862671d5db30a8/roles/74de6794e3b3422b93d26f993d260c35 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:56:52.950261 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4cd3ec-c0a2-482e-86bd-6304a5f505cb admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:52.957310 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf307021-0634-4ea3-9080-23c3574dec9b None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:52.957667 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf307021-0634-4ea3-9080-23c3574dec9b None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:52.957939 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf307021-0634-4ea3-9080-23c3574dec9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:52.974039 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:53.000369 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-bf307021-0634-4ea3-9080-23c3574dec9b None None] MFA Rules not processed for user `da8075adad894e84ac862671d5db30a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:53.001596 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-bf307021-0634-4ea3-9080-23c3574dec9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:53.005629 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:53.023586 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1661b0d4-55ec-4aa9-88a5-826ea7457070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:53.023836 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1661b0d4-55ec-4aa9-88a5-826ea7457070 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:53.024094 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1661b0d4-55ec-4aa9-88a5-826ea7457070 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:53.024356 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1661b0d4-55ec-4aa9-88a5-826ea7457070 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:53.025009 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1661b0d4-55ec-4aa9-88a5-826ea7457070 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:53.026609 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1661b0d4-55ec-4aa9-88a5-826ea7457070 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:53.036699 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1028/2036] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:56:52 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 14:56:53.041012 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1661b0d4-55ec-4aa9-88a5-826ea7457070 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:53.051153 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1661b0d4-55ec-4aa9-88a5-826ea7457070 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:53.056490 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf11315-8ed3-493d-aa29-72a231b4c755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:53.057186 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf11315-8ed3-493d-aa29-72a231b4c755 admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:53.057518 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf11315-8ed3-493d-aa29-72a231b4c755 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:53.057795 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf11315-8ed3-493d-aa29-72a231b4c755 admin admin] PATH_INFO: `/v3/projects/1a9e65c7d41849e4817f5f53c76114ba/users/6d688f931f2746c4b5d5fffca57cdd0a/roles/74de6794e3b3422b93d26f993d260c35` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:53.072252 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1009/2037] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:56:52 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 14:56:53.073809 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf11315-8ed3-493d-aa29-72a231b4c755 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a9e65c7d41849e4817f5f53c76114ba, user_id=6d688f931f2746c4b5d5fffca57cdd0a, role_id=74de6794e3b3422b93d26f993d260c35)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:53.076560 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf11315-8ed3-493d-aa29-72a231b4c755 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:53.083649 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf307021-0634-4ea3-9080-23c3574dec9b None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:53.085295 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-bf307021-0634-4ea3-9080-23c3574dec9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:53.094960 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1029/2038] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 14:56:53 2022] PUT /identity/v3/projects/1a9e65c7d41849e4817f5f53c76114ba/users/6d688f931f2746c4b5d5fffca57cdd0a/roles/74de6794e3b3422b93d26f993d260c35 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:56:53.099858 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f7084-b9a8-45b0-9858-aa38bbb2248d None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:53.100134 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f7084-b9a8-45b0-9858-aa38bbb2248d None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:53.100396 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f7084-b9a8-45b0-9858-aa38bbb2248d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:53.120791 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-2f4f7084-b9a8-45b0-9858-aa38bbb2248d None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:53.122018 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-2f4f7084-b9a8-45b0-9858-aa38bbb2248d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:53.155452 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf307021-0634-4ea3-9080-23c3574dec9b None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:53.201228 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1030/2039] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:56:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 14:56:53.213631 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4f7084-b9a8-45b0-9858-aa38bbb2248d None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:53.215783 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-2f4f7084-b9a8-45b0-9858-aa38bbb2248d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:53.226722 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c226c-9cbe-4989-b7d9-06c0b0a0d65e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df648c909ddb41418128b43f925f5ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:53.227488 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c226c-9cbe-4989-b7d9-06c0b0a0d65e service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:53.227752 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c226c-9cbe-4989-b7d9-06c0b0a0d65e service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:53.228257 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c226c-9cbe-4989-b7d9-06c0b0a0d65e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:53.297194 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4f7084-b9a8-45b0-9858-aa38bbb2248d None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:53.303170 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c213c5-db2d-4c58-9717-d2b361ebc9b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:53.303794 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c213c5-db2d-4c58-9717-d2b361ebc9b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:53.304105 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c213c5-db2d-4c58-9717-d2b361ebc9b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:53.304381 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c213c5-db2d-4c58-9717-d2b361ebc9b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:53.317997 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061c226c-9cbe-4989-b7d9-06c0b0a0d65e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:53.318216 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c213c5-db2d-4c58-9717-d2b361ebc9b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:53.319796 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061c226c-9cbe-4989-b7d9-06c0b0a0d65e service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:53.320027 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c213c5-db2d-4c58-9717-d2b361ebc9b2 service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:53.330589 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1010/2040] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:56:53 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 14:56:53.341278 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1031/2041] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:56:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:56:53.972403 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c226c-9cbe-4989-b7d9-06c0b0a0d65e service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:53.974161 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-061c226c-9cbe-4989-b7d9-06c0b0a0d65e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:53.990268 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c226c-9cbe-4989-b7d9-06c0b0a0d65e service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:53.996981 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c5536f-8073-4c43-a791-976a138757a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:53.997749 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c5536f-8073-4c43-a791-976a138757a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:53.998078 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c5536f-8073-4c43-a791-976a138757a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:53.998967 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c5536f-8073-4c43-a791-976a138757a7 admin admin] PATH_INFO: `/v3/users/2251fc23021742a4ab597fac69e8f0c8` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:53.999811 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c5536f-8073-4c43-a791-976a138757a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2251fc23021742a4ab597fac69e8f0c8)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:54.002066 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c5536f-8073-4c43-a791-976a138757a7 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:54.014070 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:54.056857 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-d2c5536f-8073-4c43-a791-976a138757a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2251fc23021742a4ab597fac69e8f0c8'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:54.070543 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-d2c5536f-8073-4c43-a791-976a138757a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2251fc23021742a4ab597fac69e8f0c8'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:54.071221 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-d2c5536f-8073-4c43-a791-976a138757a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2251fc23021742a4ab597fac69e8f0c8'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:54.071832 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-d2c5536f-8073-4c43-a791-976a138757a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2251fc23021742a4ab597fac69e8f0c8'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:54.075324 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b5f903-b85a-42a2-88aa-2443a40a70bb None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:54.075807 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b5f903-b85a-42a2-88aa-2443a40a70bb None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:54.076042 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b5f903-b85a-42a2-88aa-2443a40a70bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:54.082620 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-d2c5536f-8073-4c43-a791-976a138757a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2251fc23021742a4ab597fac69e8f0c8'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:54.104551 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1011/2042] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 14:56:53 2022] DELETE /identity/v3/users/2251fc23021742a4ab597fac69e8f0c8 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:56:54.109013 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d413dcdd-322a-4a1d-8f5b-a37236727a5f None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:54.109646 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d413dcdd-322a-4a1d-8f5b-a37236727a5f None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:54.109935 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d413dcdd-322a-4a1d-8f5b-a37236727a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:54.110970 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-a6b5f903-b85a-42a2-88aa-2443a40a70bb None None] MFA Rules not processed for user `6d688f931f2746c4b5d5fffca57cdd0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:54.112048 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-a6b5f903-b85a-42a2-88aa-2443a40a70bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:54.133046 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-d413dcdd-322a-4a1d-8f5b-a37236727a5f None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:54.134279 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d413dcdd-322a-4a1d-8f5b-a37236727a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:54.150975 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:54.203370 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1032/2043] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:56:54 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 14:56:54.207864 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b5f903-b85a-42a2-88aa-2443a40a70bb None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:54.209547 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-a6b5f903-b85a-42a2-88aa-2443a40a70bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:54.214738 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1012/2044] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:56:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:56:54.226976 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d413dcdd-322a-4a1d-8f5b-a37236727a5f None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:54.227298 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b5f903-b85a-42a2-88aa-2443a40a70bb None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:54.230005 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d413dcdd-322a-4a1d-8f5b-a37236727a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:54.232745 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a2a6f2-f9e0-46a2-b40d-4ee8e27e00bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:54.233827 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a2a6f2-f9e0-46a2-b40d-4ee8e27e00bf admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:54.233827 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a2a6f2-f9e0-46a2-b40d-4ee8e27e00bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:54.234135 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a2a6f2-f9e0-46a2-b40d-4ee8e27e00bf admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:54.234566 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a2a6f2-f9e0-46a2-b40d-4ee8e27e00bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:54.236918 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a2a6f2-f9e0-46a2-b40d-4ee8e27e00bf admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:54.279025 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1033/2045] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 14:56:54 2022] POST /identity/v3/projects => generated 405 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:56:54.283111 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a2a6f2-f9e0-46a2-b40d-4ee8e27e00bf admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:54.296771 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d413dcdd-322a-4a1d-8f5b-a37236727a5f None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:54.340305 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:54.351438 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d10c15d-b7c8-427e-910c-d6f223b8bff8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:54.351844 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d10c15d-b7c8-427e-910c-d6f223b8bff8 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:54.352342 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d10c15d-b7c8-427e-910c-d6f223b8bff8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:54.352615 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d10c15d-b7c8-427e-910c-d6f223b8bff8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:54.358864 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a2a6f2-f9e0-46a2-b40d-4ee8e27e00bf admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:54.361824 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d10c15d-b7c8-427e-910c-d6f223b8bff8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:54.363295 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d10c15d-b7c8-427e-910c-d6f223b8bff8 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:54.363539 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6044f2a-c65c-4bfc-837d-35645fc7b26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:54.364143 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6044f2a-c65c-4bfc-837d-35645fc7b26d admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:54.364421 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6044f2a-c65c-4bfc-837d-35645fc7b26d admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:54.364693 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6044f2a-c65c-4bfc-837d-35645fc7b26d admin admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:54.365363 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6044f2a-c65c-4bfc-837d-35645fc7b26d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:54.367558 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6044f2a-c65c-4bfc-837d-35645fc7b26d admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:54.373383 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1013/2046] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:56:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:56:54.390720 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1034/2047] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 14:56:54 2022] POST /identity/v3/users => generated 309 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 14:56:54.394882 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d10c15d-b7c8-427e-910c-d6f223b8bff8 service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:54.405541 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d10c15d-b7c8-427e-910c-d6f223b8bff8 service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:54.414201 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafb1be3-cae1-45db-91e7-58032d3c09e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:54.414542 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb1be3-cae1-45db-91e7-58032d3c09e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:54.414844 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb1be3-cae1-45db-91e7-58032d3c09e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:54.415165 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb1be3-cae1-45db-91e7-58032d3c09e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:54.416116 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafb1be3-cae1-45db-91e7-58032d3c09e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:54.417705 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafb1be3-cae1-45db-91e7-58032d3c09e1 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:54.429730 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1014/2048] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:56:54 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:56:54.434228 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6044f2a-c65c-4bfc-837d-35645fc7b26d admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:54.447573 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6044f2a-c65c-4bfc-837d-35645fc7b26d admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:54.452042 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f785033-bd0d-4f72-a511-3c9f864b1d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:54.452865 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f785033-bd0d-4f72-a511-3c9f864b1d54 admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:54.453294 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f785033-bd0d-4f72-a511-3c9f864b1d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:54.453888 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f785033-bd0d-4f72-a511-3c9f864b1d54 admin admin] PATH_INFO: `/v3/projects/dcedf500529c4bd9be55ac6a18694b51/users/6fde4687e4764e13b2ec672a5d7823e0/roles/019bde1756cb40de8ce06cef6b261f79` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:54.473066 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f785033-bd0d-4f72-a511-3c9f864b1d54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcedf500529c4bd9be55ac6a18694b51, user_id=6fde4687e4764e13b2ec672a5d7823e0, role_id=019bde1756cb40de8ce06cef6b261f79)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:54.476585 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f785033-bd0d-4f72-a511-3c9f864b1d54 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:54.493192 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1035/2049] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 14:56:54 2022] PUT /identity/v3/projects/dcedf500529c4bd9be55ac6a18694b51/users/6fde4687e4764e13b2ec672a5d7823e0/roles/019bde1756cb40de8ce06cef6b261f79 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:56:54.497155 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafb1be3-cae1-45db-91e7-58032d3c09e1 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:54.510584 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafb1be3-cae1-45db-91e7-58032d3c09e1 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:54.582805 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488725aa-7444-4d6b-8507-b1250998574b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:54.583745 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488725aa-7444-4d6b-8507-b1250998574b admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:54.584441 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488725aa-7444-4d6b-8507-b1250998574b admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:54.585363 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488725aa-7444-4d6b-8507-b1250998574b admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:54.586046 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488725aa-7444-4d6b-8507-b1250998574b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:54.587692 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488725aa-7444-4d6b-8507-b1250998574b admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:54.598179 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1015/2050] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:56:54 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:56:54.602868 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f785033-bd0d-4f72-a511-3c9f864b1d54 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:54.618627 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f785033-bd0d-4f72-a511-3c9f864b1d54 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:54.625779 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ad48b-21ae-4453-a6c2-6d56ec507cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:54.626425 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ad48b-21ae-4453-a6c2-6d56ec507cee admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:54.626765 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ad48b-21ae-4453-a6c2-6d56ec507cee admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:54.627110 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ad48b-21ae-4453-a6c2-6d56ec507cee admin admin] PATH_INFO: `/v3/projects/dcedf500529c4bd9be55ac6a18694b51/users/6fde4687e4764e13b2ec672a5d7823e0/roles/019bde1756cb40de8ce06cef6b261f79` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:54.629253 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505ad48b-21ae-4453-a6c2-6d56ec507cee admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcedf500529c4bd9be55ac6a18694b51, user_id=6fde4687e4764e13b2ec672a5d7823e0, role_id=019bde1756cb40de8ce06cef6b261f79)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:54.634312 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505ad48b-21ae-4453-a6c2-6d56ec507cee admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:54.649213 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1036/2051] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 14:56:54 2022] PUT /identity/v3/projects/dcedf500529c4bd9be55ac6a18694b51/users/6fde4687e4764e13b2ec672a5d7823e0/roles/019bde1756cb40de8ce06cef6b261f79 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 14:56:54.842696 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488725aa-7444-4d6b-8507-b1250998574b admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:54.844770 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-488725aa-7444-4d6b-8507-b1250998574b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:54.861516 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488725aa-7444-4d6b-8507-b1250998574b admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:54.934632 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaa919b-a530-4e30-8e82-08eb139e1bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:54.935276 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaa919b-a530-4e30-8e82-08eb139e1bf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:54.935743 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaa919b-a530-4e30-8e82-08eb139e1bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:54.936019 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaa919b-a530-4e30-8e82-08eb139e1bf1 admin admin] PATH_INFO: `/v3/projects/0ac59d24f4034c149f00b3e7e7fa371f` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:54.937205 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaa919b-a530-4e30-8e82-08eb139e1bf1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ac59d24f4034c149f00b3e7e7fa371f)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:54.939156 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaa919b-a530-4e30-8e82-08eb139e1bf1 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:55.020475 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ddaa919b-a530-4e30-8e82-08eb139e1bf1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ac59d24f4034c149f00b3e7e7fa371f', 'request_id': 'req-ddaa919b-a530-4e30-8e82-08eb139e1bf1'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:55.029018 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ddaa919b-a530-4e30-8e82-08eb139e1bf1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ac59d24f4034c149f00b3e7e7fa371f', 'request_id': 'req-ddaa919b-a530-4e30-8e82-08eb139e1bf1'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:55.038347 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ddaa919b-a530-4e30-8e82-08eb139e1bf1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ac59d24f4034c149f00b3e7e7fa371f', 'request_id': 'req-ddaa919b-a530-4e30-8e82-08eb139e1bf1'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:55.051342 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ddaa919b-a530-4e30-8e82-08eb139e1bf1 admin admin] The token cache is being invalidate because project 0ac59d24f4034c149f00b3e7e7fa371f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:56:55.051628 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ddaa919b-a530-4e30-8e82-08eb139e1bf1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:55.052777 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ddaa919b-a530-4e30-8e82-08eb139e1bf1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:55.054164 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1016/2052] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 14:56:54 2022] DELETE /identity/v3/projects/0ac59d24f4034c149f00b3e7e7fa371f => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:56:55.058859 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ad48b-21ae-4453-a6c2-6d56ec507cee admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:55.060722 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-505ad48b-21ae-4453-a6c2-6d56ec507cee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:55.074735 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ad48b-21ae-4453-a6c2-6d56ec507cee admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:55.145624 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f0de4d-4a3d-4fb0-90be-abf6daa06472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:55.146372 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0de4d-4a3d-4fb0-90be-abf6daa06472 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:55.146758 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0de4d-4a3d-4fb0-90be-abf6daa06472 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:55.147101 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0de4d-4a3d-4fb0-90be-abf6daa06472 admin admin] PATH_INFO: `/v3/users/747aff475dab40b49c08b54083cb4544` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:55.149420 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f0de4d-4a3d-4fb0-90be-abf6daa06472 admin admin] RBAC: Authorizing `identity:delete_user(user_id=747aff475dab40b49c08b54083cb4544)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:55.151566 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f0de4d-4a3d-4fb0-90be-abf6daa06472 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:55.153630 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:55.223942 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-83f0de4d-4a3d-4fb0-90be-abf6daa06472 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '747aff475dab40b49c08b54083cb4544'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:55.232412 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-83f0de4d-4a3d-4fb0-90be-abf6daa06472 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '747aff475dab40b49c08b54083cb4544'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:55.233133 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-83f0de4d-4a3d-4fb0-90be-abf6daa06472 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '747aff475dab40b49c08b54083cb4544'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:55.233847 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-83f0de4d-4a3d-4fb0-90be-abf6daa06472 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '747aff475dab40b49c08b54083cb4544'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:55.247195 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-83f0de4d-4a3d-4fb0-90be-abf6daa06472 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '747aff475dab40b49c08b54083cb4544'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:55.260097 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1037/2053] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 14:56:55 2022] DELETE /identity/v3/users/747aff475dab40b49c08b54083cb4544 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:56:55.589381 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd58347-4577-405c-82a1-3720bf2e7055 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:55.589916 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd58347-4577-405c-82a1-3720bf2e7055 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:55.590531 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd58347-4577-405c-82a1-3720bf2e7055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:55.598795 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:55.633328 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-5bd58347-4577-405c-82a1-3720bf2e7055 None None] MFA Rules not processed for user `6fde4687e4764e13b2ec672a5d7823e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:55.634730 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-5bd58347-4577-405c-82a1-3720bf2e7055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:55.722591 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1017/2054] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:56:55 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 14:56:55.780576 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f0de4d-4a3d-4fb0-90be-abf6daa06472 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:55.782042 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-83f0de4d-4a3d-4fb0-90be-abf6daa06472 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:55.881469 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f0de4d-4a3d-4fb0-90be-abf6daa06472 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:55.886747 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3d0d85-921b-4973-8dcd-62c3fa94fe36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:55.887382 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3d0d85-921b-4973-8dcd-62c3fa94fe36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:55.887654 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3d0d85-921b-4973-8dcd-62c3fa94fe36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:55.887922 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3d0d85-921b-4973-8dcd-62c3fa94fe36 admin admin] PATH_INFO: `/v3/projects/6851148740854545bd3f3d19ff413c68` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:55.889095 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3d0d85-921b-4973-8dcd-62c3fa94fe36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6851148740854545bd3f3d19ff413c68)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:55.891297 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3d0d85-921b-4973-8dcd-62c3fa94fe36 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:55.964275 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-5d3d0d85-921b-4973-8dcd-62c3fa94fe36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6851148740854545bd3f3d19ff413c68', 'request_id': 'req-5d3d0d85-921b-4973-8dcd-62c3fa94fe36'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:55.972752 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-5d3d0d85-921b-4973-8dcd-62c3fa94fe36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6851148740854545bd3f3d19ff413c68', 'request_id': 'req-5d3d0d85-921b-4973-8dcd-62c3fa94fe36'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:55.983890 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-5d3d0d85-921b-4973-8dcd-62c3fa94fe36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6851148740854545bd3f3d19ff413c68', 'request_id': 'req-5d3d0d85-921b-4973-8dcd-62c3fa94fe36'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:56.033253 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-5d3d0d85-921b-4973-8dcd-62c3fa94fe36 admin admin] The token cache is being invalidate because project 6851148740854545bd3f3d19ff413c68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:56:56.033253 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-5d3d0d85-921b-4973-8dcd-62c3fa94fe36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:56.033253 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-5d3d0d85-921b-4973-8dcd-62c3fa94fe36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:56.033253 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1038/2055] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 14:56:55 2022] DELETE /identity/v3/projects/6851148740854545bd3f3d19ff413c68 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:56:56.033629 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a0c432-27d8-495a-aa83-193bae57730e None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:56.033629 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a0c432-27d8-495a-aa83-193bae57730e None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:56.033629 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a0c432-27d8-495a-aa83-193bae57730e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:56.084639 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-24a0c432-27d8-495a-aa83-193bae57730e None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:56.087213 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-24a0c432-27d8-495a-aa83-193bae57730e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:56.188515 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1018/2056] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:56:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:56:56.190562 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469cd341-ed95-4b77-9c78-92f831400a07 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:56.191186 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469cd341-ed95-4b77-9c78-92f831400a07 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:56.191186 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469cd341-ed95-4b77-9c78-92f831400a07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:56.215001 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-469cd341-ed95-4b77-9c78-92f831400a07 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:56.216624 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-469cd341-ed95-4b77-9c78-92f831400a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:56.230839 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1039/2057] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:56:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 14:56:56.233876 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a0c432-27d8-495a-aa83-193bae57730e None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:56.246870 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a0c432-27d8-495a-aa83-193bae57730e None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:56.253458 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9694eff5-d017-44e4-a1d8-185e297e79f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:56.254709 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9694eff5-d017-44e4-a1d8-185e297e79f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:56.255226 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9694eff5-d017-44e4-a1d8-185e297e79f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:56.255635 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9694eff5-d017-44e4-a1d8-185e297e79f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:56.257396 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9694eff5-d017-44e4-a1d8-185e297e79f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:56:56.258044 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9694eff5-d017-44e4-a1d8-185e297e79f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:56.260900 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9694eff5-d017-44e4-a1d8-185e297e79f8 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:56.278336 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1019/2058] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 19 14:56:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:56:56.282799 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469cd341-ed95-4b77-9c78-92f831400a07 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:56.287653 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:56.295308 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469cd341-ed95-4b77-9c78-92f831400a07 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:56.301358 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826ce50e-dbd3-40c4-a910-71cc0e1a7ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:56.302144 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826ce50e-dbd3-40c4-a910-71cc0e1a7ca8 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:56.302682 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826ce50e-dbd3-40c4-a910-71cc0e1a7ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:56.303046 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826ce50e-dbd3-40c4-a910-71cc0e1a7ca8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:56.303894 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826ce50e-dbd3-40c4-a910-71cc0e1a7ca8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:56.306341 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826ce50e-dbd3-40c4-a910-71cc0e1a7ca8 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:56.340843 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1040/2059] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 14:56:56 2022] POST /identity/v3/projects => generated 399 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:56:56.344802 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9694eff5-d017-44e4-a1d8-185e297e79f8 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:56.356645 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9694eff5-d017-44e4-a1d8-185e297e79f8 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:56.421890 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e3095d-fcac-4195-907c-31beaa08fd39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:56.422489 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e3095d-fcac-4195-907c-31beaa08fd39 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:56.422762 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e3095d-fcac-4195-907c-31beaa08fd39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:56.423027 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e3095d-fcac-4195-907c-31beaa08fd39 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:56.423680 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e3095d-fcac-4195-907c-31beaa08fd39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:56.425665 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e3095d-fcac-4195-907c-31beaa08fd39 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:56.450901 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1020/2060] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 14:56:56 2022] POST /identity/v3/users => generated 300 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 14:56:56.452571 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826ce50e-dbd3-40c4-a910-71cc0e1a7ca8 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:56.463645 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826ce50e-dbd3-40c4-a910-71cc0e1a7ca8 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:56.468522 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a598ce-ea0d-4659-9e6f-f0c777cd11ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:56.469097 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a598ce-ea0d-4659-9e6f-f0c777cd11ce admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:56.469371 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a598ce-ea0d-4659-9e6f-f0c777cd11ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:56.469637 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a598ce-ea0d-4659-9e6f-f0c777cd11ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:56.470303 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a598ce-ea0d-4659-9e6f-f0c777cd11ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:56.471909 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a598ce-ea0d-4659-9e6f-f0c777cd11ce admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:56.483373 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1041/2061] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:56:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 14:56:56.489958 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e3095d-fcac-4195-907c-31beaa08fd39 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:56.497088 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:56.501846 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e3095d-fcac-4195-907c-31beaa08fd39 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:56.508252 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce5146a-1aee-4260-bd51-8cd4a158b93d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:56.508900 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce5146a-1aee-4260-bd51-8cd4a158b93d admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:56.509213 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce5146a-1aee-4260-bd51-8cd4a158b93d admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:56.509461 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce5146a-1aee-4260-bd51-8cd4a158b93d admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:56.509687 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01602ed-4d1a-40e5-98b4-1979599e7629 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:56.509981 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01602ed-4d1a-40e5-98b4-1979599e7629 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:56.510140 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce5146a-1aee-4260-bd51-8cd4a158b93d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:56.510236 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01602ed-4d1a-40e5-98b4-1979599e7629 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:56.512098 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce5146a-1aee-4260-bd51-8cd4a158b93d admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:56.512210 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1042/2062] 10.222.0.26 () {54 vars in 921 bytes} [Mon Sep 19 14:56:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 14:56:56.524345 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1021/2063] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:56:56 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:56:56.528701 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01602ed-4d1a-40e5-98b4-1979599e7629 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:56.529150 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a3fffd-0bd2-4f0c-9474-33170fbaa531 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:56.529434 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a3fffd-0bd2-4f0c-9474-33170fbaa531 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:56.529701 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a3fffd-0bd2-4f0c-9474-33170fbaa531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:56.546204 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01602ed-4d1a-40e5-98b4-1979599e7629 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:56.550597 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-b7a3fffd-0bd2-4f0c-9474-33170fbaa531 None None] MFA Rules not processed for user `da0a58c526f34afda909e4ede2b1e1c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:56.551370 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5b81e6-d4cf-4c4e-a4df-ac5a997a647c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:56.551779 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b7a3fffd-0bd2-4f0c-9474-33170fbaa531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:56.552149 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b81e6-d4cf-4c4e-a4df-ac5a997a647c admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:56.552651 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b81e6-d4cf-4c4e-a4df-ac5a997a647c admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:56.552812 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b81e6-d4cf-4c4e-a4df-ac5a997a647c admin admin] PATH_INFO: `/v3/projects/020371df397e46cbbec2e3f4d8d0d081/users/a6eb725c7afa4b2e8adcade9f00e6281/roles/74de6794e3b3422b93d26f993d260c35` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:56.572345 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5b81e6-d4cf-4c4e-a4df-ac5a997a647c admin admin] RBAC: Authorizing `identity:create_grant(project_id=020371df397e46cbbec2e3f4d8d0d081, user_id=a6eb725c7afa4b2e8adcade9f00e6281, role_id=74de6794e3b3422b93d26f993d260c35)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:56.575100 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5b81e6-d4cf-4c4e-a4df-ac5a997a647c admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:56.600432 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1043/2064] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 14:56:56 2022] PUT /identity/v3/projects/020371df397e46cbbec2e3f4d8d0d081/users/a6eb725c7afa4b2e8adcade9f00e6281/roles/74de6794e3b3422b93d26f993d260c35 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:56:56.614973 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e42757-1d5c-434f-832c-c0005f3380ee None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:56.615785 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e42757-1d5c-434f-832c-c0005f3380ee None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:56.616561 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e42757-1d5c-434f-832c-c0005f3380ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:56.631769 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1022/2065] 10.222.0.26 () {58 vars in 1018 bytes} [Mon Sep 19 14:56:56 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:56:56.650554 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-f1e42757-1d5c-434f-832c-c0005f3380ee None None] MFA Rules not processed for user `a6eb725c7afa4b2e8adcade9f00e6281`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:56.651874 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a3fffd-0bd2-4f0c-9474-33170fbaa531 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:56.652803 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-f1e42757-1d5c-434f-832c-c0005f3380ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:56.653362 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b7a3fffd-0bd2-4f0c-9474-33170fbaa531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:56.669795 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a3fffd-0bd2-4f0c-9474-33170fbaa531 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:56.746802 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1044/2066] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:56:56 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:56:56.751155 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e42757-1d5c-434f-832c-c0005f3380ee None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:56.756723 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3892a95c-4e57-4c6b-8877-912a713c3d4f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da0a58c526f34afda909e4ede2b1e1c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:56.758083 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3892a95c-4e57-4c6b-8877-912a713c3d4f service placement] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:56.758083 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3892a95c-4e57-4c6b-8877-912a713c3d4f service placement] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:56.758514 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3892a95c-4e57-4c6b-8877-912a713c3d4f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:56.771982 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3892a95c-4e57-4c6b-8877-912a713c3d4f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:56.774696 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3892a95c-4e57-4c6b-8877-912a713c3d4f service placement] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:56.789263 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1023/2067] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:56:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 14:56:56.831154 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e42757-1d5c-434f-832c-c0005f3380ee None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:56.836359 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae0e477-b7c6-412c-88b1-7d3627bb7f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:56.837122 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae0e477-b7c6-412c-88b1-7d3627bb7f38 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:56.837505 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae0e477-b7c6-412c-88b1-7d3627bb7f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:56.837777 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae0e477-b7c6-412c-88b1-7d3627bb7f38 admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:56.838521 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae0e477-b7c6-412c-88b1-7d3627bb7f38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:56.840806 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae0e477-b7c6-412c-88b1-7d3627bb7f38 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:56.872084 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1045/2068] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 14:56:56 2022] POST /identity/v3/projects => generated 401 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 14:56:56.876587 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3892a95c-4e57-4c6b-8877-912a713c3d4f service placement] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:56.889542 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3892a95c-4e57-4c6b-8877-912a713c3d4f service placement] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:56.972265 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f0e675-1d66-4375-9d51-44f0f8cc6a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:56.972960 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f0e675-1d66-4375-9d51-44f0f8cc6a6f admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:56.973879 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f0e675-1d66-4375-9d51-44f0f8cc6a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:56.973879 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f0e675-1d66-4375-9d51-44f0f8cc6a6f admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:56.974160 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f0e675-1d66-4375-9d51-44f0f8cc6a6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:56.976301 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f0e675-1d66-4375-9d51-44f0f8cc6a6f admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:57.013553 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1024/2069] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 14:56:56 2022] POST /identity/v3/users => generated 307 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:56:57.017674 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae0e477-b7c6-412c-88b1-7d3627bb7f38 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:57.029230 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae0e477-b7c6-412c-88b1-7d3627bb7f38 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:57.034092 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56a8102-0d78-4d00-a5b6-aade9f72bb7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:57.034703 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a8102-0d78-4d00-a5b6-aade9f72bb7e admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:57.034981 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a8102-0d78-4d00-a5b6-aade9f72bb7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:57.035250 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a8102-0d78-4d00-a5b6-aade9f72bb7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:57.035896 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56a8102-0d78-4d00-a5b6-aade9f72bb7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:57.037549 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56a8102-0d78-4d00-a5b6-aade9f72bb7e admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:57.050421 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1046/2070] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:56:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:56:57.054339 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f0e675-1d66-4375-9d51-44f0f8cc6a6f admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:57.067644 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f0e675-1d66-4375-9d51-44f0f8cc6a6f admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:57.077879 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8f3217-842e-4efc-8f75-31106b7aea28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:57.086239 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f3217-842e-4efc-8f75-31106b7aea28 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:57.086627 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f3217-842e-4efc-8f75-31106b7aea28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:57.086963 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f3217-842e-4efc-8f75-31106b7aea28 admin admin] PATH_INFO: `/v3/projects/f6aba2a7f7d34b6b9e0dd1d33a31b723/users/a1a3d0e6c08b4695b4eb8c15b2ba80be/roles/019bde1756cb40de8ce06cef6b261f79` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:57.090662 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:57.110303 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8f3217-842e-4efc-8f75-31106b7aea28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6aba2a7f7d34b6b9e0dd1d33a31b723, user_id=a1a3d0e6c08b4695b4eb8c15b2ba80be, role_id=019bde1756cb40de8ce06cef6b261f79)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:57.115345 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8f3217-842e-4efc-8f75-31106b7aea28 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:57.156895 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1025/2071] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 14:56:57 2022] PUT /identity/v3/projects/f6aba2a7f7d34b6b9e0dd1d33a31b723/users/a1a3d0e6c08b4695b4eb8c15b2ba80be/roles/019bde1756cb40de8ce06cef6b261f79 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:56:57.158291 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56a8102-0d78-4d00-a5b6-aade9f72bb7e admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:57.169159 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56a8102-0d78-4d00-a5b6-aade9f72bb7e admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:57.174799 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:57.251942 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547f83f1-df77-484f-b09f-20a7a17e565f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:57.253910 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f83f1-df77-484f-b09f-20a7a17e565f admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:57.253910 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f83f1-df77-484f-b09f-20a7a17e565f admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:57.253910 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f83f1-df77-484f-b09f-20a7a17e565f admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:57.254824 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547f83f1-df77-484f-b09f-20a7a17e565f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:57.256760 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547f83f1-df77-484f-b09f-20a7a17e565f admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:57.272277 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1047/2072] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:56:57 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:56:57.273808 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8f3217-842e-4efc-8f75-31106b7aea28 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:57.286325 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8f3217-842e-4efc-8f75-31106b7aea28 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:57.292162 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1734446-c9e5-4866-9817-9c7ab15f115d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:57.294243 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1734446-c9e5-4866-9817-9c7ab15f115d admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:57.294588 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1734446-c9e5-4866-9817-9c7ab15f115d admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:57.294981 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1734446-c9e5-4866-9817-9c7ab15f115d admin admin] PATH_INFO: `/v3/projects/f6aba2a7f7d34b6b9e0dd1d33a31b723/users/a1a3d0e6c08b4695b4eb8c15b2ba80be/roles/019bde1756cb40de8ce06cef6b261f79` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:57.297232 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1734446-c9e5-4866-9817-9c7ab15f115d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6aba2a7f7d34b6b9e0dd1d33a31b723, user_id=a1a3d0e6c08b4695b4eb8c15b2ba80be, role_id=019bde1756cb40de8ce06cef6b261f79)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:57.300092 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1734446-c9e5-4866-9817-9c7ab15f115d admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:57.314623 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1026/2073] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 14:56:57 2022] PUT /identity/v3/projects/f6aba2a7f7d34b6b9e0dd1d33a31b723/users/a1a3d0e6c08b4695b4eb8c15b2ba80be/roles/019bde1756cb40de8ce06cef6b261f79 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:56:57.330173 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b599a-5846-4edc-b5e9-c941aeda9aba None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:57.330621 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b599a-5846-4edc-b5e9-c941aeda9aba None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:57.331063 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b599a-5846-4edc-b5e9-c941aeda9aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:57.383352 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1734446-c9e5-4866-9817-9c7ab15f115d admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:57.385330 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e1734446-c9e5-4866-9817-9c7ab15f115d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:57.408031 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-217b599a-5846-4edc-b5e9-c941aeda9aba None None] MFA Rules not processed for user `a1a3d0e6c08b4695b4eb8c15b2ba80be`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:57.410354 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-217b599a-5846-4edc-b5e9-c941aeda9aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:57.513236 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1048/2074] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:56:57 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 14:56:57.514055 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1734446-c9e5-4866-9817-9c7ab15f115d admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:57.528328 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb197a4c-5b2d-4789-8fed-734eb905ebe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:57.528979 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb197a4c-5b2d-4789-8fed-734eb905ebe5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:57.529280 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb197a4c-5b2d-4789-8fed-734eb905ebe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:57.530217 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb197a4c-5b2d-4789-8fed-734eb905ebe5 admin admin] PATH_INFO: `/v3/users/6d688f931f2746c4b5d5fffca57cdd0a` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:57.531364 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb197a4c-5b2d-4789-8fed-734eb905ebe5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d688f931f2746c4b5d5fffca57cdd0a)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:57.534302 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb197a4c-5b2d-4789-8fed-734eb905ebe5 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:57.569296 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217b599a-5846-4edc-b5e9-c941aeda9aba None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:57.571711 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-217b599a-5846-4edc-b5e9-c941aeda9aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:57.619121 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-fb197a4c-5b2d-4789-8fed-734eb905ebe5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d688f931f2746c4b5d5fffca57cdd0a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:57.631581 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-fb197a4c-5b2d-4789-8fed-734eb905ebe5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d688f931f2746c4b5d5fffca57cdd0a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:57.633516 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-fb197a4c-5b2d-4789-8fed-734eb905ebe5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d688f931f2746c4b5d5fffca57cdd0a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:57.634470 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-fb197a4c-5b2d-4789-8fed-734eb905ebe5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d688f931f2746c4b5d5fffca57cdd0a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:57.643511 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-fb197a4c-5b2d-4789-8fed-734eb905ebe5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d688f931f2746c4b5d5fffca57cdd0a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:57.662649 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1027/2075] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 14:56:57 2022] DELETE /identity/v3/users/6d688f931f2746c4b5d5fffca57cdd0a => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:56:57.670597 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217b599a-5846-4edc-b5e9-c941aeda9aba None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:57.716966 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:57.722679 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec84089-b5c5-4df8-80ef-1e60cc205ab3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df648c909ddb41418128b43f925f5ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:57.723287 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec84089-b5c5-4df8-80ef-1e60cc205ab3 service cinder] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:57.723563 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec84089-b5c5-4df8-80ef-1e60cc205ab3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:57.723832 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec84089-b5c5-4df8-80ef-1e60cc205ab3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:57.725743 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-3ec84089-b5c5-4df8-80ef-1e60cc205ab3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:57.791154 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec84089-b5c5-4df8-80ef-1e60cc205ab3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:57.792974 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec84089-b5c5-4df8-80ef-1e60cc205ab3 service cinder] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:57.802840 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1049/2076] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:56:57 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:56:57.836043 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb197a4c-5b2d-4789-8fed-734eb905ebe5 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:57.837674 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-fb197a4c-5b2d-4789-8fed-734eb905ebe5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:57.889400 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec84089-b5c5-4df8-80ef-1e60cc205ab3 service cinder] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:57.891068 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-3ec84089-b5c5-4df8-80ef-1e60cc205ab3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:57.901910 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec84089-b5c5-4df8-80ef-1e60cc205ab3 service cinder] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:57.905655 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6390ed-d209-4d9f-a09c-9178e6beb185 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df648c909ddb41418128b43f925f5ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:57.906215 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:57.906336 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6390ed-d209-4d9f-a09c-9178e6beb185 service cinder] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:57.906520 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6390ed-d209-4d9f-a09c-9178e6beb185 service cinder] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:57.907167 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6390ed-d209-4d9f-a09c-9178e6beb185 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:57.909258 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-ad6390ed-d209-4d9f-a09c-9178e6beb185 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:57.920547 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb197a4c-5b2d-4789-8fed-734eb905ebe5 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:57.926205 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c481b8d5-03ec-4475-925b-fc6bdc4226dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:57.926841 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c481b8d5-03ec-4475-925b-fc6bdc4226dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:57.927115 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c481b8d5-03ec-4475-925b-fc6bdc4226dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:57.927383 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c481b8d5-03ec-4475-925b-fc6bdc4226dd admin admin] PATH_INFO: `/v3/projects/1a9e65c7d41849e4817f5f53c76114ba` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:57.928516 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c481b8d5-03ec-4475-925b-fc6bdc4226dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a9e65c7d41849e4817f5f53c76114ba)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:57.931193 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c481b8d5-03ec-4475-925b-fc6bdc4226dd admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:57.972398 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6390ed-d209-4d9f-a09c-9178e6beb185 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:57.974077 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6390ed-d209-4d9f-a09c-9178e6beb185 service cinder] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:57.985098 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c481b8d5-03ec-4475-925b-fc6bdc4226dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a9e65c7d41849e4817f5f53c76114ba', 'request_id': 'req-c481b8d5-03ec-4475-925b-fc6bdc4226dd'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:57.985980 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1050/2077] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:56:57 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 14:56:57.997207 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c481b8d5-03ec-4475-925b-fc6bdc4226dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a9e65c7d41849e4817f5f53c76114ba', 'request_id': 'req-c481b8d5-03ec-4475-925b-fc6bdc4226dd'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:58.006271 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c481b8d5-03ec-4475-925b-fc6bdc4226dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a9e65c7d41849e4817f5f53c76114ba', 'request_id': 'req-c481b8d5-03ec-4475-925b-fc6bdc4226dd'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:58.017831 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c481b8d5-03ec-4475-925b-fc6bdc4226dd admin admin] The token cache is being invalidate because project 1a9e65c7d41849e4817f5f53c76114ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:56:58.018114 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c481b8d5-03ec-4475-925b-fc6bdc4226dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:58.018811 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c481b8d5-03ec-4475-925b-fc6bdc4226dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:58.020421 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1028/2078] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 14:56:57 2022] DELETE /identity/v3/projects/1a9e65c7d41849e4817f5f53c76114ba => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:56:58.025686 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6390ed-d209-4d9f-a09c-9178e6beb185 service cinder] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:58.037100 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6390ed-d209-4d9f-a09c-9178e6beb185 service cinder] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:58.101204 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b29efa-4efa-4ad3-b77e-ac2138051028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:58.101961 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b29efa-4efa-4ad3-b77e-ac2138051028 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:58.102127 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b29efa-4efa-4ad3-b77e-ac2138051028 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:58.102399 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b29efa-4efa-4ad3-b77e-ac2138051028 admin admin] PATH_INFO: `/v3/users/6fde4687e4764e13b2ec672a5d7823e0` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:58.103864 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b29efa-4efa-4ad3-b77e-ac2138051028 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fde4687e4764e13b2ec672a5d7823e0)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:58.105658 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b29efa-4efa-4ad3-b77e-ac2138051028 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:58.152035 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:58.163321 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-18b29efa-4efa-4ad3-b77e-ac2138051028 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fde4687e4764e13b2ec672a5d7823e0'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:58.170670 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-18b29efa-4efa-4ad3-b77e-ac2138051028 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fde4687e4764e13b2ec672a5d7823e0'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:58.171470 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-18b29efa-4efa-4ad3-b77e-ac2138051028 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fde4687e4764e13b2ec672a5d7823e0'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:58.172285 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-18b29efa-4efa-4ad3-b77e-ac2138051028 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fde4687e4764e13b2ec672a5d7823e0'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:58.187044 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-18b29efa-4efa-4ad3-b77e-ac2138051028 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fde4687e4764e13b2ec672a5d7823e0'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:58.201025 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1051/2079] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 14:56:58 2022] DELETE /identity/v3/users/6fde4687e4764e13b2ec672a5d7823e0 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:56:58.398942 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c481b8d5-03ec-4475-925b-fc6bdc4226dd admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:58.400526 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-c481b8d5-03ec-4475-925b-fc6bdc4226dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:58.417621 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c481b8d5-03ec-4475-925b-fc6bdc4226dd admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:58.487875 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3377bd9-7dc6-4835-b129-af85f5d279bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:58.488609 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3377bd9-7dc6-4835-b129-af85f5d279bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:58.488968 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3377bd9-7dc6-4835-b129-af85f5d279bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:58.489281 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3377bd9-7dc6-4835-b129-af85f5d279bd admin admin] PATH_INFO: `/v3/projects/dcedf500529c4bd9be55ac6a18694b51` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:58.490458 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3377bd9-7dc6-4835-b129-af85f5d279bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcedf500529c4bd9be55ac6a18694b51)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:58.493029 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3377bd9-7dc6-4835-b129-af85f5d279bd admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:58.545734 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f3377bd9-7dc6-4835-b129-af85f5d279bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcedf500529c4bd9be55ac6a18694b51', 'request_id': 'req-f3377bd9-7dc6-4835-b129-af85f5d279bd'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:58.552071 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f3377bd9-7dc6-4835-b129-af85f5d279bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcedf500529c4bd9be55ac6a18694b51', 'request_id': 'req-f3377bd9-7dc6-4835-b129-af85f5d279bd'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:58.560867 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f3377bd9-7dc6-4835-b129-af85f5d279bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcedf500529c4bd9be55ac6a18694b51', 'request_id': 'req-f3377bd9-7dc6-4835-b129-af85f5d279bd'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:58.571920 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f3377bd9-7dc6-4835-b129-af85f5d279bd admin admin] The token cache is being invalidate because project dcedf500529c4bd9be55ac6a18694b51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:56:58.572206 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f3377bd9-7dc6-4835-b129-af85f5d279bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:58.572838 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f3377bd9-7dc6-4835-b129-af85f5d279bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:56:58.574348 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1029/2080] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 14:56:58 2022] DELETE /identity/v3/projects/dcedf500529c4bd9be55ac6a18694b51 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:56:58.579361 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dc7105-ab8c-4dc9-871e-b37b5c2d01a8 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:58.579949 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dc7105-ab8c-4dc9-871e-b37b5c2d01a8 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:58.579949 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dc7105-ab8c-4dc9-871e-b37b5c2d01a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:58.602963 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-b5dc7105-ab8c-4dc9-871e-b37b5c2d01a8 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:58.604194 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-b5dc7105-ab8c-4dc9-871e-b37b5c2d01a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:58.685870 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1052/2081] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:56:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:56:58.689311 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14b7a13-e5dd-4ee4-9a14-ac210e876d32 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:58.689611 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14b7a13-e5dd-4ee4-9a14-ac210e876d32 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:58.689906 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14b7a13-e5dd-4ee4-9a14-ac210e876d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:58.716339 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-e14b7a13-e5dd-4ee4-9a14-ac210e876d32 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:58.717689 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e14b7a13-e5dd-4ee4-9a14-ac210e876d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:58.727147 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1030/2082] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:56:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:56:58.732116 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dc7105-ab8c-4dc9-871e-b37b5c2d01a8 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:58.746260 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dc7105-ab8c-4dc9-871e-b37b5c2d01a8 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:58.753495 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c49fd70-9101-4f24-9f51-9c8734317232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:58.754192 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c49fd70-9101-4f24-9f51-9c8734317232 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:58.755103 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c49fd70-9101-4f24-9f51-9c8734317232 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:58.755596 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c49fd70-9101-4f24-9f51-9c8734317232 admin admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:58.756395 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c49fd70-9101-4f24-9f51-9c8734317232 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:56:58.756716 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c49fd70-9101-4f24-9f51-9c8734317232 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:58.758381 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c49fd70-9101-4f24-9f51-9c8734317232 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:58.776023 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1053/2083] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 19 14:56:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:56:58.781479 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14b7a13-e5dd-4ee4-9a14-ac210e876d32 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:58.787819 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:58.792730 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14b7a13-e5dd-4ee4-9a14-ac210e876d32 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:58.799367 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02195e8-e292-42ee-a92b-71dd7949f352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:58.800419 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02195e8-e292-42ee-a92b-71dd7949f352 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:58.800717 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02195e8-e292-42ee-a92b-71dd7949f352 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:58.801021 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02195e8-e292-42ee-a92b-71dd7949f352 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:58.801825 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02195e8-e292-42ee-a92b-71dd7949f352 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:58.803968 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02195e8-e292-42ee-a92b-71dd7949f352 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:58.842008 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1031/2084] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 14:56:58 2022] POST /identity/v3/projects => generated 409 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 14:56:58.843225 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c49fd70-9101-4f24-9f51-9c8734317232 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:58.854393 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c49fd70-9101-4f24-9f51-9c8734317232 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:58.930648 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d256779-f65a-48e6-b54d-ed87d7cc7cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:58.931450 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d256779-f65a-48e6-b54d-ed87d7cc7cbd admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:58.931654 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d256779-f65a-48e6-b54d-ed87d7cc7cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:58.931922 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d256779-f65a-48e6-b54d-ed87d7cc7cbd admin admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:58.932551 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d256779-f65a-48e6-b54d-ed87d7cc7cbd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:58.934769 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d256779-f65a-48e6-b54d-ed87d7cc7cbd admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:58.958622 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1054/2085] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 14:56:58 2022] POST /identity/v3/users => generated 305 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:56:58.963086 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02195e8-e292-42ee-a92b-71dd7949f352 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:58.974698 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02195e8-e292-42ee-a92b-71dd7949f352 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:58.979668 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db8c270-bf03-4897-92eb-a1809b85c7fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:58.980279 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db8c270-bf03-4897-92eb-a1809b85c7fb admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:58.980552 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db8c270-bf03-4897-92eb-a1809b85c7fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:58.981090 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db8c270-bf03-4897-92eb-a1809b85c7fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:58.981478 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db8c270-bf03-4897-92eb-a1809b85c7fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:58.983062 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db8c270-bf03-4897-92eb-a1809b85c7fb admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:59.005030 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1032/2086] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:56:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:56:59.005485 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d256779-f65a-48e6-b54d-ed87d7cc7cbd admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:59.016010 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d256779-f65a-48e6-b54d-ed87d7cc7cbd admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:59.021223 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b76bc30-c65a-4e50-b5de-f6dafdc08d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:59.021866 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b76bc30-c65a-4e50-b5de-f6dafdc08d96 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:59.022185 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b76bc30-c65a-4e50-b5de-f6dafdc08d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:59.022855 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b76bc30-c65a-4e50-b5de-f6dafdc08d96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:59.023265 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b76bc30-c65a-4e50-b5de-f6dafdc08d96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:59.025019 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b76bc30-c65a-4e50-b5de-f6dafdc08d96 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:59.036722 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1055/2087] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:56:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:56:59.041275 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db8c270-bf03-4897-92eb-a1809b85c7fb admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:59.056164 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db8c270-bf03-4897-92eb-a1809b85c7fb admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:59.061298 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074e403c-f1b9-4751-ac0f-987d3e35aec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:59.061948 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e403c-f1b9-4751-ac0f-987d3e35aec5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:59.062224 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e403c-f1b9-4751-ac0f-987d3e35aec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:59.062498 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e403c-f1b9-4751-ac0f-987d3e35aec5 admin admin] PATH_INFO: `/v3/projects/525b177a5e934239b7af139d070720f9/users/018c1393661d4f25a00c63a8252bdaf1/roles/74de6794e3b3422b93d26f993d260c35` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:59.080550 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074e403c-f1b9-4751-ac0f-987d3e35aec5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=525b177a5e934239b7af139d070720f9, user_id=018c1393661d4f25a00c63a8252bdaf1, role_id=74de6794e3b3422b93d26f993d260c35)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:59.091253 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074e403c-f1b9-4751-ac0f-987d3e35aec5 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:59.102014 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1033/2088] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 14:56:59 2022] PUT /identity/v3/projects/525b177a5e934239b7af139d070720f9/users/018c1393661d4f25a00c63a8252bdaf1/roles/74de6794e3b3422b93d26f993d260c35 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:56:59.112892 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e776f6-2f79-4d58-9365-2de2a4adf36f None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:59.113203 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e776f6-2f79-4d58-9365-2de2a4adf36f None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:59.113469 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e776f6-2f79-4d58-9365-2de2a4adf36f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:59.151073 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-41e776f6-2f79-4d58-9365-2de2a4adf36f None None] MFA Rules not processed for user `018c1393661d4f25a00c63a8252bdaf1`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:59.152436 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-41e776f6-2f79-4d58-9365-2de2a4adf36f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:59.165140 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:59.267757 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074e403c-f1b9-4751-ac0f-987d3e35aec5 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:59.277758 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1056/2089] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:56:59 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:56:59.357055 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074e403c-f1b9-4751-ac0f-987d3e35aec5 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:59.362140 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8b78b6-4767-4b5d-b687-34051e74755b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:59.362751 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8b78b6-4767-4b5d-b687-34051e74755b admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:59.363033 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8b78b6-4767-4b5d-b687-34051e74755b admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:59.363307 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8b78b6-4767-4b5d-b687-34051e74755b admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:59.363937 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8b78b6-4767-4b5d-b687-34051e74755b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:59.366075 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8b78b6-4767-4b5d-b687-34051e74755b admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:59.403733 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1034/2090] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 14:56:59 2022] POST /identity/v3/projects => generated 407 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:56:59.408133 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e776f6-2f79-4d58-9365-2de2a4adf36f None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:59.420432 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e776f6-2f79-4d58-9365-2de2a4adf36f None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:59.495837 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d84cf4-09ec-481f-aece-4dbfe425bc02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:59.496455 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d84cf4-09ec-481f-aece-4dbfe425bc02 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:59.496736 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d84cf4-09ec-481f-aece-4dbfe425bc02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:59.497028 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d84cf4-09ec-481f-aece-4dbfe425bc02 admin admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:59.497703 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d84cf4-09ec-481f-aece-4dbfe425bc02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:59.499629 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d84cf4-09ec-481f-aece-4dbfe425bc02 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:59.525064 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1057/2091] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 14:56:59 2022] POST /identity/v3/users => generated 310 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:56:59.526310 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8b78b6-4767-4b5d-b687-34051e74755b admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:59.537323 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8b78b6-4767-4b5d-b687-34051e74755b admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:59.542357 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18af0c4-1669-43ab-8c04-95acb4a42691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:59.543004 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18af0c4-1669-43ab-8c04-95acb4a42691 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:59.543278 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18af0c4-1669-43ab-8c04-95acb4a42691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:59.543540 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18af0c4-1669-43ab-8c04-95acb4a42691 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:59.544211 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18af0c4-1669-43ab-8c04-95acb4a42691 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:59.546049 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18af0c4-1669-43ab-8c04-95acb4a42691 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:59.558973 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1035/2092] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:56:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:56:59.563358 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d84cf4-09ec-481f-aece-4dbfe425bc02 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:59.573899 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d84cf4-09ec-481f-aece-4dbfe425bc02 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:59.578723 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb068ee5-f354-4475-b8eb-ea68b60a424e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:59.579470 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb068ee5-f354-4475-b8eb-ea68b60a424e admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:59.580092 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb068ee5-f354-4475-b8eb-ea68b60a424e admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:59.580092 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb068ee5-f354-4475-b8eb-ea68b60a424e admin admin] PATH_INFO: `/v3/projects/0881172ebf3f495bbcae0b0c810742d0/users/a43b95b8ae3945e484c31bf4c4785664/roles/019bde1756cb40de8ce06cef6b261f79` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:59.597087 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb068ee5-f354-4475-b8eb-ea68b60a424e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0881172ebf3f495bbcae0b0c810742d0, user_id=a43b95b8ae3945e484c31bf4c4785664, role_id=019bde1756cb40de8ce06cef6b261f79)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:59.601035 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb068ee5-f354-4475-b8eb-ea68b60a424e admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:59.620949 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1058/2093] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 14:56:59 2022] PUT /identity/v3/projects/0881172ebf3f495bbcae0b0c810742d0/users/a43b95b8ae3945e484c31bf4c4785664/roles/019bde1756cb40de8ce06cef6b261f79 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:56:59.621799 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18af0c4-1669-43ab-8c04-95acb4a42691 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:59.633810 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18af0c4-1669-43ab-8c04-95acb4a42691 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:59.723840 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b3311d-a6af-453d-937f-acb16514d72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:59.724570 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b3311d-a6af-453d-937f-acb16514d72a admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:59.724848 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b3311d-a6af-453d-937f-acb16514d72a admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:59.725947 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b3311d-a6af-453d-937f-acb16514d72a admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:59.726206 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b3311d-a6af-453d-937f-acb16514d72a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:59.728509 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b3311d-a6af-453d-937f-acb16514d72a admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:59.741041 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1036/2094] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:56:59 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:56:59.744556 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb068ee5-f354-4475-b8eb-ea68b60a424e admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:59.755950 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb068ee5-f354-4475-b8eb-ea68b60a424e admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:56:59.761627 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6568a602-4b46-4592-bd8a-9d378202dfbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:56:59.762289 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6568a602-4b46-4592-bd8a-9d378202dfbb admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:59.762568 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6568a602-4b46-4592-bd8a-9d378202dfbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:59.762871 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6568a602-4b46-4592-bd8a-9d378202dfbb admin admin] PATH_INFO: `/v3/projects/0881172ebf3f495bbcae0b0c810742d0/users/a43b95b8ae3945e484c31bf4c4785664/roles/019bde1756cb40de8ce06cef6b261f79` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:59.765009 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6568a602-4b46-4592-bd8a-9d378202dfbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=0881172ebf3f495bbcae0b0c810742d0, user_id=a43b95b8ae3945e484c31bf4c4785664, role_id=019bde1756cb40de8ce06cef6b261f79)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:56:59.767783 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6568a602-4b46-4592-bd8a-9d378202dfbb admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:56:59.779972 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1059/2095] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 14:56:59 2022] PUT /identity/v3/projects/0881172ebf3f495bbcae0b0c810742d0/users/a43b95b8ae3945e484c31bf4c4785664/roles/019bde1756cb40de8ce06cef6b261f79 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:56:59.793510 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e2e9a7-f63f-4198-b916-ce9d9c1cc83e None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:56:59.793818 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e2e9a7-f63f-4198-b916-ce9d9c1cc83e None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:56:59.794137 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e2e9a7-f63f-4198-b916-ce9d9c1cc83e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:56:59.826769 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-26e2e9a7-f63f-4198-b916-ce9d9c1cc83e None None] MFA Rules not processed for user `a43b95b8ae3945e484c31bf4c4785664`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:56:59.827964 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-26e2e9a7-f63f-4198-b916-ce9d9c1cc83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:59.834144 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:59.907497 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1037/2096] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:56:59 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:56:59.920338 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6568a602-4b46-4592-bd8a-9d378202dfbb admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:56:59.923512 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-6568a602-4b46-4592-bd8a-9d378202dfbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:56:59.997609 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6568a602-4b46-4592-bd8a-9d378202dfbb admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:00.003748 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35294d0-7c18-465e-b9b7-575dfc844a80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df648c909ddb41418128b43f925f5ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:00.004408 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35294d0-7c18-465e-b9b7-575dfc844a80 service cinder] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:00.004685 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35294d0-7c18-465e-b9b7-575dfc844a80 service cinder] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:00.004955 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35294d0-7c18-465e-b9b7-575dfc844a80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:00.015053 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35294d0-7c18-465e-b9b7-575dfc844a80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:00.016488 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35294d0-7c18-465e-b9b7-575dfc844a80 service cinder] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:00.027545 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1060/2097] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:56:59 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:57:00.225268 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e2e9a7-f63f-4198-b916-ce9d9c1cc83e None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:00.235786 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e2e9a7-f63f-4198-b916-ce9d9c1cc83e None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:00.240198 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fe91a6-1f2c-46e0-94c7-5518ba56f729 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df648c909ddb41418128b43f925f5ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:00.240766 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fe91a6-1f2c-46e0-94c7-5518ba56f729 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:00.241080 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fe91a6-1f2c-46e0-94c7-5518ba56f729 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:00.241407 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fe91a6-1f2c-46e0-94c7-5518ba56f729 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:00.300884 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fe91a6-1f2c-46e0-94c7-5518ba56f729 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:00.302360 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fe91a6-1f2c-46e0-94c7-5518ba56f729 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:00.312190 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1038/2098] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:57:00 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:57:02.211669 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35294d0-7c18-465e-b9b7-575dfc844a80 service cinder] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:02.213252 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-e35294d0-7c18-465e-b9b7-575dfc844a80 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:02.219908 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:02.283716 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35294d0-7c18-465e-b9b7-575dfc844a80 service cinder] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:02.288856 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150b9846-1f64-40c6-ac47-bc5c38dc7377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:02.289521 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b9846-1f64-40c6-ac47-bc5c38dc7377 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:02.289799 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b9846-1f64-40c6-ac47-bc5c38dc7377 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:02.290955 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b9846-1f64-40c6-ac47-bc5c38dc7377 admin admin] PATH_INFO: `/v3/users/a6eb725c7afa4b2e8adcade9f00e6281` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:02.291194 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150b9846-1f64-40c6-ac47-bc5c38dc7377 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6eb725c7afa4b2e8adcade9f00e6281)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:02.293237 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150b9846-1f64-40c6-ac47-bc5c38dc7377 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:02.345736 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-150b9846-1f64-40c6-ac47-bc5c38dc7377 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6eb725c7afa4b2e8adcade9f00e6281'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:02.354456 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-150b9846-1f64-40c6-ac47-bc5c38dc7377 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6eb725c7afa4b2e8adcade9f00e6281'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:02.355082 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-150b9846-1f64-40c6-ac47-bc5c38dc7377 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6eb725c7afa4b2e8adcade9f00e6281'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:02.355757 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-150b9846-1f64-40c6-ac47-bc5c38dc7377 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6eb725c7afa4b2e8adcade9f00e6281'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:02.370510 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-150b9846-1f64-40c6-ac47-bc5c38dc7377 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6eb725c7afa4b2e8adcade9f00e6281'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:02.384323 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1061/2099] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 14:57:02 2022] DELETE /identity/v3/users/a6eb725c7afa4b2e8adcade9f00e6281 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:02.390387 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab17d88c-f666-4ac9-ac3c-091e9c612f6e None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:02.390913 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab17d88c-f666-4ac9-ac3c-091e9c612f6e None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:02.391007 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab17d88c-f666-4ac9-ac3c-091e9c612f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:02.411605 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-ab17d88c-f666-4ac9-ac3c-091e9c612f6e None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:02.412881 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ab17d88c-f666-4ac9-ac3c-091e9c612f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:02.474360 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1039/2100] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:57:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:02.484560 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150b9846-1f64-40c6-ac47-bc5c38dc7377 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:02.486056 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-150b9846-1f64-40c6-ac47-bc5c38dc7377 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:02.546327 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150b9846-1f64-40c6-ac47-bc5c38dc7377 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:02.550370 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b320bfa7-803b-4a34-9326-ac3b0e50ce70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:02.550970 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320bfa7-803b-4a34-9326-ac3b0e50ce70 service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:02.551246 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320bfa7-803b-4a34-9326-ac3b0e50ce70 service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:02.551513 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320bfa7-803b-4a34-9326-ac3b0e50ce70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:02.561631 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b320bfa7-803b-4a34-9326-ac3b0e50ce70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:02.563041 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b320bfa7-803b-4a34-9326-ac3b0e50ce70 service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:02.572978 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1062/2101] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:57:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:57:02.996975 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab17d88c-f666-4ac9-ac3c-091e9c612f6e None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:03.006010 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ab17d88c-f666-4ac9-ac3c-091e9c612f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:03.065327 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab17d88c-f666-4ac9-ac3c-091e9c612f6e None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:03.080119 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4739bb9e-cfbb-4740-afbe-d27f4b2b0619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:03.080735 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4739bb9e-cfbb-4740-afbe-d27f4b2b0619 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:03.081118 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4739bb9e-cfbb-4740-afbe-d27f4b2b0619 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:03.081420 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4739bb9e-cfbb-4740-afbe-d27f4b2b0619 admin admin] PATH_INFO: `/v3/projects/020371df397e46cbbec2e3f4d8d0d081` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:03.082850 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4739bb9e-cfbb-4740-afbe-d27f4b2b0619 admin admin] RBAC: Authorizing `identity:delete_project(project_id=020371df397e46cbbec2e3f4d8d0d081)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:03.088826 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4739bb9e-cfbb-4740-afbe-d27f4b2b0619 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:03.151775 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:03.176608 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-4739bb9e-cfbb-4740-afbe-d27f4b2b0619 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '020371df397e46cbbec2e3f4d8d0d081', 'request_id': 'req-4739bb9e-cfbb-4740-afbe-d27f4b2b0619'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:03.188438 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-4739bb9e-cfbb-4740-afbe-d27f4b2b0619 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '020371df397e46cbbec2e3f4d8d0d081', 'request_id': 'req-4739bb9e-cfbb-4740-afbe-d27f4b2b0619'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:03.201654 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-4739bb9e-cfbb-4740-afbe-d27f4b2b0619 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '020371df397e46cbbec2e3f4d8d0d081', 'request_id': 'req-4739bb9e-cfbb-4740-afbe-d27f4b2b0619'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:03.232428 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-4739bb9e-cfbb-4740-afbe-d27f4b2b0619 admin admin] The token cache is being invalidate because project 020371df397e46cbbec2e3f4d8d0d081 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:57:03.232771 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-4739bb9e-cfbb-4740-afbe-d27f4b2b0619 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:03.234487 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-4739bb9e-cfbb-4740-afbe-d27f4b2b0619 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:03.236126 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1040/2102] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 14:57:02 2022] DELETE /identity/v3/projects/020371df397e46cbbec2e3f4d8d0d081 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:03.244284 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b320bfa7-803b-4a34-9326-ac3b0e50ce70 service neutron] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:03.256256 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b320bfa7-803b-4a34-9326-ac3b0e50ce70 service neutron] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:03.306413 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:03.390700 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc33825-161d-4c82-8148-8185c86b10b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:03.392512 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc33825-161d-4c82-8148-8185c86b10b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:03.392976 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc33825-161d-4c82-8148-8185c86b10b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:03.393277 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc33825-161d-4c82-8148-8185c86b10b2 admin admin] PATH_INFO: `/v3/users/a1a3d0e6c08b4695b4eb8c15b2ba80be` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:03.394639 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc33825-161d-4c82-8148-8185c86b10b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1a3d0e6c08b4695b4eb8c15b2ba80be)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:03.396579 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc33825-161d-4c82-8148-8185c86b10b2 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:03.485625 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-6cc33825-161d-4c82-8148-8185c86b10b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1a3d0e6c08b4695b4eb8c15b2ba80be'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:03.498861 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-6cc33825-161d-4c82-8148-8185c86b10b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1a3d0e6c08b4695b4eb8c15b2ba80be'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:03.500356 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-6cc33825-161d-4c82-8148-8185c86b10b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1a3d0e6c08b4695b4eb8c15b2ba80be'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:03.501580 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-6cc33825-161d-4c82-8148-8185c86b10b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1a3d0e6c08b4695b4eb8c15b2ba80be'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:03.522305 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-6cc33825-161d-4c82-8148-8185c86b10b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1a3d0e6c08b4695b4eb8c15b2ba80be'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:03.539811 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1063/2103] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 14:57:03 2022] DELETE /identity/v3/users/a1a3d0e6c08b4695b4eb8c15b2ba80be => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:03.907363 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4739bb9e-cfbb-4740-afbe-d27f4b2b0619 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:03.908876 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-4739bb9e-cfbb-4740-afbe-d27f4b2b0619 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:03.922932 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4739bb9e-cfbb-4740-afbe-d27f4b2b0619 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:03.993509 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc33825-161d-4c82-8148-8185c86b10b2 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:03.995235 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-6cc33825-161d-4c82-8148-8185c86b10b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:04.004345 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0bab85-fb6d-4033-91cc-459ff7777e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:04.005030 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0bab85-fb6d-4033-91cc-459ff7777e12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:04.005302 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0bab85-fb6d-4033-91cc-459ff7777e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:04.005566 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0bab85-fb6d-4033-91cc-459ff7777e12 admin admin] PATH_INFO: `/v3/projects/f6aba2a7f7d34b6b9e0dd1d33a31b723` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:04.007266 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0bab85-fb6d-4033-91cc-459ff7777e12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6aba2a7f7d34b6b9e0dd1d33a31b723)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:04.009249 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0bab85-fb6d-4033-91cc-459ff7777e12 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:04.066225 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2a0bab85-fb6d-4033-91cc-459ff7777e12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6aba2a7f7d34b6b9e0dd1d33a31b723', 'request_id': 'req-2a0bab85-fb6d-4033-91cc-459ff7777e12'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:04.072822 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2a0bab85-fb6d-4033-91cc-459ff7777e12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6aba2a7f7d34b6b9e0dd1d33a31b723', 'request_id': 'req-2a0bab85-fb6d-4033-91cc-459ff7777e12'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:04.081076 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc33825-161d-4c82-8148-8185c86b10b2 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:04.085420 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2a0bab85-fb6d-4033-91cc-459ff7777e12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6aba2a7f7d34b6b9e0dd1d33a31b723', 'request_id': 'req-2a0bab85-fb6d-4033-91cc-459ff7777e12'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:04.100654 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2a0bab85-fb6d-4033-91cc-459ff7777e12 admin admin] The token cache is being invalidate because project f6aba2a7f7d34b6b9e0dd1d33a31b723 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:57:04.101026 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2a0bab85-fb6d-4033-91cc-459ff7777e12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:04.101777 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2a0bab85-fb6d-4033-91cc-459ff7777e12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:04.103578 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1041/2104] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 14:57:03 2022] DELETE /identity/v3/projects/f6aba2a7f7d34b6b9e0dd1d33a31b723 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:04.108665 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ca996-dbdc-465d-ae9d-5c8cbceeca47 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:04.109009 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ca996-dbdc-465d-ae9d-5c8cbceeca47 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:04.109495 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ca996-dbdc-465d-ae9d-5c8cbceeca47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:04.132570 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-7d4ca996-dbdc-465d-ae9d-5c8cbceeca47 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:04.133827 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-7d4ca996-dbdc-465d-ae9d-5c8cbceeca47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:04.146322 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:04.162407 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76091cfe-6b09-44c3-9a21-f57aecb3325c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:04.164017 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76091cfe-6b09-44c3-9a21-f57aecb3325c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:04.164477 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76091cfe-6b09-44c3-9a21-f57aecb3325c admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:04.165282 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76091cfe-6b09-44c3-9a21-f57aecb3325c admin admin] PATH_INFO: `/v3/users/da8075adad894e84ac862671d5db30a8` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:04.167285 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76091cfe-6b09-44c3-9a21-f57aecb3325c admin admin] RBAC: Authorizing `identity:delete_user(user_id=da8075adad894e84ac862671d5db30a8)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:04.169899 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76091cfe-6b09-44c3-9a21-f57aecb3325c admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:04.196414 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:04.217610 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1042/2105] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:57:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 14:57:04.226762 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddecb08e-6122-44c8-9ef8-f453d4650ba3 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:04.227636 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddecb08e-6122-44c8-9ef8-f453d4650ba3 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:04.228103 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddecb08e-6122-44c8-9ef8-f453d4650ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:04.249052 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-76091cfe-6b09-44c3-9a21-f57aecb3325c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da8075adad894e84ac862671d5db30a8'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:04.251451 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-ddecb08e-6122-44c8-9ef8-f453d4650ba3 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:04.252740 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ddecb08e-6122-44c8-9ef8-f453d4650ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:04.262576 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1043/2106] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:57:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 14:57:04.264920 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-76091cfe-6b09-44c3-9a21-f57aecb3325c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da8075adad894e84ac862671d5db30a8'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:04.265674 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-76091cfe-6b09-44c3-9a21-f57aecb3325c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da8075adad894e84ac862671d5db30a8'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:04.266661 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-76091cfe-6b09-44c3-9a21-f57aecb3325c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da8075adad894e84ac862671d5db30a8'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:04.267327 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddecb08e-6122-44c8-9ef8-f453d4650ba3 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:04.277282 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddecb08e-6122-44c8-9ef8-f453d4650ba3 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:04.281316 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-76091cfe-6b09-44c3-9a21-f57aecb3325c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da8075adad894e84ac862671d5db30a8'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:04.282073 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c332384f-cd50-4efe-b785-09da4ee03e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:04.282672 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332384f-cd50-4efe-b785-09da4ee03e36 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:04.282948 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332384f-cd50-4efe-b785-09da4ee03e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:04.283500 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332384f-cd50-4efe-b785-09da4ee03e36 admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:04.283855 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c332384f-cd50-4efe-b785-09da4ee03e36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:57:04.284154 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c332384f-cd50-4efe-b785-09da4ee03e36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:04.285807 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c332384f-cd50-4efe-b785-09da4ee03e36 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:04.299434 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1044/2107] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 19 14:57:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 14:57:04.304628 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1064/2108] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 14:57:03 2022] DELETE /identity/v3/users/da8075adad894e84ac862671d5db30a8 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:04.305059 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c332384f-cd50-4efe-b785-09da4ee03e36 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:04.306959 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-c332384f-cd50-4efe-b785-09da4ee03e36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:04.309036 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf8601-a51a-449e-8904-b1dcd36975e9 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:04.309388 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf8601-a51a-449e-8904-b1dcd36975e9 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:04.309741 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf8601-a51a-449e-8904-b1dcd36975e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:04.319962 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c332384f-cd50-4efe-b785-09da4ee03e36 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:04.330524 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-c3cf8601-a51a-449e-8904-b1dcd36975e9 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:04.331769 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-c3cf8601-a51a-449e-8904-b1dcd36975e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:04.383342 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82170177-d9c7-4257-aa58-0015c1c79b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:04.383941 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82170177-d9c7-4257-aa58-0015c1c79b70 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:04.384215 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82170177-d9c7-4257-aa58-0015c1c79b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:04.384479 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82170177-d9c7-4257-aa58-0015c1c79b70 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:04.385197 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82170177-d9c7-4257-aa58-0015c1c79b70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:04.387087 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82170177-d9c7-4257-aa58-0015c1c79b70 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:04.394469 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1065/2109] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:57:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 14:57:04.406788 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cf8601-a51a-449e-8904-b1dcd36975e9 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:04.408942 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-c3cf8601-a51a-449e-8904-b1dcd36975e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:04.423299 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1045/2110] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 14:57:04 2022] POST /identity/v3/projects => generated 381 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:57:04.426125 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82170177-d9c7-4257-aa58-0015c1c79b70 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:04.485144 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cf8601-a51a-449e-8904-b1dcd36975e9 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:04.498834 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82170177-d9c7-4257-aa58-0015c1c79b70 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:04.509135 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a65e8a-49c3-4688-b944-1f94a859b850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:04.509135 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a65e8a-49c3-4688-b944-1f94a859b850 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:04.509135 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a65e8a-49c3-4688-b944-1f94a859b850 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:04.509135 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a65e8a-49c3-4688-b944-1f94a859b850 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:04.510227 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a65e8a-49c3-4688-b944-1f94a859b850 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:04.514664 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a65e8a-49c3-4688-b944-1f94a859b850 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:04.520154 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:04.551325 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1046/2111] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 14:57:04 2022] POST /identity/v3/users => generated 291 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 14:57:04.554628 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a65e8a-49c3-4688-b944-1f94a859b850 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:04.556721 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a18905f-1092-4d13-b781-4aa7769b2582 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:04.557381 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a18905f-1092-4d13-b781-4aa7769b2582 service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:04.557660 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a18905f-1092-4d13-b781-4aa7769b2582 service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:04.560335 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a18905f-1092-4d13-b781-4aa7769b2582 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:04.565414 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a65e8a-49c3-4688-b944-1f94a859b850 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:04.572573 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1b6b2b-41c3-4fea-88d5-097c139a3a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:04.573359 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b6b2b-41c3-4fea-88d5-097c139a3a21 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:04.573628 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b6b2b-41c3-4fea-88d5-097c139a3a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:04.573895 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b6b2b-41c3-4fea-88d5-097c139a3a21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:04.573993 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a18905f-1092-4d13-b781-4aa7769b2582 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:04.574543 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1b6b2b-41c3-4fea-88d5-097c139a3a21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:04.575889 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a18905f-1092-4d13-b781-4aa7769b2582 service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:04.576152 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1b6b2b-41c3-4fea-88d5-097c139a3a21 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:04.594539 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1047/2112] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:57:04 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:57:04.595107 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1066/2113] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:57:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:57:04.606652 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a18905f-1092-4d13-b781-4aa7769b2582 service neutron] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:04.621190 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a18905f-1092-4d13-b781-4aa7769b2582 service neutron] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:04.626609 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49ce69f-b1c9-4364-bd00-af4965e68638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:04.627226 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ce69f-b1c9-4364-bd00-af4965e68638 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:04.627507 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ce69f-b1c9-4364-bd00-af4965e68638 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:04.628292 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ce69f-b1c9-4364-bd00-af4965e68638 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:04.628430 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49ce69f-b1c9-4364-bd00-af4965e68638 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:04.630879 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49ce69f-b1c9-4364-bd00-af4965e68638 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:04.648014 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1067/2114] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:57:04 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:57:04.648750 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1b6b2b-41c3-4fea-88d5-097c139a3a21 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:04.659791 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1b6b2b-41c3-4fea-88d5-097c139a3a21 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:04.666410 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8105e4-379f-433a-92b5-250647493097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:04.667122 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8105e4-379f-433a-92b5-250647493097 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:04.667399 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8105e4-379f-433a-92b5-250647493097 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:04.667670 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8105e4-379f-433a-92b5-250647493097 admin admin] PATH_INFO: `/v3/projects/94c3c332577b4c1d9e986c7e5db9a455/users/a07ceef8525c4e9fa371f6aa95a3960c/roles/74de6794e3b3422b93d26f993d260c35` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:04.689480 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8105e4-379f-433a-92b5-250647493097 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94c3c332577b4c1d9e986c7e5db9a455, user_id=a07ceef8525c4e9fa371f6aa95a3960c, role_id=74de6794e3b3422b93d26f993d260c35)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:04.694830 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8105e4-379f-433a-92b5-250647493097 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:04.721043 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1048/2115] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 14:57:04 2022] PUT /identity/v3/projects/94c3c332577b4c1d9e986c7e5db9a455/users/a07ceef8525c4e9fa371f6aa95a3960c/roles/74de6794e3b3422b93d26f993d260c35 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:04.731842 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2e11f8-7f95-41ab-bb43-8da4e9a4643a None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:04.732154 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2e11f8-7f95-41ab-bb43-8da4e9a4643a None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:04.733027 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2e11f8-7f95-41ab-bb43-8da4e9a4643a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:04.775352 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-dc2e11f8-7f95-41ab-bb43-8da4e9a4643a None None] MFA Rules not processed for user `a07ceef8525c4e9fa371f6aa95a3960c`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:04.775352 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-dc2e11f8-7f95-41ab-bb43-8da4e9a4643a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:04.883272 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1068/2116] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:57:04 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:04.888217 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8105e4-379f-433a-92b5-250647493097 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:04.906979 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:04.956487 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2e11f8-7f95-41ab-bb43-8da4e9a4643a None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:04.958909 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-dc2e11f8-7f95-41ab-bb43-8da4e9a4643a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:04.972799 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8105e4-379f-433a-92b5-250647493097 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:04.980066 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d564df-33c4-474c-a720-bfbdf0e62d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:04.980722 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d564df-33c4-474c-a720-bfbdf0e62d6b admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:04.981031 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d564df-33c4-474c-a720-bfbdf0e62d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:04.981317 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d564df-33c4-474c-a720-bfbdf0e62d6b admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:04.981958 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d564df-33c4-474c-a720-bfbdf0e62d6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:04.985067 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d564df-33c4-474c-a720-bfbdf0e62d6b admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:04.988341 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2e11f8-7f95-41ab-bb43-8da4e9a4643a None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:05.001541 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae3a0af-c98f-4f56-9d78-ff75b29b776b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:05.001760 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae3a0af-c98f-4f56-9d78-ff75b29b776b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:05.002033 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae3a0af-c98f-4f56-9d78-ff75b29b776b admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:05.002337 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae3a0af-c98f-4f56-9d78-ff75b29b776b admin admin] PATH_INFO: `/v3/projects/15c5c5204adf4936bd3cc96393dac724` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:05.004075 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae3a0af-c98f-4f56-9d78-ff75b29b776b admin admin] RBAC: Authorizing `identity:delete_project(project_id=15c5c5204adf4936bd3cc96393dac724)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:05.006672 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae3a0af-c98f-4f56-9d78-ff75b29b776b admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:05.048128 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1049/2117] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 14:57:04 2022] POST /identity/v3/projects => generated 383 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 14:57:05.052715 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d564df-33c4-474c-a720-bfbdf0e62d6b admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:05.073502 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-4ae3a0af-c98f-4f56-9d78-ff75b29b776b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15c5c5204adf4936bd3cc96393dac724', 'request_id': 'req-4ae3a0af-c98f-4f56-9d78-ff75b29b776b'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:05.081651 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-4ae3a0af-c98f-4f56-9d78-ff75b29b776b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15c5c5204adf4936bd3cc96393dac724', 'request_id': 'req-4ae3a0af-c98f-4f56-9d78-ff75b29b776b'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:05.093374 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-4ae3a0af-c98f-4f56-9d78-ff75b29b776b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15c5c5204adf4936bd3cc96393dac724', 'request_id': 'req-4ae3a0af-c98f-4f56-9d78-ff75b29b776b'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:05.111545 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-4ae3a0af-c98f-4f56-9d78-ff75b29b776b admin admin] The token cache is being invalidate because project 15c5c5204adf4936bd3cc96393dac724 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:57:05.111837 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-4ae3a0af-c98f-4f56-9d78-ff75b29b776b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:05.112524 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-4ae3a0af-c98f-4f56-9d78-ff75b29b776b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:05.114092 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1069/2118] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 14:57:04 2022] DELETE /identity/v3/projects/15c5c5204adf4936bd3cc96393dac724 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:05.119016 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5e114-73cf-4af8-b1d0-b3a4162f2df5 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:05.119543 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5e114-73cf-4af8-b1d0-b3a4162f2df5 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:05.119543 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5e114-73cf-4af8-b1d0-b3a4162f2df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:05.129632 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d564df-33c4-474c-a720-bfbdf0e62d6b admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:05.141706 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-7ea5e114-73cf-4af8-b1d0-b3a4162f2df5 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:05.142706 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-7ea5e114-73cf-4af8-b1d0-b3a4162f2df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:05.176114 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:05.195308 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297529d8-0976-418e-a7cf-95b07106ceed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:05.195921 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297529d8-0976-418e-a7cf-95b07106ceed admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:05.196202 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297529d8-0976-418e-a7cf-95b07106ceed admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:05.196483 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297529d8-0976-418e-a7cf-95b07106ceed admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:05.197165 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297529d8-0976-418e-a7cf-95b07106ceed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:05.199089 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297529d8-0976-418e-a7cf-95b07106ceed admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:05.218292 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1070/2119] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:57:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:05.222500 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1050/2120] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 14:57:05 2022] POST /identity/v3/users => generated 298 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 14:57:05.226705 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297529d8-0976-418e-a7cf-95b07106ceed admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:05.226871 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49df327-53c8-4980-b053-a90218ce853c None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:05.227162 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49df327-53c8-4980-b053-a90218ce853c None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:05.227506 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49df327-53c8-4980-b053-a90218ce853c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:05.228417 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-297529d8-0976-418e-a7cf-95b07106ceed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:05.240744 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297529d8-0976-418e-a7cf-95b07106ceed admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:05.247134 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c508e8-9a92-47e6-bcb2-555db7ab795f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:05.247759 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c508e8-9a92-47e6-bcb2-555db7ab795f admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:05.248035 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c508e8-9a92-47e6-bcb2-555db7ab795f admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:05.248305 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c508e8-9a92-47e6-bcb2-555db7ab795f admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:05.249096 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c508e8-9a92-47e6-bcb2-555db7ab795f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:05.250816 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c508e8-9a92-47e6-bcb2-555db7ab795f admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:05.254671 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-b49df327-53c8-4980-b053-a90218ce853c None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:05.256001 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-b49df327-53c8-4980-b053-a90218ce853c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:05.263048 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1051/2121] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:57:05 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 14:57:05.266229 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1071/2122] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:57:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:05.267589 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c508e8-9a92-47e6-bcb2-555db7ab795f admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:05.270466 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49df327-53c8-4980-b053-a90218ce853c None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:05.281219 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c508e8-9a92-47e6-bcb2-555db7ab795f admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:05.281455 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49df327-53c8-4980-b053-a90218ce853c None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:05.286912 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0783baa-ad37-4fc8-96fe-7e02c6200e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:05.287449 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fdb3a7-09f3-4c37-8a84-4bf0e53ae889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:05.287562 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0783baa-ad37-4fc8-96fe-7e02c6200e2b admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:05.287923 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0783baa-ad37-4fc8-96fe-7e02c6200e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:05.288112 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fdb3a7-09f3-4c37-8a84-4bf0e53ae889 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:05.288209 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0783baa-ad37-4fc8-96fe-7e02c6200e2b admin admin] PATH_INFO: `/v3/projects/26f73648aab149159448a568a783adb9/users/c670f9557cd84e1e9d34c73b207698e9/roles/019bde1756cb40de8ce06cef6b261f79` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:05.288386 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fdb3a7-09f3-4c37-8a84-4bf0e53ae889 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:05.288651 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fdb3a7-09f3-4c37-8a84-4bf0e53ae889 admin admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:05.289329 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fdb3a7-09f3-4c37-8a84-4bf0e53ae889 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:57:05.289629 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fdb3a7-09f3-4c37-8a84-4bf0e53ae889 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:05.291292 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fdb3a7-09f3-4c37-8a84-4bf0e53ae889 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:05.305469 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1072/2123] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 19 14:57:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:57:05.310732 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fdb3a7-09f3-4c37-8a84-4bf0e53ae889 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:05.312162 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0783baa-ad37-4fc8-96fe-7e02c6200e2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=26f73648aab149159448a568a783adb9, user_id=c670f9557cd84e1e9d34c73b207698e9, role_id=019bde1756cb40de8ce06cef6b261f79)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:05.316836 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0783baa-ad37-4fc8-96fe-7e02c6200e2b admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:05.321694 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fdb3a7-09f3-4c37-8a84-4bf0e53ae889 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:05.326753 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c96029-bf68-4251-91b2-31357eec2f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:05.327304 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c96029-bf68-4251-91b2-31357eec2f8d admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:05.327578 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c96029-bf68-4251-91b2-31357eec2f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:05.327844 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c96029-bf68-4251-91b2-31357eec2f8d admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:05.328505 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c96029-bf68-4251-91b2-31357eec2f8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:05.330597 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c96029-bf68-4251-91b2-31357eec2f8d admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:05.334753 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1052/2124] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 14:57:05 2022] PUT /identity/v3/projects/26f73648aab149159448a568a783adb9/users/c670f9557cd84e1e9d34c73b207698e9/roles/019bde1756cb40de8ce06cef6b261f79 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:05.339251 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0783baa-ad37-4fc8-96fe-7e02c6200e2b admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:05.344547 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:05.361941 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1073/2125] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 14:57:05 2022] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:57:05.366848 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c96029-bf68-4251-91b2-31357eec2f8d admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:05.416616 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0783baa-ad37-4fc8-96fe-7e02c6200e2b admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:05.430881 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c96029-bf68-4251-91b2-31357eec2f8d admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:05.435721 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9d76c4-38eb-465c-9d70-4a469ed731c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:05.436348 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9d76c4-38eb-465c-9d70-4a469ed731c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:05.436773 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9d76c4-38eb-465c-9d70-4a469ed731c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:05.437072 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9d76c4-38eb-465c-9d70-4a469ed731c2 admin admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:05.437713 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9d76c4-38eb-465c-9d70-4a469ed731c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:05.439663 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9d76c4-38eb-465c-9d70-4a469ed731c2 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:05.463103 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1074/2126] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 14:57:05 2022] POST /identity/v3/users => generated 286 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 14:57:05.467063 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9d76c4-38eb-465c-9d70-4a469ed731c2 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:05.478030 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9d76c4-38eb-465c-9d70-4a469ed731c2 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:05.481204 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd6ad5d-d1a4-4823-a474-bc3e99043d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:05.481824 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd6ad5d-d1a4-4823-a474-bc3e99043d80 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:05.482099 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd6ad5d-d1a4-4823-a474-bc3e99043d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:05.482389 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd6ad5d-d1a4-4823-a474-bc3e99043d80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:05.483089 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd6ad5d-d1a4-4823-a474-bc3e99043d80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:05.484096 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eea703-d7c2-41fc-918f-8e785b012363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:05.484648 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd6ad5d-d1a4-4823-a474-bc3e99043d80 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:05.484775 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eea703-d7c2-41fc-918f-8e785b012363 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:05.484958 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eea703-d7c2-41fc-918f-8e785b012363 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:05.485263 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eea703-d7c2-41fc-918f-8e785b012363 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:05.485903 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eea703-d7c2-41fc-918f-8e785b012363 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:05.487627 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eea703-d7c2-41fc-918f-8e785b012363 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:05.495550 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1053/2127] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:57:05 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:57:05.500316 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd6ad5d-d1a4-4823-a474-bc3e99043d80 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:05.501810 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1075/2128] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:57:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 14:57:05.502720 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eea703-d7c2-41fc-918f-8e785b012363 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:05.515172 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eea703-d7c2-41fc-918f-8e785b012363 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:05.516519 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd6ad5d-d1a4-4823-a474-bc3e99043d80 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:05.521564 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61f0a5a-a242-4887-bda1-e9a1cbf945a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:05.523697 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61f0a5a-a242-4887-bda1-e9a1cbf945a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:05.523697 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61f0a5a-a242-4887-bda1-e9a1cbf945a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:05.523697 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61f0a5a-a242-4887-bda1-e9a1cbf945a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:05.524137 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61f0a5a-a242-4887-bda1-e9a1cbf945a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:05.525654 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41f968a-f420-4d3d-bfe1-601d6740ce9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:05.526307 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61f0a5a-a242-4887-bda1-e9a1cbf945a5 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:05.526432 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f968a-f420-4d3d-bfe1-601d6740ce9e admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:05.526588 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f968a-f420-4d3d-bfe1-601d6740ce9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:05.526886 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f968a-f420-4d3d-bfe1-601d6740ce9e admin admin] PATH_INFO: `/v3/projects/26f73648aab149159448a568a783adb9/users/c670f9557cd84e1e9d34c73b207698e9/roles/019bde1756cb40de8ce06cef6b261f79` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:05.528936 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41f968a-f420-4d3d-bfe1-601d6740ce9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=26f73648aab149159448a568a783adb9, user_id=c670f9557cd84e1e9d34c73b207698e9, role_id=019bde1756cb40de8ce06cef6b261f79)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:05.532356 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41f968a-f420-4d3d-bfe1-601d6740ce9e admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:05.549676 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1076/2129] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:57:05 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:57:05.550953 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61f0a5a-a242-4887-bda1-e9a1cbf945a5 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:05.551303 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1054/2130] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 14:57:05 2022] PUT /identity/v3/projects/26f73648aab149159448a568a783adb9/users/c670f9557cd84e1e9d34c73b207698e9/roles/019bde1756cb40de8ce06cef6b261f79 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:05.561663 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0658a6d-6d3f-45c1-b7e9-ae0db9457379 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:05.561872 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61f0a5a-a242-4887-bda1-e9a1cbf945a5 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:05.561972 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0658a6d-6d3f-45c1-b7e9-ae0db9457379 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:05.562210 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0658a6d-6d3f-45c1-b7e9-ae0db9457379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:05.599682 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-a0658a6d-6d3f-45c1-b7e9-ae0db9457379 None None] MFA Rules not processed for user `c670f9557cd84e1e9d34c73b207698e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:05.601427 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a0658a6d-6d3f-45c1-b7e9-ae0db9457379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:05.630363 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1aa836-24dc-408e-b681-a536b5d1a411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:05.631021 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1aa836-24dc-408e-b681-a536b5d1a411 admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:05.631304 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1aa836-24dc-408e-b681-a536b5d1a411 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:05.631621 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1aa836-24dc-408e-b681-a536b5d1a411 admin admin] PATH_INFO: `/v3/projects/eba4013b8c6e4eacaf090b7c04451527/users/cf6e0ff5391247558bfad031e08a1c1a/roles/74de6794e3b3422b93d26f993d260c35` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:05.633916 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:05.649549 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1aa836-24dc-408e-b681-a536b5d1a411 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eba4013b8c6e4eacaf090b7c04451527, user_id=cf6e0ff5391247558bfad031e08a1c1a, role_id=74de6794e3b3422b93d26f993d260c35)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:05.652220 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1aa836-24dc-408e-b681-a536b5d1a411 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:05.673556 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1077/2131] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 14:57:05 2022] PUT /identity/v3/projects/eba4013b8c6e4eacaf090b7c04451527/users/cf6e0ff5391247558bfad031e08a1c1a/roles/74de6794e3b3422b93d26f993d260c35 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 14:57:05.678133 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28462e65-491a-4d97-8177-6b44cf6b9120 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:05.678477 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28462e65-491a-4d97-8177-6b44cf6b9120 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:05.678950 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28462e65-491a-4d97-8177-6b44cf6b9120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:05.681261 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1055/2132] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:57:05 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 14:57:05.691099 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0658a6d-6d3f-45c1-b7e9-ae0db9457379 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:05.692692 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a0658a6d-6d3f-45c1-b7e9-ae0db9457379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:05.699045 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-28462e65-491a-4d97-8177-6b44cf6b9120 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:05.700226 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-28462e65-491a-4d97-8177-6b44cf6b9120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:05.715516 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:05.765504 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0658a6d-6d3f-45c1-b7e9-ae0db9457379 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:05.771253 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1078/2133] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:57:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 14:57:05.783483 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28462e65-491a-4d97-8177-6b44cf6b9120 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:05.785236 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-28462e65-491a-4d97-8177-6b44cf6b9120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:05.840100 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304964f2-84df-4ff3-b375-fcd96e1b1861 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df648c909ddb41418128b43f925f5ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:05.840769 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304964f2-84df-4ff3-b375-fcd96e1b1861 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:05.841080 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304964f2-84df-4ff3-b375-fcd96e1b1861 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:05.841349 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304964f2-84df-4ff3-b375-fcd96e1b1861 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:05.861303 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28462e65-491a-4d97-8177-6b44cf6b9120 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:05.866480 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56a709e-1da7-4812-a819-246b82914838 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:05.867347 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56a709e-1da7-4812-a819-246b82914838 service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:05.868217 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56a709e-1da7-4812-a819-246b82914838 service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:05.868492 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56a709e-1da7-4812-a819-246b82914838 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:05.880931 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56a709e-1da7-4812-a819-246b82914838 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:05.882508 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56a709e-1da7-4812-a819-246b82914838 service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:05.900745 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1079/2134] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:57:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:57:05.920038 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304964f2-84df-4ff3-b375-fcd96e1b1861 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:05.921544 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304964f2-84df-4ff3-b375-fcd96e1b1861 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:05.934507 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1056/2135] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:57:05 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 14:57:06.050815 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56a709e-1da7-4812-a819-246b82914838 service neutron] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:06.069201 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56a709e-1da7-4812-a819-246b82914838 service neutron] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:06.074773 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f465d997-76df-49d2-b69f-1613dc46d1af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df648c909ddb41418128b43f925f5ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:06.075540 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f465d997-76df-49d2-b69f-1613dc46d1af service cinder] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:06.076491 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f465d997-76df-49d2-b69f-1613dc46d1af service cinder] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:06.076898 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f465d997-76df-49d2-b69f-1613dc46d1af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:06.079955 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-f465d997-76df-49d2-b69f-1613dc46d1af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:06.093546 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304964f2-84df-4ff3-b375-fcd96e1b1861 service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:06.095107 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-304964f2-84df-4ff3-b375-fcd96e1b1861 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:06.122652 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304964f2-84df-4ff3-b375-fcd96e1b1861 service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:06.129174 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ace128-7d1c-402e-b64f-f3147802d580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:06.129901 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ace128-7d1c-402e-b64f-f3147802d580 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:06.130183 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ace128-7d1c-402e-b64f-f3147802d580 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:06.130617 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ace128-7d1c-402e-b64f-f3147802d580 admin admin] PATH_INFO: `/v3/users/018c1393661d4f25a00c63a8252bdaf1` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:06.131984 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ace128-7d1c-402e-b64f-f3147802d580 admin admin] RBAC: Authorizing `identity:delete_user(user_id=018c1393661d4f25a00c63a8252bdaf1)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:06.134940 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ace128-7d1c-402e-b64f-f3147802d580 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:06.179503 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f465d997-76df-49d2-b69f-1613dc46d1af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:06.181130 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f465d997-76df-49d2-b69f-1613dc46d1af service cinder] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:06.194091 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1080/2136] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:57:06 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:57:06.216026 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-16ace128-7d1c-402e-b64f-f3147802d580 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '018c1393661d4f25a00c63a8252bdaf1'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:06.231117 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-16ace128-7d1c-402e-b64f-f3147802d580 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '018c1393661d4f25a00c63a8252bdaf1'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:06.232080 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-16ace128-7d1c-402e-b64f-f3147802d580 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '018c1393661d4f25a00c63a8252bdaf1'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:06.233439 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-16ace128-7d1c-402e-b64f-f3147802d580 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '018c1393661d4f25a00c63a8252bdaf1'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:06.246320 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-16ace128-7d1c-402e-b64f-f3147802d580 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '018c1393661d4f25a00c63a8252bdaf1'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:06.261968 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:06.279084 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1057/2137] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 14:57:06 2022] DELETE /identity/v3/users/018c1393661d4f25a00c63a8252bdaf1 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:06.284021 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf0a3c2-de2d-4e82-bce5-d6cd4d59f98e None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:06.284579 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf0a3c2-de2d-4e82-bce5-d6cd4d59f98e None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:06.284579 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf0a3c2-de2d-4e82-bce5-d6cd4d59f98e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:06.319640 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-2cf0a3c2-de2d-4e82-bce5-d6cd4d59f98e None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:06.321856 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-2cf0a3c2-de2d-4e82-bce5-d6cd4d59f98e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:06.346378 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:06.408586 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1081/2138] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:57:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:06.432118 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ace128-7d1c-402e-b64f-f3147802d580 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:06.436958 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-16ace128-7d1c-402e-b64f-f3147802d580 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:06.545035 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ace128-7d1c-402e-b64f-f3147802d580 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:06.566241 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edd67f3-d51d-4774-90c3-4325d5fcf85b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:06.566241 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edd67f3-d51d-4774-90c3-4325d5fcf85b service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:06.566656 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edd67f3-d51d-4774-90c3-4325d5fcf85b service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:06.566772 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edd67f3-d51d-4774-90c3-4325d5fcf85b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:06.624866 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edd67f3-d51d-4774-90c3-4325d5fcf85b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:06.629477 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edd67f3-d51d-4774-90c3-4325d5fcf85b service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:06.646551 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1058/2139] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:57:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:57:06.664943 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf0a3c2-de2d-4e82-bce5-d6cd4d59f98e None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:06.666609 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-2cf0a3c2-de2d-4e82-bce5-d6cd4d59f98e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:06.681121 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf0a3c2-de2d-4e82-bce5-d6cd4d59f98e None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:06.686237 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3d8c6f-405a-4b91-a8a9-d596a4ddab51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:06.687155 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3d8c6f-405a-4b91-a8a9-d596a4ddab51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:06.687741 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3d8c6f-405a-4b91-a8a9-d596a4ddab51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:06.688210 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3d8c6f-405a-4b91-a8a9-d596a4ddab51 admin admin] PATH_INFO: `/v3/users/a07ceef8525c4e9fa371f6aa95a3960c` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:06.689719 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3d8c6f-405a-4b91-a8a9-d596a4ddab51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a07ceef8525c4e9fa371f6aa95a3960c)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:06.691855 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3d8c6f-405a-4b91-a8a9-d596a4ddab51 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:06.785156 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-be3d8c6f-405a-4b91-a8a9-d596a4ddab51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a07ceef8525c4e9fa371f6aa95a3960c'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:06.794686 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-be3d8c6f-405a-4b91-a8a9-d596a4ddab51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a07ceef8525c4e9fa371f6aa95a3960c'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:06.796109 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-be3d8c6f-405a-4b91-a8a9-d596a4ddab51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a07ceef8525c4e9fa371f6aa95a3960c'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:06.796109 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-be3d8c6f-405a-4b91-a8a9-d596a4ddab51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a07ceef8525c4e9fa371f6aa95a3960c'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:06.818547 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-be3d8c6f-405a-4b91-a8a9-d596a4ddab51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a07ceef8525c4e9fa371f6aa95a3960c'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:06.839259 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1082/2140] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 14:57:06 2022] DELETE /identity/v3/users/a07ceef8525c4e9fa371f6aa95a3960c => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 14:57:06.847098 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74bcd42-cb6c-44de-b790-5de61acfd759 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:06.847098 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74bcd42-cb6c-44de-b790-5de61acfd759 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:06.847098 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74bcd42-cb6c-44de-b790-5de61acfd759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:06.867361 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-f74bcd42-cb6c-44de-b790-5de61acfd759 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:06.868856 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f74bcd42-cb6c-44de-b790-5de61acfd759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:07.016811 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1059/2141] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:57:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 14:57:07.028186 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3d8c6f-405a-4b91-a8a9-d596a4ddab51 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:07.029964 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-be3d8c6f-405a-4b91-a8a9-d596a4ddab51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:07.162743 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3d8c6f-405a-4b91-a8a9-d596a4ddab51 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:07.167302 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03862f8f-8955-4e57-9685-be014f04b912 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:07.168088 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03862f8f-8955-4e57-9685-be014f04b912 service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:07.168436 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03862f8f-8955-4e57-9685-be014f04b912 service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:07.168773 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03862f8f-8955-4e57-9685-be014f04b912 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:07.185968 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03862f8f-8955-4e57-9685-be014f04b912 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:07.187535 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03862f8f-8955-4e57-9685-be014f04b912 service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:07.200567 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1083/2142] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:57:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:57:07.476590 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74bcd42-cb6c-44de-b790-5de61acfd759 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:07.478144 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f74bcd42-cb6c-44de-b790-5de61acfd759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:07.497189 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74bcd42-cb6c-44de-b790-5de61acfd759 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:07.503200 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01a6d76-a06d-4f6f-be85-062d4f91e7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:07.503858 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a6d76-a06d-4f6f-be85-062d4f91e7a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:07.504101 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a6d76-a06d-4f6f-be85-062d4f91e7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:07.504366 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a6d76-a06d-4f6f-be85-062d4f91e7a8 admin admin] PATH_INFO: `/v3/projects/525b177a5e934239b7af139d070720f9` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:07.505584 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01a6d76-a06d-4f6f-be85-062d4f91e7a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=525b177a5e934239b7af139d070720f9)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:07.507600 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01a6d76-a06d-4f6f-be85-062d4f91e7a8 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:07.584178 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c01a6d76-a06d-4f6f-be85-062d4f91e7a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '525b177a5e934239b7af139d070720f9', 'request_id': 'req-c01a6d76-a06d-4f6f-be85-062d4f91e7a8'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:07.591741 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c01a6d76-a06d-4f6f-be85-062d4f91e7a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '525b177a5e934239b7af139d070720f9', 'request_id': 'req-c01a6d76-a06d-4f6f-be85-062d4f91e7a8'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:07.602722 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c01a6d76-a06d-4f6f-be85-062d4f91e7a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '525b177a5e934239b7af139d070720f9', 'request_id': 'req-c01a6d76-a06d-4f6f-be85-062d4f91e7a8'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:07.615210 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c01a6d76-a06d-4f6f-be85-062d4f91e7a8 admin admin] The token cache is being invalidate because project 525b177a5e934239b7af139d070720f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:57:07.615479 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c01a6d76-a06d-4f6f-be85-062d4f91e7a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:07.616334 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c01a6d76-a06d-4f6f-be85-062d4f91e7a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:07.618739 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1060/2143] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 14:57:07 2022] DELETE /identity/v3/projects/525b177a5e934239b7af139d070720f9 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:07.625054 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03862f8f-8955-4e57-9685-be014f04b912 service neutron] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:07.639321 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03862f8f-8955-4e57-9685-be014f04b912 service neutron] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:07.689089 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:07.728774 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531d6cbc-b56f-4fc5-b575-80a406b193d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:07.729854 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d6cbc-b56f-4fc5-b575-80a406b193d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:07.730181 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d6cbc-b56f-4fc5-b575-80a406b193d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:07.730603 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d6cbc-b56f-4fc5-b575-80a406b193d9 admin admin] PATH_INFO: `/v3/users/a43b95b8ae3945e484c31bf4c4785664` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:07.732650 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531d6cbc-b56f-4fc5-b575-80a406b193d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a43b95b8ae3945e484c31bf4c4785664)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:07.735371 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531d6cbc-b56f-4fc5-b575-80a406b193d9 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:07.828496 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-531d6cbc-b56f-4fc5-b575-80a406b193d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a43b95b8ae3945e484c31bf4c4785664'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:07.847564 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-531d6cbc-b56f-4fc5-b575-80a406b193d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a43b95b8ae3945e484c31bf4c4785664'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:07.848957 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-531d6cbc-b56f-4fc5-b575-80a406b193d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a43b95b8ae3945e484c31bf4c4785664'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:07.850144 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-531d6cbc-b56f-4fc5-b575-80a406b193d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a43b95b8ae3945e484c31bf4c4785664'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:07.863193 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01a6d76-a06d-4f6f-be85-062d4f91e7a8 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:07.864698 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-c01a6d76-a06d-4f6f-be85-062d4f91e7a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:07.879842 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-531d6cbc-b56f-4fc5-b575-80a406b193d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a43b95b8ae3945e484c31bf4c4785664'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:07.885790 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01a6d76-a06d-4f6f-be85-062d4f91e7a8 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:07.892635 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c273476c-8aba-4a92-bace-0766d9677e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:07.893624 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c273476c-8aba-4a92-bace-0766d9677e5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:07.894010 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c273476c-8aba-4a92-bace-0766d9677e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:07.894388 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c273476c-8aba-4a92-bace-0766d9677e5a admin admin] PATH_INFO: `/v3/projects/94c3c332577b4c1d9e986c7e5db9a455` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:07.895695 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c273476c-8aba-4a92-bace-0766d9677e5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=94c3c332577b4c1d9e986c7e5db9a455)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:07.898398 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c273476c-8aba-4a92-bace-0766d9677e5a admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:07.914852 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1084/2144] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 14:57:07 2022] DELETE /identity/v3/users/a43b95b8ae3945e484c31bf4c4785664 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:07.926529 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:07.986921 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c273476c-8aba-4a92-bace-0766d9677e5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94c3c332577b4c1d9e986c7e5db9a455', 'request_id': 'req-c273476c-8aba-4a92-bace-0766d9677e5a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:08.005331 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c273476c-8aba-4a92-bace-0766d9677e5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94c3c332577b4c1d9e986c7e5db9a455', 'request_id': 'req-c273476c-8aba-4a92-bace-0766d9677e5a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:08.020854 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c273476c-8aba-4a92-bace-0766d9677e5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94c3c332577b4c1d9e986c7e5db9a455', 'request_id': 'req-c273476c-8aba-4a92-bace-0766d9677e5a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:08.036927 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c273476c-8aba-4a92-bace-0766d9677e5a admin admin] The token cache is being invalidate because project 94c3c332577b4c1d9e986c7e5db9a455 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:57:08.037848 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c273476c-8aba-4a92-bace-0766d9677e5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:08.039004 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c273476c-8aba-4a92-bace-0766d9677e5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:08.041170 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1061/2145] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 14:57:07 2022] DELETE /identity/v3/projects/94c3c332577b4c1d9e986c7e5db9a455 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:08.047870 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531d6cbc-b56f-4fc5-b575-80a406b193d9 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:08.051182 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-531d6cbc-b56f-4fc5-b575-80a406b193d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:08.218513 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531d6cbc-b56f-4fc5-b575-80a406b193d9 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:08.413118 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0530d942-4007-43cc-aa4c-2c1fb614c5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:08.413980 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0530d942-4007-43cc-aa4c-2c1fb614c5bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:08.414270 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0530d942-4007-43cc-aa4c-2c1fb614c5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:08.414560 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0530d942-4007-43cc-aa4c-2c1fb614c5bf admin admin] PATH_INFO: `/v3/users/c670f9557cd84e1e9d34c73b207698e9` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:08.418707 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0530d942-4007-43cc-aa4c-2c1fb614c5bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=c670f9557cd84e1e9d34c73b207698e9)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:08.427179 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0530d942-4007-43cc-aa4c-2c1fb614c5bf admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:08.440971 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:08.568224 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-0530d942-4007-43cc-aa4c-2c1fb614c5bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c670f9557cd84e1e9d34c73b207698e9'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:08.583400 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-0530d942-4007-43cc-aa4c-2c1fb614c5bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c670f9557cd84e1e9d34c73b207698e9'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:08.584218 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-0530d942-4007-43cc-aa4c-2c1fb614c5bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c670f9557cd84e1e9d34c73b207698e9'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:08.585413 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-0530d942-4007-43cc-aa4c-2c1fb614c5bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c670f9557cd84e1e9d34c73b207698e9'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:08.609348 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-0530d942-4007-43cc-aa4c-2c1fb614c5bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c670f9557cd84e1e9d34c73b207698e9'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:08.638966 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1085/2146] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 14:57:08 2022] DELETE /identity/v3/users/c670f9557cd84e1e9d34c73b207698e9 => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:08.710337 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c273476c-8aba-4a92-bace-0766d9677e5a admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:08.712658 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-c273476c-8aba-4a92-bace-0766d9677e5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:08.734665 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c273476c-8aba-4a92-bace-0766d9677e5a admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:08.890907 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135cb0a7-7eb8-4022-a38c-01a791d5e05c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:08.892716 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135cb0a7-7eb8-4022-a38c-01a791d5e05c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:08.892716 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135cb0a7-7eb8-4022-a38c-01a791d5e05c admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:08.892716 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135cb0a7-7eb8-4022-a38c-01a791d5e05c admin admin] PATH_INFO: `/v3/projects/0881172ebf3f495bbcae0b0c810742d0` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:08.893902 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135cb0a7-7eb8-4022-a38c-01a791d5e05c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0881172ebf3f495bbcae0b0c810742d0)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:08.896850 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135cb0a7-7eb8-4022-a38c-01a791d5e05c admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:08.989363 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-135cb0a7-7eb8-4022-a38c-01a791d5e05c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0881172ebf3f495bbcae0b0c810742d0', 'request_id': 'req-135cb0a7-7eb8-4022-a38c-01a791d5e05c'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:09.006184 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-135cb0a7-7eb8-4022-a38c-01a791d5e05c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0881172ebf3f495bbcae0b0c810742d0', 'request_id': 'req-135cb0a7-7eb8-4022-a38c-01a791d5e05c'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:09.024854 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-135cb0a7-7eb8-4022-a38c-01a791d5e05c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0881172ebf3f495bbcae0b0c810742d0', 'request_id': 'req-135cb0a7-7eb8-4022-a38c-01a791d5e05c'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:09.044837 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-135cb0a7-7eb8-4022-a38c-01a791d5e05c admin admin] The token cache is being invalidate because project 0881172ebf3f495bbcae0b0c810742d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:57:09.045226 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-135cb0a7-7eb8-4022-a38c-01a791d5e05c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:09.047081 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-135cb0a7-7eb8-4022-a38c-01a791d5e05c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:09.049236 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1062/2147] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 14:57:08 2022] DELETE /identity/v3/projects/0881172ebf3f495bbcae0b0c810742d0 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:09.055426 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56ee312-dc2a-469c-bb45-851a1fb2c84c None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:09.055623 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56ee312-dc2a-469c-bb45-851a1fb2c84c None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:09.055892 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56ee312-dc2a-469c-bb45-851a1fb2c84c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:09.093971 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-e56ee312-dc2a-469c-bb45-851a1fb2c84c None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:09.095741 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-e56ee312-dc2a-469c-bb45-851a1fb2c84c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:09.233193 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1086/2148] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:57:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:09.240152 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf83bcf5-1d13-41be-810b-1840c25b736f None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:09.240513 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf83bcf5-1d13-41be-810b-1840c25b736f None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:09.241677 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf83bcf5-1d13-41be-810b-1840c25b736f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:09.289982 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-cf83bcf5-1d13-41be-810b-1840c25b736f None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:09.292138 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-cf83bcf5-1d13-41be-810b-1840c25b736f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:09.304595 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1063/2149] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:57:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:09.310772 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56ee312-dc2a-469c-bb45-851a1fb2c84c None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:09.359906 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56ee312-dc2a-469c-bb45-851a1fb2c84c None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:09.379496 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075d634d-10e4-4227-8e3e-8ea2b7d136a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:09.380659 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d634d-10e4-4227-8e3e-8ea2b7d136a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:09.381435 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d634d-10e4-4227-8e3e-8ea2b7d136a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:09.382433 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d634d-10e4-4227-8e3e-8ea2b7d136a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:09.383880 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075d634d-10e4-4227-8e3e-8ea2b7d136a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:57:09.384578 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075d634d-10e4-4227-8e3e-8ea2b7d136a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:09.389465 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075d634d-10e4-4227-8e3e-8ea2b7d136a3 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:09.413064 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1087/2150] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 19 14:57:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:57:09.416625 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf83bcf5-1d13-41be-810b-1840c25b736f None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:09.444965 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf83bcf5-1d13-41be-810b-1840c25b736f None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:09.450504 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8077514a-ba45-4cee-bbd7-5e4a6a48d82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:09.451260 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8077514a-ba45-4cee-bbd7-5e4a6a48d82b admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:09.451594 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8077514a-ba45-4cee-bbd7-5e4a6a48d82b admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:09.451935 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8077514a-ba45-4cee-bbd7-5e4a6a48d82b admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:09.452672 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8077514a-ba45-4cee-bbd7-5e4a6a48d82b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:09.454858 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8077514a-ba45-4cee-bbd7-5e4a6a48d82b admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:09.514664 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075d634d-10e4-4227-8e3e-8ea2b7d136a3 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:09.516925 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1064/2151] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 14:57:09 2022] POST /identity/v3/projects => generated 375 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:57:09.531097 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075d634d-10e4-4227-8e3e-8ea2b7d136a3 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:09.582435 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8077514a-ba45-4cee-bbd7-5e4a6a48d82b admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:09.584827 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-8077514a-ba45-4cee-bbd7-5e4a6a48d82b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:09.596254 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:09.660020 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba17e13-c64a-48da-a70a-05115b0bd132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:09.661436 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba17e13-c64a-48da-a70a-05115b0bd132 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:09.661881 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba17e13-c64a-48da-a70a-05115b0bd132 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:09.662306 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba17e13-c64a-48da-a70a-05115b0bd132 admin admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:09.664059 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba17e13-c64a-48da-a70a-05115b0bd132 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:09.666603 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba17e13-c64a-48da-a70a-05115b0bd132 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:09.702562 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1088/2152] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 14:57:09 2022] POST /identity/v3/users => generated 288 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:57:09.707340 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba17e13-c64a-48da-a70a-05115b0bd132 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:09.713490 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8077514a-ba45-4cee-bbd7-5e4a6a48d82b admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:09.715296 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:09.721311 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f399ec-ef00-4155-9072-c1d2285f7dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:09.722372 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba17e13-c64a-48da-a70a-05115b0bd132 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:09.722530 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f399ec-ef00-4155-9072-c1d2285f7dcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:09.722530 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f399ec-ef00-4155-9072-c1d2285f7dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:09.722992 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f399ec-ef00-4155-9072-c1d2285f7dcc admin admin] PATH_INFO: `/v3/projects/26f73648aab149159448a568a783adb9` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:09.725512 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f399ec-ef00-4155-9072-c1d2285f7dcc admin admin] RBAC: Authorizing `identity:delete_project(project_id=26f73648aab149159448a568a783adb9)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:09.729880 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f399ec-ef00-4155-9072-c1d2285f7dcc admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:09.731564 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f781fad7-3747-41f1-83cd-eff39feccefa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:09.732580 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f781fad7-3747-41f1-83cd-eff39feccefa admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:09.732940 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f781fad7-3747-41f1-83cd-eff39feccefa admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:09.733296 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f781fad7-3747-41f1-83cd-eff39feccefa admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:09.734328 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f781fad7-3747-41f1-83cd-eff39feccefa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:09.735745 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f781fad7-3747-41f1-83cd-eff39feccefa admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:09.751931 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1089/2153] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:57:09 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 14:57:09.758175 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f781fad7-3747-41f1-83cd-eff39feccefa admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:09.774199 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f781fad7-3747-41f1-83cd-eff39feccefa admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:09.781395 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b412a7-26f3-4f59-acea-ef72cb10423d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:09.782387 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b412a7-26f3-4f59-acea-ef72cb10423d admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:09.782770 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b412a7-26f3-4f59-acea-ef72cb10423d admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:09.783106 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b412a7-26f3-4f59-acea-ef72cb10423d admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:09.783885 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b412a7-26f3-4f59-acea-ef72cb10423d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:09.785678 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b412a7-26f3-4f59-acea-ef72cb10423d admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:09.804785 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1090/2154] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:57:09 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:57:09.806329 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b412a7-26f3-4f59-acea-ef72cb10423d admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:09.818131 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b412a7-26f3-4f59-acea-ef72cb10423d admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:09.818443 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c6f399ec-ef00-4155-9072-c1d2285f7dcc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26f73648aab149159448a568a783adb9', 'request_id': 'req-c6f399ec-ef00-4155-9072-c1d2285f7dcc'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:09.836745 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c6f399ec-ef00-4155-9072-c1d2285f7dcc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26f73648aab149159448a568a783adb9', 'request_id': 'req-c6f399ec-ef00-4155-9072-c1d2285f7dcc'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:09.858974 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c6f399ec-ef00-4155-9072-c1d2285f7dcc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26f73648aab149159448a568a783adb9', 'request_id': 'req-c6f399ec-ef00-4155-9072-c1d2285f7dcc'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:09.890458 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c6f399ec-ef00-4155-9072-c1d2285f7dcc admin admin] The token cache is being invalidate because project 26f73648aab149159448a568a783adb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:57:09.890800 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c6f399ec-ef00-4155-9072-c1d2285f7dcc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:09.897284 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c6f399ec-ef00-4155-9072-c1d2285f7dcc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:09.902490 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1065/2155] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 14:57:09 2022] DELETE /identity/v3/projects/26f73648aab149159448a568a783adb9 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:09.908108 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e47fbe2-c84a-4b6e-8a6b-e443b16cc33e None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:09.908426 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e47fbe2-c84a-4b6e-8a6b-e443b16cc33e None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:09.908853 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e47fbe2-c84a-4b6e-8a6b-e443b16cc33e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:09.947783 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-2e47fbe2-c84a-4b6e-8a6b-e443b16cc33e None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:09.949177 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2e47fbe2-c84a-4b6e-8a6b-e443b16cc33e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:09.954876 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709cd59d-fd84-4ba2-b77e-2f1e55f253c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:09.956809 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709cd59d-fd84-4ba2-b77e-2f1e55f253c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:09.957376 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709cd59d-fd84-4ba2-b77e-2f1e55f253c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:09.960464 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1066/2156] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:57:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 14:57:09.960638 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709cd59d-fd84-4ba2-b77e-2f1e55f253c9 admin admin] PATH_INFO: `/v3/projects/1e2e276467974e519657accfcd0cee33/users/9951096677d04427bea331d95f793560/roles/74de6794e3b3422b93d26f993d260c35` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:09.970168 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ad80a-bf7c-431f-b89e-e995534766b1 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:09.972538 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ad80a-bf7c-431f-b89e-e995534766b1 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:09.974883 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ad80a-bf7c-431f-b89e-e995534766b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:10.023542 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709cd59d-fd84-4ba2-b77e-2f1e55f253c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e2e276467974e519657accfcd0cee33, user_id=9951096677d04427bea331d95f793560, role_id=74de6794e3b3422b93d26f993d260c35)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:10.032289 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709cd59d-fd84-4ba2-b77e-2f1e55f253c9 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:10.052570 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-f93ad80a-bf7c-431f-b89e-e995534766b1 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:10.057756 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f93ad80a-bf7c-431f-b89e-e995534766b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:10.074375 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1091/2157] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 14:57:09 2022] PUT /identity/v3/projects/1e2e276467974e519657accfcd0cee33/users/9951096677d04427bea331d95f793560/roles/74de6794e3b3422b93d26f993d260c35 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:10.096344 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473aaf1d-1493-4e38-b306-53eed8c56e70 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:10.097105 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473aaf1d-1493-4e38-b306-53eed8c56e70 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:10.097556 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473aaf1d-1493-4e38-b306-53eed8c56e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:10.171688 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-473aaf1d-1493-4e38-b306-53eed8c56e70 None None] MFA Rules not processed for user `9951096677d04427bea331d95f793560`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:10.173841 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-473aaf1d-1493-4e38-b306-53eed8c56e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:10.257693 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1067/2158] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:57:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:10.262865 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93ad80a-bf7c-431f-b89e-e995534766b1 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:10.282967 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93ad80a-bf7c-431f-b89e-e995534766b1 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:10.302347 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fc264c-e899-4a89-8118-a4fbc36c238d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:10.320701 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fc264c-e899-4a89-8118-a4fbc36c238d admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:10.323349 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fc264c-e899-4a89-8118-a4fbc36c238d admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:10.323870 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fc264c-e899-4a89-8118-a4fbc36c238d admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:10.326486 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fc264c-e899-4a89-8118-a4fbc36c238d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:57:10.329114 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fc264c-e899-4a89-8118-a4fbc36c238d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:10.330940 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fc264c-e899-4a89-8118-a4fbc36c238d admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:10.357030 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1092/2159] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:57:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:10.357030 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473aaf1d-1493-4e38-b306-53eed8c56e70 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:10.357030 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-473aaf1d-1493-4e38-b306-53eed8c56e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:10.370755 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473aaf1d-1493-4e38-b306-53eed8c56e70 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:10.371066 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1068/2160] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 19 14:57:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:57:10.371883 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fc264c-e899-4a89-8118-a4fbc36c238d admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:10.375066 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870346ae-0a30-41cd-9b34-6cd897cc2223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:10.375803 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870346ae-0a30-41cd-9b34-6cd897cc2223 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:10.376178 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870346ae-0a30-41cd-9b34-6cd897cc2223 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:10.376548 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870346ae-0a30-41cd-9b34-6cd897cc2223 admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:10.377666 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870346ae-0a30-41cd-9b34-6cd897cc2223 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:10.379597 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870346ae-0a30-41cd-9b34-6cd897cc2223 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:10.394451 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fc264c-e899-4a89-8118-a4fbc36c238d admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:10.401352 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3244e07d-d82e-44f8-984d-cebd53d07e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:10.402155 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244e07d-d82e-44f8-984d-cebd53d07e26 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:10.407011 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244e07d-d82e-44f8-984d-cebd53d07e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:10.407752 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244e07d-d82e-44f8-984d-cebd53d07e26 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:10.408913 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3244e07d-d82e-44f8-984d-cebd53d07e26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:10.410945 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3244e07d-d82e-44f8-984d-cebd53d07e26 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:10.421711 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1093/2161] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 14:57:10 2022] POST /identity/v3/projects => generated 373 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:57:10.423653 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870346ae-0a30-41cd-9b34-6cd897cc2223 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:10.446816 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:10.472026 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1069/2162] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 14:57:10 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:57:10.477134 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3244e07d-d82e-44f8-984d-cebd53d07e26 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:10.480839 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:10.525635 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870346ae-0a30-41cd-9b34-6cd897cc2223 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:10.566665 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3244e07d-d82e-44f8-984d-cebd53d07e26 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:10.573519 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbbcab6-bad2-4993-a5e8-b56c4a97d5c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:10.574186 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbbcab6-bad2-4993-a5e8-b56c4a97d5c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:10.574474 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbbcab6-bad2-4993-a5e8-b56c4a97d5c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:10.574752 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbbcab6-bad2-4993-a5e8-b56c4a97d5c7 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:10.575785 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbbcab6-bad2-4993-a5e8-b56c4a97d5c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:10.578138 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbbcab6-bad2-4993-a5e8-b56c4a97d5c7 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:10.607926 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1070/2163] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 14:57:10 2022] POST /identity/v3/users => generated 293 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 14:57:10.609505 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c829fe5c-3a8f-4f40-a1f1-669357d47bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:10.610327 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c829fe5c-3a8f-4f40-a1f1-669357d47bb1 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:10.610862 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c829fe5c-3a8f-4f40-a1f1-669357d47bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:10.611040 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c829fe5c-3a8f-4f40-a1f1-669357d47bb1 admin admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:10.611645 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c829fe5c-3a8f-4f40-a1f1-669357d47bb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:10.612594 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbbcab6-bad2-4993-a5e8-b56c4a97d5c7 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:10.613825 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c829fe5c-3a8f-4f40-a1f1-669357d47bb1 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:10.625898 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbbcab6-bad2-4993-a5e8-b56c4a97d5c7 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:10.642640 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423c6d36-1715-49bf-b71c-428e02e9bbcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:10.643413 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423c6d36-1715-49bf-b71c-428e02e9bbcf admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:10.643760 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423c6d36-1715-49bf-b71c-428e02e9bbcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:10.644364 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423c6d36-1715-49bf-b71c-428e02e9bbcf admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:10.647354 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423c6d36-1715-49bf-b71c-428e02e9bbcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:10.649934 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423c6d36-1715-49bf-b71c-428e02e9bbcf admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:10.655986 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1094/2164] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 14:57:10 2022] POST /identity/v3/users => generated 293 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 14:57:10.660454 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c829fe5c-3a8f-4f40-a1f1-669357d47bb1 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:10.676595 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1071/2165] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:57:10 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:57:10.677983 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423c6d36-1715-49bf-b71c-428e02e9bbcf admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:10.685031 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c829fe5c-3a8f-4f40-a1f1-669357d47bb1 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:10.695270 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6520bbd-82cc-465a-a882-92f00281c0b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:10.695951 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6520bbd-82cc-465a-a882-92f00281c0b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:10.696392 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6520bbd-82cc-465a-a882-92f00281c0b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:10.697420 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6520bbd-82cc-465a-a882-92f00281c0b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:10.698212 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6520bbd-82cc-465a-a882-92f00281c0b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:10.699516 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423c6d36-1715-49bf-b71c-428e02e9bbcf admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:10.700191 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6520bbd-82cc-465a-a882-92f00281c0b3 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:10.705847 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e070d86d-d162-4494-87fe-e79e76da1701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:10.706761 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e070d86d-d162-4494-87fe-e79e76da1701 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:10.707225 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e070d86d-d162-4494-87fe-e79e76da1701 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:10.707724 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e070d86d-d162-4494-87fe-e79e76da1701 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:10.708915 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e070d86d-d162-4494-87fe-e79e76da1701 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:10.711701 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e070d86d-d162-4494-87fe-e79e76da1701 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:10.718330 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1095/2166] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:57:10 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:57:10.719986 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6520bbd-82cc-465a-a882-92f00281c0b3 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:10.731924 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1072/2167] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:57:10 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:57:10.735376 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6520bbd-82cc-465a-a882-92f00281c0b3 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:10.737563 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e070d86d-d162-4494-87fe-e79e76da1701 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:10.742352 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2ed1eb-7bf6-41b4-b608-8ab897a23270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:10.743224 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ed1eb-7bf6-41b4-b608-8ab897a23270 admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:10.743616 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ed1eb-7bf6-41b4-b608-8ab897a23270 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:10.743974 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ed1eb-7bf6-41b4-b608-8ab897a23270 admin admin] PATH_INFO: `/v3/projects/91c50356590a4f27b8a3f6aa6d685ae6/users/c90b59245fd845f09b552f87bc14f805/roles/019bde1756cb40de8ce06cef6b261f79` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:10.750914 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e070d86d-d162-4494-87fe-e79e76da1701 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:10.761279 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec502eb8-2266-4077-a9cf-b3559c2ef829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:10.762010 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec502eb8-2266-4077-a9cf-b3559c2ef829 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:10.762290 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec502eb8-2266-4077-a9cf-b3559c2ef829 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:10.762564 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec502eb8-2266-4077-a9cf-b3559c2ef829 admin admin] PATH_INFO: `/v3/projects/30e01c8bd0ea4503b90b8ff58d1e4e09/users/4f478c7228114e31a83c5b42e6ad08a5/roles/74de6794e3b3422b93d26f993d260c35` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:10.770289 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2ed1eb-7bf6-41b4-b608-8ab897a23270 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91c50356590a4f27b8a3f6aa6d685ae6, user_id=c90b59245fd845f09b552f87bc14f805, role_id=019bde1756cb40de8ce06cef6b261f79)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:10.773782 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2ed1eb-7bf6-41b4-b608-8ab897a23270 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:10.781845 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec502eb8-2266-4077-a9cf-b3559c2ef829 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30e01c8bd0ea4503b90b8ff58d1e4e09, user_id=4f478c7228114e31a83c5b42e6ad08a5, role_id=74de6794e3b3422b93d26f993d260c35)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:10.786995 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec502eb8-2266-4077-a9cf-b3559c2ef829 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:10.796094 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1096/2168] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 14:57:10 2022] PUT /identity/v3/projects/91c50356590a4f27b8a3f6aa6d685ae6/users/c90b59245fd845f09b552f87bc14f805/roles/019bde1756cb40de8ce06cef6b261f79 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:10.800319 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2ed1eb-7bf6-41b4-b608-8ab897a23270 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:10.809134 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1073/2169] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 14:57:10 2022] PUT /identity/v3/projects/30e01c8bd0ea4503b90b8ff58d1e4e09/users/4f478c7228114e31a83c5b42e6ad08a5/roles/74de6794e3b3422b93d26f993d260c35 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 14:57:10.892391 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c88946-3cd2-4779-b31f-2ba9094939f6 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:10.893220 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c88946-3cd2-4779-b31f-2ba9094939f6 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:10.893798 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c88946-3cd2-4779-b31f-2ba9094939f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:10.948695 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2ed1eb-7bf6-41b4-b608-8ab897a23270 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:10.963357 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-05c88946-3cd2-4779-b31f-2ba9094939f6 None None] MFA Rules not processed for user `4f478c7228114e31a83c5b42e6ad08a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:10.964698 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-05c88946-3cd2-4779-b31f-2ba9094939f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:11.042361 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:11.088091 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3848bbb-50a0-47f4-89db-9bcfe59395d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:11.088727 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3848bbb-50a0-47f4-89db-9bcfe59395d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:11.089041 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3848bbb-50a0-47f4-89db-9bcfe59395d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:11.089310 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3848bbb-50a0-47f4-89db-9bcfe59395d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:11.090132 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3848bbb-50a0-47f4-89db-9bcfe59395d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:11.091811 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3848bbb-50a0-47f4-89db-9bcfe59395d4 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:11.110696 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1097/2170] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:57:10 2022] GET /identity/v3/roles => generated 1420 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:57:11.112118 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3848bbb-50a0-47f4-89db-9bcfe59395d4 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:11.135459 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3848bbb-50a0-47f4-89db-9bcfe59395d4 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:11.136016 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1074/2171] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:57:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 14:57:11.141761 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c88946-3cd2-4779-b31f-2ba9094939f6 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:11.144716 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63744236-9c97-4e80-8035-0e42928b1903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:11.146173 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63744236-9c97-4e80-8035-0e42928b1903 admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:11.146455 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63744236-9c97-4e80-8035-0e42928b1903 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:11.146740 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63744236-9c97-4e80-8035-0e42928b1903 admin admin] PATH_INFO: `/v3/projects/91c50356590a4f27b8a3f6aa6d685ae6/users/c90b59245fd845f09b552f87bc14f805/roles/019bde1756cb40de8ce06cef6b261f79` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:11.149246 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63744236-9c97-4e80-8035-0e42928b1903 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91c50356590a4f27b8a3f6aa6d685ae6, user_id=c90b59245fd845f09b552f87bc14f805, role_id=019bde1756cb40de8ce06cef6b261f79)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:11.153505 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63744236-9c97-4e80-8035-0e42928b1903 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:11.156148 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c88946-3cd2-4779-b31f-2ba9094939f6 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:11.162250 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29093ba-79ce-42c4-b477-62a390392d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:11.163323 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29093ba-79ce-42c4-b477-62a390392d6c admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:11.163965 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29093ba-79ce-42c4-b477-62a390392d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:11.164111 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29093ba-79ce-42c4-b477-62a390392d6c admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:11.164882 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29093ba-79ce-42c4-b477-62a390392d6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:11.166995 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29093ba-79ce-42c4-b477-62a390392d6c admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:11.173928 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1098/2172] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 14:57:11 2022] PUT /identity/v3/projects/91c50356590a4f27b8a3f6aa6d685ae6/users/c90b59245fd845f09b552f87bc14f805/roles/019bde1756cb40de8ce06cef6b261f79 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:11.188386 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c594e6e5-86ae-489b-a1cc-8b9ea5798a30 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:11.188625 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c594e6e5-86ae-489b-a1cc-8b9ea5798a30 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:11.188903 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c594e6e5-86ae-489b-a1cc-8b9ea5798a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:11.228882 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-c594e6e5-86ae-489b-a1cc-8b9ea5798a30 None None] MFA Rules not processed for user `c90b59245fd845f09b552f87bc14f805`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:11.230425 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-c594e6e5-86ae-489b-a1cc-8b9ea5798a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:11.237770 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1075/2173] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 14:57:11 2022] POST /identity/v3/projects => generated 385 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 14:57:11.242284 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29093ba-79ce-42c4-b477-62a390392d6c admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:11.261245 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:11.394959 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29093ba-79ce-42c4-b477-62a390392d6c admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:11.405184 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1099/2174] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:57:11 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:11.409819 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5d0162-186a-47cf-928c-b49625c92bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:11.411724 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d0162-186a-47cf-928c-b49625c92bc1 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:11.412365 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d0162-186a-47cf-928c-b49625c92bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:11.413059 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d0162-186a-47cf-928c-b49625c92bc1 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:11.414285 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5d0162-186a-47cf-928c-b49625c92bc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:11.417571 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c594e6e5-86ae-489b-a1cc-8b9ea5798a30 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:11.419318 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5d0162-186a-47cf-928c-b49625c92bc1 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:11.419615 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-c594e6e5-86ae-489b-a1cc-8b9ea5798a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:11.485918 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1076/2175] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 14:57:11 2022] POST /identity/v3/users => generated 293 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:57:11.487616 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5d0162-186a-47cf-928c-b49625c92bc1 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:11.534186 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5d0162-186a-47cf-928c-b49625c92bc1 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:11.554460 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd34e19d-2ffc-4c52-87ab-2f438742ed74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:11.555476 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34e19d-2ffc-4c52-87ab-2f438742ed74 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:11.555936 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34e19d-2ffc-4c52-87ab-2f438742ed74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:11.556370 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34e19d-2ffc-4c52-87ab-2f438742ed74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:11.557620 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd34e19d-2ffc-4c52-87ab-2f438742ed74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:11.580104 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd34e19d-2ffc-4c52-87ab-2f438742ed74 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:11.583868 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c594e6e5-86ae-489b-a1cc-8b9ea5798a30 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:11.601079 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1077/2176] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:57:11 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:57:11.605525 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd34e19d-2ffc-4c52-87ab-2f438742ed74 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:11.621221 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd34e19d-2ffc-4c52-87ab-2f438742ed74 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:11.632563 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb511227-80c5-405a-a1f1-42eb6abd1f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:11.633532 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb511227-80c5-405a-a1f1-42eb6abd1f98 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:11.634055 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb511227-80c5-405a-a1f1-42eb6abd1f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:11.634500 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb511227-80c5-405a-a1f1-42eb6abd1f98 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:11.635391 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb511227-80c5-405a-a1f1-42eb6abd1f98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:11.638172 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb511227-80c5-405a-a1f1-42eb6abd1f98 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:11.661049 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1078/2177] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:57:11 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:57:11.664851 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb511227-80c5-405a-a1f1-42eb6abd1f98 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:11.677205 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb511227-80c5-405a-a1f1-42eb6abd1f98 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:11.691478 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230c4d59-02ef-416e-baa9-6e44627eed69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:11.694808 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230c4d59-02ef-416e-baa9-6e44627eed69 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:11.695458 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230c4d59-02ef-416e-baa9-6e44627eed69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:11.696108 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230c4d59-02ef-416e-baa9-6e44627eed69 admin admin] PATH_INFO: `/v3/projects/8a5f3bbf9bda4d93a4d57e5e70c23260/users/cdd3427966304bf481f1b12a2f03ccea/roles/74de6794e3b3422b93d26f993d260c35` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:11.723387 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230c4d59-02ef-416e-baa9-6e44627eed69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a5f3bbf9bda4d93a4d57e5e70c23260, user_id=cdd3427966304bf481f1b12a2f03ccea, role_id=74de6794e3b3422b93d26f993d260c35)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:11.731186 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230c4d59-02ef-416e-baa9-6e44627eed69 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:11.749395 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e663134-d984-4d3e-b2c4-2ce507116639 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df648c909ddb41418128b43f925f5ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:11.751433 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e663134-d984-4d3e-b2c4-2ce507116639 service cinder] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:11.752914 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e663134-d984-4d3e-b2c4-2ce507116639 service cinder] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:11.753766 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e663134-d984-4d3e-b2c4-2ce507116639 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:11.762171 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1079/2178] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 14:57:11 2022] PUT /identity/v3/projects/8a5f3bbf9bda4d93a4d57e5e70c23260/users/cdd3427966304bf481f1b12a2f03ccea/roles/74de6794e3b3422b93d26f993d260c35 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 14:57:11.781502 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f3a4c2-54a1-4c9b-9b1d-3b2b03a4cb17 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:11.781939 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f3a4c2-54a1-4c9b-9b1d-3b2b03a4cb17 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:11.782998 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f3a4c2-54a1-4c9b-9b1d-3b2b03a4cb17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:11.795673 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:11.845683 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-c5f3a4c2-54a1-4c9b-9b1d-3b2b03a4cb17 None None] MFA Rules not processed for user `cdd3427966304bf481f1b12a2f03ccea`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:11.848235 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-c5f3a4c2-54a1-4c9b-9b1d-3b2b03a4cb17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:11.897987 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e663134-d984-4d3e-b2c4-2ce507116639 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:11.899582 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e663134-d984-4d3e-b2c4-2ce507116639 service cinder] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:11.912698 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1100/2179] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:57:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 14:57:12.019529 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1080/2180] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:57:11 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 14:57:12.022815 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e663134-d984-4d3e-b2c4-2ce507116639 service cinder] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:12.037725 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e663134-d984-4d3e-b2c4-2ce507116639 service cinder] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:12.149302 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8378d9a-c467-4211-86db-364ac2610f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:12.149944 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8378d9a-c467-4211-86db-364ac2610f9c admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:12.150225 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8378d9a-c467-4211-86db-364ac2610f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:12.150500 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8378d9a-c467-4211-86db-364ac2610f9c admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:12.151296 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8378d9a-c467-4211-86db-364ac2610f9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:12.153648 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8378d9a-c467-4211-86db-364ac2610f9c admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:12.197457 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1101/2181] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 14:57:12 2022] POST /identity/v3/projects => generated 385 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:57:12.199227 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f3a4c2-54a1-4c9b-9b1d-3b2b03a4cb17 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:12.226571 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f3a4c2-54a1-4c9b-9b1d-3b2b03a4cb17 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:12.335090 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:12.375115 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d67f3c-ef88-4951-9c01-f1d79bc0bfa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:12.376786 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d67f3c-ef88-4951-9c01-f1d79bc0bfa9 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:12.379498 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d67f3c-ef88-4951-9c01-f1d79bc0bfa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:12.379498 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d67f3c-ef88-4951-9c01-f1d79bc0bfa9 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:12.379808 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d67f3c-ef88-4951-9c01-f1d79bc0bfa9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:12.386785 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d67f3c-ef88-4951-9c01-f1d79bc0bfa9 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:12.433457 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1081/2182] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 14:57:12 2022] POST /identity/v3/users => generated 299 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:57:12.437629 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8378d9a-c467-4211-86db-364ac2610f9c admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:12.453677 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8378d9a-c467-4211-86db-364ac2610f9c admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:12.462989 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a028bc77-250c-47c1-afad-43723b5ef5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:12.463781 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a028bc77-250c-47c1-afad-43723b5ef5ce admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:12.464169 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a028bc77-250c-47c1-afad-43723b5ef5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:12.464543 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a028bc77-250c-47c1-afad-43723b5ef5ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:12.466297 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a028bc77-250c-47c1-afad-43723b5ef5ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:12.468278 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a028bc77-250c-47c1-afad-43723b5ef5ce admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:12.497145 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1102/2183] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:57:12 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 14:57:12.502231 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d67f3c-ef88-4951-9c01-f1d79bc0bfa9 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:12.523756 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d67f3c-ef88-4951-9c01-f1d79bc0bfa9 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:12.530040 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f88edd8-902e-4eba-93b6-1f06e6260fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:12.531678 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88edd8-902e-4eba-93b6-1f06e6260fbf admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:12.532156 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88edd8-902e-4eba-93b6-1f06e6260fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:12.532448 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88edd8-902e-4eba-93b6-1f06e6260fbf admin admin] PATH_INFO: `/v3/projects/5d7935a87a574b4e8377f486ddba9f7e/users/0cc4367fb6c344a6b53d3148c18aae7f/roles/019bde1756cb40de8ce06cef6b261f79` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:12.583782 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f88edd8-902e-4eba-93b6-1f06e6260fbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d7935a87a574b4e8377f486ddba9f7e, user_id=0cc4367fb6c344a6b53d3148c18aae7f, role_id=019bde1756cb40de8ce06cef6b261f79)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:12.587733 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f88edd8-902e-4eba-93b6-1f06e6260fbf admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:12.618666 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1082/2184] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 14:57:12 2022] PUT /identity/v3/projects/5d7935a87a574b4e8377f486ddba9f7e/users/0cc4367fb6c344a6b53d3148c18aae7f/roles/019bde1756cb40de8ce06cef6b261f79 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:12.624061 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a028bc77-250c-47c1-afad-43723b5ef5ce admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:12.640376 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a028bc77-250c-47c1-afad-43723b5ef5ce admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:12.776481 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39095e5d-1b3f-46a6-8df3-929f5347e4c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:12.777377 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39095e5d-1b3f-46a6-8df3-929f5347e4c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:12.777770 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39095e5d-1b3f-46a6-8df3-929f5347e4c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:12.778814 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39095e5d-1b3f-46a6-8df3-929f5347e4c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:12.779628 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39095e5d-1b3f-46a6-8df3-929f5347e4c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:12.785828 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39095e5d-1b3f-46a6-8df3-929f5347e4c5 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:12.809529 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1103/2185] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:57:12 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:57:12.815335 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f88edd8-902e-4eba-93b6-1f06e6260fbf admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:12.829201 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f88edd8-902e-4eba-93b6-1f06e6260fbf admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:12.835777 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b146e38b-9ce6-471b-9f53-441a357efc45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:12.836670 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b146e38b-9ce6-471b-9f53-441a357efc45 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:12.836955 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b146e38b-9ce6-471b-9f53-441a357efc45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:12.837277 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b146e38b-9ce6-471b-9f53-441a357efc45 admin admin] PATH_INFO: `/v3/projects/5d7935a87a574b4e8377f486ddba9f7e/users/0cc4367fb6c344a6b53d3148c18aae7f/roles/019bde1756cb40de8ce06cef6b261f79` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:12.842193 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b146e38b-9ce6-471b-9f53-441a357efc45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d7935a87a574b4e8377f486ddba9f7e, user_id=0cc4367fb6c344a6b53d3148c18aae7f, role_id=019bde1756cb40de8ce06cef6b261f79)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:12.845345 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b146e38b-9ce6-471b-9f53-441a357efc45 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:12.871426 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e54651c-92b3-48b1-8230-2ec3aff8b17b None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:12.871811 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e54651c-92b3-48b1-8230-2ec3aff8b17b None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:12.872194 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e54651c-92b3-48b1-8230-2ec3aff8b17b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:12.879770 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1083/2186] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 14:57:12 2022] PUT /identity/v3/projects/5d7935a87a574b4e8377f486ddba9f7e/users/0cc4367fb6c344a6b53d3148c18aae7f/roles/019bde1756cb40de8ce06cef6b261f79 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:12.891136 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924816c3-abef-4965-9d59-af5b7efa5c58 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:12.891439 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924816c3-abef-4965-9d59-af5b7efa5c58 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:12.891691 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924816c3-abef-4965-9d59-af5b7efa5c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:12.941472 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-924816c3-abef-4965-9d59-af5b7efa5c58 None None] MFA Rules not processed for user `0cc4367fb6c344a6b53d3148c18aae7f`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:12.942232 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-3e54651c-92b3-48b1-8230-2ec3aff8b17b None None] MFA Rules not processed for user `cf6e0ff5391247558bfad031e08a1c1a`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:12.943037 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-924816c3-abef-4965-9d59-af5b7efa5c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:12.943525 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-3e54651c-92b3-48b1-8230-2ec3aff8b17b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:12.984799 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:13.067089 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1084/2187] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:57:12 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 14:57:13.080106 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1104/2188] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:57:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:13.083639 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924816c3-abef-4965-9d59-af5b7efa5c58 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:13.084429 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e54651c-92b3-48b1-8230-2ec3aff8b17b None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:13.085541 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-924816c3-abef-4965-9d59-af5b7efa5c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:13.179312 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e54651c-92b3-48b1-8230-2ec3aff8b17b None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:13.183792 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd66179f-f181-46d2-b9d2-25d5755d515a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df648c909ddb41418128b43f925f5ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:13.184523 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd66179f-f181-46d2-b9d2-25d5755d515a service cinder] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:13.184837 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd66179f-f181-46d2-b9d2-25d5755d515a service cinder] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:13.185229 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd66179f-f181-46d2-b9d2-25d5755d515a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:13.191946 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924816c3-abef-4965-9d59-af5b7efa5c58 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:13.202364 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ba9bb6-0258-4f70-b34c-bbd9b0a5323d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:13.203130 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ba9bb6-0258-4f70-b34c-bbd9b0a5323d admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:13.203417 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ba9bb6-0258-4f70-b34c-bbd9b0a5323d admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:13.203698 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ba9bb6-0258-4f70-b34c-bbd9b0a5323d admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:13.204414 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ba9bb6-0258-4f70-b34c-bbd9b0a5323d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:13.206510 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ba9bb6-0258-4f70-b34c-bbd9b0a5323d admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:13.245047 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1085/2189] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 14:57:13 2022] POST /identity/v3/projects => generated 371 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:57:13.249018 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ba9bb6-0258-4f70-b34c-bbd9b0a5323d admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:13.260407 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:13.271073 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd66179f-f181-46d2-b9d2-25d5755d515a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:13.273018 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd66179f-f181-46d2-b9d2-25d5755d515a service cinder] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:13.284384 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1105/2190] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:57:13 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 14:57:13.434633 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ba9bb6-0258-4f70-b34c-bbd9b0a5323d admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:13.442854 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56762c4e-f476-4a77-ba89-98c4810dccf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:13.444101 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56762c4e-f476-4a77-ba89-98c4810dccf9 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:13.444629 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56762c4e-f476-4a77-ba89-98c4810dccf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:13.445145 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56762c4e-f476-4a77-ba89-98c4810dccf9 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:13.446297 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56762c4e-f476-4a77-ba89-98c4810dccf9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:13.448939 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56762c4e-f476-4a77-ba89-98c4810dccf9 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:13.475008 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1086/2191] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 14:57:13 2022] POST /identity/v3/users => generated 292 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:57:13.480331 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd66179f-f181-46d2-b9d2-25d5755d515a service cinder] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:13.498822 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd66179f-f181-46d2-b9d2-25d5755d515a service cinder] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:13.507684 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad64ac-d07b-4275-8057-c19c070370fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:13.509611 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad64ac-d07b-4275-8057-c19c070370fa admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:13.510564 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad64ac-d07b-4275-8057-c19c070370fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:13.511295 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad64ac-d07b-4275-8057-c19c070370fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:13.512442 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ad64ac-d07b-4275-8057-c19c070370fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:13.516002 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ad64ac-d07b-4275-8057-c19c070370fa admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:13.543002 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1106/2192] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:57:13 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 14:57:13.545380 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56762c4e-f476-4a77-ba89-98c4810dccf9 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:13.559474 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56762c4e-f476-4a77-ba89-98c4810dccf9 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:13.566671 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc39551e-3bd0-4d93-a205-4086941003ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:13.567260 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc39551e-3bd0-4d93-a205-4086941003ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:13.567542 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc39551e-3bd0-4d93-a205-4086941003ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:13.567819 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc39551e-3bd0-4d93-a205-4086941003ca admin admin] PATH_INFO: `/v3/projects/c12da6cb46cf455d93bf9ee9e023baa9/users/9a4539c267734afcaf126bb61a501d39/roles/019bde1756cb40de8ce06cef6b261f79` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:13.600507 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc39551e-3bd0-4d93-a205-4086941003ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=c12da6cb46cf455d93bf9ee9e023baa9, user_id=9a4539c267734afcaf126bb61a501d39, role_id=019bde1756cb40de8ce06cef6b261f79)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:13.605632 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc39551e-3bd0-4d93-a205-4086941003ca admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:13.631005 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1087/2193] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 14:57:13 2022] PUT /identity/v3/projects/c12da6cb46cf455d93bf9ee9e023baa9/users/9a4539c267734afcaf126bb61a501d39/roles/019bde1756cb40de8ce06cef6b261f79 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:13.637736 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad64ac-d07b-4275-8057-c19c070370fa admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:13.654392 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad64ac-d07b-4275-8057-c19c070370fa admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:13.771694 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2054b430-1d82-4eda-a358-8e0bb8eefbc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:13.778174 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2054b430-1d82-4eda-a358-8e0bb8eefbc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:13.779214 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2054b430-1d82-4eda-a358-8e0bb8eefbc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:13.779738 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2054b430-1d82-4eda-a358-8e0bb8eefbc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:13.781888 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2054b430-1d82-4eda-a358-8e0bb8eefbc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:13.784049 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2054b430-1d82-4eda-a358-8e0bb8eefbc2 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:13.787819 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:13.801146 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1107/2194] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:57:13 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:57:13.804496 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc39551e-3bd0-4d93-a205-4086941003ca admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:13.816756 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc39551e-3bd0-4d93-a205-4086941003ca admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:13.824157 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec58728-282a-4cd3-999c-7d3d40c8e6dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:13.825040 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec58728-282a-4cd3-999c-7d3d40c8e6dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:13.825380 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec58728-282a-4cd3-999c-7d3d40c8e6dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:13.825718 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec58728-282a-4cd3-999c-7d3d40c8e6dc admin admin] PATH_INFO: `/v3/projects/c12da6cb46cf455d93bf9ee9e023baa9/users/9a4539c267734afcaf126bb61a501d39/roles/019bde1756cb40de8ce06cef6b261f79` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:13.828625 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec58728-282a-4cd3-999c-7d3d40c8e6dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c12da6cb46cf455d93bf9ee9e023baa9, user_id=9a4539c267734afcaf126bb61a501d39, role_id=019bde1756cb40de8ce06cef6b261f79)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:13.832066 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec58728-282a-4cd3-999c-7d3d40c8e6dc admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:13.844388 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1088/2195] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 14:57:13 2022] PUT /identity/v3/projects/c12da6cb46cf455d93bf9ee9e023baa9/users/9a4539c267734afcaf126bb61a501d39/roles/019bde1756cb40de8ce06cef6b261f79 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:15.116229 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2054b430-1d82-4eda-a358-8e0bb8eefbc2 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:15.128803 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec58728-282a-4cd3-999c-7d3d40c8e6dc admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:15.226960 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2054b430-1d82-4eda-a358-8e0bb8eefbc2 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:15.233049 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec58728-282a-4cd3-999c-7d3d40c8e6dc admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:15.240354 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7b741f-1af9-4520-9aca-dba612125936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:15.241276 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7b741f-1af9-4520-9aca-dba612125936 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:15.241855 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7b741f-1af9-4520-9aca-dba612125936 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:15.242206 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7b741f-1af9-4520-9aca-dba612125936 admin admin] PATH_INFO: `/v3/users/9951096677d04427bea331d95f793560` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:15.244011 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7b741f-1af9-4520-9aca-dba612125936 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9951096677d04427bea331d95f793560)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:15.246316 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7b741f-1af9-4520-9aca-dba612125936 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:15.359533 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4e0861-0e8e-4353-95ea-47c46e04461e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df648c909ddb41418128b43f925f5ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:15.361117 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e0861-0e8e-4353-95ea-47c46e04461e service cinder] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:15.361823 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e0861-0e8e-4353-95ea-47c46e04461e service cinder] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:15.363167 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e0861-0e8e-4353-95ea-47c46e04461e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:15.389699 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-dc7b741f-1af9-4520-9aca-dba612125936 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9951096677d04427bea331d95f793560'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:15.403881 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-dc7b741f-1af9-4520-9aca-dba612125936 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9951096677d04427bea331d95f793560'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:15.404502 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-dc7b741f-1af9-4520-9aca-dba612125936 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9951096677d04427bea331d95f793560'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:15.405387 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-dc7b741f-1af9-4520-9aca-dba612125936 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9951096677d04427bea331d95f793560'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:15.408513 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=86,keystone:INSERT=6,keystone:DELETE=8 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:15.421803 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-dc7b741f-1af9-4520-9aca-dba612125936 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9951096677d04427bea331d95f793560'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:15.480066 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1089/2196] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 14:57:15 2022] DELETE /identity/v3/users/9951096677d04427bea331d95f793560 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:15.482473 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb84ccce-3bec-4d80-8bf7-8885bfbc29f3 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:15.482771 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb84ccce-3bec-4d80-8bf7-8885bfbc29f3 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:15.483046 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb84ccce-3bec-4d80-8bf7-8885bfbc29f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:15.489445 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4e0861-0e8e-4353-95ea-47c46e04461e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:15.491668 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4e0861-0e8e-4353-95ea-47c46e04461e service cinder] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:15.507434 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1108/2197] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:57:15 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:57:15.578019 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-bb84ccce-3bec-4d80-8bf7-8885bfbc29f3 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:15.578993 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-bb84ccce-3bec-4d80-8bf7-8885bfbc29f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:15.725035 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1090/2198] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:57:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:15.748317 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4e0861-0e8e-4353-95ea-47c46e04461e service cinder] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:15.750237 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-5e4e0861-0e8e-4353-95ea-47c46e04461e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:15.921599 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4e0861-0e8e-4353-95ea-47c46e04461e service cinder] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:15.977798 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:16.095150 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e954e3e0-59d2-4a80-9368-5dbf31f93b0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:16.097419 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e954e3e0-59d2-4a80-9368-5dbf31f93b0c service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:16.098720 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e954e3e0-59d2-4a80-9368-5dbf31f93b0c service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:16.098720 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e954e3e0-59d2-4a80-9368-5dbf31f93b0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:16.132527 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e954e3e0-59d2-4a80-9368-5dbf31f93b0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:16.135622 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e954e3e0-59d2-4a80-9368-5dbf31f93b0c service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:16.163119 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1109/2199] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:57:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:57:16.734202 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb84ccce-3bec-4d80-8bf7-8885bfbc29f3 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:16.736273 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-bb84ccce-3bec-4d80-8bf7-8885bfbc29f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:16.762416 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e954e3e0-59d2-4a80-9368-5dbf31f93b0c service neutron] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:16.765780 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-e954e3e0-59d2-4a80-9368-5dbf31f93b0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:16.796984 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e954e3e0-59d2-4a80-9368-5dbf31f93b0c service neutron] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:16.809706 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c47e8d-be54-4553-b73b-c7e00c4c647c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:16.810656 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c47e8d-be54-4553-b73b-c7e00c4c647c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:16.811058 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c47e8d-be54-4553-b73b-c7e00c4c647c admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:16.811456 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c47e8d-be54-4553-b73b-c7e00c4c647c admin admin] PATH_INFO: `/v3/projects/1e2e276467974e519657accfcd0cee33` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:16.814887 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c47e8d-be54-4553-b73b-c7e00c4c647c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e2e276467974e519657accfcd0cee33)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:16.819539 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c47e8d-be54-4553-b73b-c7e00c4c647c admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:16.872071 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb84ccce-3bec-4d80-8bf7-8885bfbc29f3 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:16.876469 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7afe09-4309-4e20-a696-5929684eed0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df648c909ddb41418128b43f925f5ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:16.877677 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7afe09-4309-4e20-a696-5929684eed0b service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:16.878128 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7afe09-4309-4e20-a696-5929684eed0b service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:16.878619 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7afe09-4309-4e20-a696-5929684eed0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:16.881260 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-5e7afe09-4309-4e20-a696-5929684eed0b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:16.973823 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-b2c47e8d-be54-4553-b73b-c7e00c4c647c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e2e276467974e519657accfcd0cee33', 'request_id': 'req-b2c47e8d-be54-4553-b73b-c7e00c4c647c'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:17.010230 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7afe09-4309-4e20-a696-5929684eed0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:17.013044 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7afe09-4309-4e20-a696-5929684eed0b service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:17.016192 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-b2c47e8d-be54-4553-b73b-c7e00c4c647c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e2e276467974e519657accfcd0cee33', 'request_id': 'req-b2c47e8d-be54-4553-b73b-c7e00c4c647c'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:17.030734 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1091/2200] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:57:16 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 14:57:17.034169 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-b2c47e8d-be54-4553-b73b-c7e00c4c647c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e2e276467974e519657accfcd0cee33', 'request_id': 'req-b2c47e8d-be54-4553-b73b-c7e00c4c647c'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:17.053502 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-b2c47e8d-be54-4553-b73b-c7e00c4c647c admin admin] The token cache is being invalidate because project 1e2e276467974e519657accfcd0cee33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:57:17.054021 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-b2c47e8d-be54-4553-b73b-c7e00c4c647c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:17.054874 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-b2c47e8d-be54-4553-b73b-c7e00c4c647c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:17.057422 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1110/2201] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 14:57:16 2022] DELETE /identity/v3/projects/1e2e276467974e519657accfcd0cee33 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 14:57:17.063707 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7afe09-4309-4e20-a696-5929684eed0b service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:17.102909 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7afe09-4309-4e20-a696-5929684eed0b service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:17.175376 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:17.280480 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6b3fb0-016e-40bd-8099-7bb0a0bf32be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:17.281185 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b3fb0-016e-40bd-8099-7bb0a0bf32be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:17.281927 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b3fb0-016e-40bd-8099-7bb0a0bf32be admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:17.281927 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b3fb0-016e-40bd-8099-7bb0a0bf32be admin admin] PATH_INFO: `/v3/users/c90b59245fd845f09b552f87bc14f805` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:17.283564 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6b3fb0-016e-40bd-8099-7bb0a0bf32be admin admin] RBAC: Authorizing `identity:delete_user(user_id=c90b59245fd845f09b552f87bc14f805)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:17.285616 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6b3fb0-016e-40bd-8099-7bb0a0bf32be admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:17.390942 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-af6b3fb0-016e-40bd-8099-7bb0a0bf32be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c90b59245fd845f09b552f87bc14f805'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:17.406509 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-af6b3fb0-016e-40bd-8099-7bb0a0bf32be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c90b59245fd845f09b552f87bc14f805'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:17.407305 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-af6b3fb0-016e-40bd-8099-7bb0a0bf32be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c90b59245fd845f09b552f87bc14f805'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:17.407962 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-af6b3fb0-016e-40bd-8099-7bb0a0bf32be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c90b59245fd845f09b552f87bc14f805'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:17.424615 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-af6b3fb0-016e-40bd-8099-7bb0a0bf32be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c90b59245fd845f09b552f87bc14f805'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:17.454246 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1092/2202] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 14:57:17 2022] DELETE /identity/v3/users/c90b59245fd845f09b552f87bc14f805 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 14:57:17.853190 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c47e8d-be54-4553-b73b-c7e00c4c647c admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:17.855769 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-b2c47e8d-be54-4553-b73b-c7e00c4c647c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:17.878472 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c47e8d-be54-4553-b73b-c7e00c4c647c admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:18.034205 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90c9068-c0d1-41d0-91a7-f9cb94ad3c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:18.036346 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c9068-c0d1-41d0-91a7-f9cb94ad3c1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:18.036904 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c9068-c0d1-41d0-91a7-f9cb94ad3c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:18.037665 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c9068-c0d1-41d0-91a7-f9cb94ad3c1f admin admin] PATH_INFO: `/v3/projects/91c50356590a4f27b8a3f6aa6d685ae6` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:18.039672 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90c9068-c0d1-41d0-91a7-f9cb94ad3c1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=91c50356590a4f27b8a3f6aa6d685ae6)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:18.042636 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90c9068-c0d1-41d0-91a7-f9cb94ad3c1f admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:18.185092 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-f90c9068-c0d1-41d0-91a7-f9cb94ad3c1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91c50356590a4f27b8a3f6aa6d685ae6', 'request_id': 'req-f90c9068-c0d1-41d0-91a7-f9cb94ad3c1f'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:18.188279 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:18.195699 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-f90c9068-c0d1-41d0-91a7-f9cb94ad3c1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91c50356590a4f27b8a3f6aa6d685ae6', 'request_id': 'req-f90c9068-c0d1-41d0-91a7-f9cb94ad3c1f'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:18.215958 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-f90c9068-c0d1-41d0-91a7-f9cb94ad3c1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91c50356590a4f27b8a3f6aa6d685ae6', 'request_id': 'req-f90c9068-c0d1-41d0-91a7-f9cb94ad3c1f'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:18.263353 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-f90c9068-c0d1-41d0-91a7-f9cb94ad3c1f admin admin] The token cache is being invalidate because project 91c50356590a4f27b8a3f6aa6d685ae6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:57:18.264256 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-f90c9068-c0d1-41d0-91a7-f9cb94ad3c1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:18.266273 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-f90c9068-c0d1-41d0-91a7-f9cb94ad3c1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:18.268977 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1111/2203] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 14:57:17 2022] DELETE /identity/v3/projects/91c50356590a4f27b8a3f6aa6d685ae6 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:18.276647 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae905fc-c91a-4297-948f-1ce7cd3d05dc None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:18.279658 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae905fc-c91a-4297-948f-1ce7cd3d05dc None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:18.280357 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae905fc-c91a-4297-948f-1ce7cd3d05dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:18.331453 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-2ae905fc-c91a-4297-948f-1ce7cd3d05dc None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:18.340819 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2ae905fc-c91a-4297-948f-1ce7cd3d05dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:18.536723 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a811b-44ab-4606-8f4f-95c3a7d41020 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:18.537192 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a811b-44ab-4606-8f4f-95c3a7d41020 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:18.537544 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1093/2204] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:57:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:18.538149 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a811b-44ab-4606-8f4f-95c3a7d41020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:18.598967 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-9e3a811b-44ab-4606-8f4f-95c3a7d41020 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:18.605679 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-9e3a811b-44ab-4606-8f4f-95c3a7d41020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:18.628709 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1112/2205] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:57:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 14:57:18.636491 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae905fc-c91a-4297-948f-1ce7cd3d05dc None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:18.685233 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae905fc-c91a-4297-948f-1ce7cd3d05dc None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:18.720950 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e539255-39e5-4d34-a8c9-3f5b59df2f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:18.722089 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e539255-39e5-4d34-a8c9-3f5b59df2f2d admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:18.722565 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e539255-39e5-4d34-a8c9-3f5b59df2f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:18.723043 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e539255-39e5-4d34-a8c9-3f5b59df2f2d admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:18.724270 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e539255-39e5-4d34-a8c9-3f5b59df2f2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:57:18.724869 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e539255-39e5-4d34-a8c9-3f5b59df2f2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:18.733073 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e539255-39e5-4d34-a8c9-3f5b59df2f2d admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:18.776166 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1094/2206] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 19 14:57:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:57:18.777461 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3a811b-44ab-4606-8f4f-95c3a7d41020 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:18.823301 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3a811b-44ab-4606-8f4f-95c3a7d41020 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:18.865904 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9056d354-a029-4b01-a95f-7bb4dd21902c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:18.866731 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9056d354-a029-4b01-a95f-7bb4dd21902c admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:18.866846 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9056d354-a029-4b01-a95f-7bb4dd21902c admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:18.867116 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9056d354-a029-4b01-a95f-7bb4dd21902c admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:18.867891 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9056d354-a029-4b01-a95f-7bb4dd21902c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:18.870093 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9056d354-a029-4b01-a95f-7bb4dd21902c admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:18.959881 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1113/2207] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 14:57:18 2022] POST /identity/v3/projects => generated 377 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:57:18.964684 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e539255-39e5-4d34-a8c9-3f5b59df2f2d admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:18.978660 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e539255-39e5-4d34-a8c9-3f5b59df2f2d admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:19.080438 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:19.168359 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe070e03-a343-4996-8d3b-c7b6492bb78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:19.169258 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe070e03-a343-4996-8d3b-c7b6492bb78e admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:19.169736 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe070e03-a343-4996-8d3b-c7b6492bb78e admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:19.170015 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe070e03-a343-4996-8d3b-c7b6492bb78e admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:19.170727 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe070e03-a343-4996-8d3b-c7b6492bb78e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:19.185682 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe070e03-a343-4996-8d3b-c7b6492bb78e admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:19.252441 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1095/2208] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 14:57:18 2022] POST /identity/v3/users => generated 289 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:57:19.256831 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9056d354-a029-4b01-a95f-7bb4dd21902c admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:19.275813 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9056d354-a029-4b01-a95f-7bb4dd21902c admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:19.291486 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761b6e63-d515-41bf-8824-ae107a38ed93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:19.292624 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b6e63-d515-41bf-8824-ae107a38ed93 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:19.293150 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b6e63-d515-41bf-8824-ae107a38ed93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:19.294047 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b6e63-d515-41bf-8824-ae107a38ed93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:19.295022 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761b6e63-d515-41bf-8824-ae107a38ed93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:19.298404 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761b6e63-d515-41bf-8824-ae107a38ed93 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:19.327522 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1114/2209] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:57:19 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:57:19.332164 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe070e03-a343-4996-8d3b-c7b6492bb78e admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:19.355910 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe070e03-a343-4996-8d3b-c7b6492bb78e admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:19.367604 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d8a7ff-3abe-4109-af27-6075a25eb26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:19.369222 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d8a7ff-3abe-4109-af27-6075a25eb26b admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:19.369757 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d8a7ff-3abe-4109-af27-6075a25eb26b admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:19.370472 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d8a7ff-3abe-4109-af27-6075a25eb26b admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:19.371461 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d8a7ff-3abe-4109-af27-6075a25eb26b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:19.373540 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d8a7ff-3abe-4109-af27-6075a25eb26b admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:19.388791 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1096/2210] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:57:19 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 14:57:19.394598 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761b6e63-d515-41bf-8824-ae107a38ed93 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:19.407530 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761b6e63-d515-41bf-8824-ae107a38ed93 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:19.414333 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548a6be6-0cae-4e14-a357-5f0a413f1c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:19.415527 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548a6be6-0cae-4e14-a357-5f0a413f1c08 admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:19.417170 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548a6be6-0cae-4e14-a357-5f0a413f1c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:19.417947 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548a6be6-0cae-4e14-a357-5f0a413f1c08 admin admin] PATH_INFO: `/v3/projects/90f93a5441d04fb1816969481454e5a9/users/9fe13f26843e407692ca53a19e9b8113/roles/74de6794e3b3422b93d26f993d260c35` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:19.445451 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548a6be6-0cae-4e14-a357-5f0a413f1c08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90f93a5441d04fb1816969481454e5a9, user_id=9fe13f26843e407692ca53a19e9b8113, role_id=74de6794e3b3422b93d26f993d260c35)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:19.448919 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548a6be6-0cae-4e14-a357-5f0a413f1c08 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:19.481732 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1115/2211] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 14:57:19 2022] PUT /identity/v3/projects/90f93a5441d04fb1816969481454e5a9/users/9fe13f26843e407692ca53a19e9b8113/roles/74de6794e3b3422b93d26f993d260c35 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:19.495907 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dbb576-5d4e-45a3-a909-3a43e94055a7 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:19.496306 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dbb576-5d4e-45a3-a909-3a43e94055a7 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:19.496691 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dbb576-5d4e-45a3-a909-3a43e94055a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:19.546348 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-12dbb576-5d4e-45a3-a909-3a43e94055a7 None None] MFA Rules not processed for user `9fe13f26843e407692ca53a19e9b8113`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:19.547997 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-12dbb576-5d4e-45a3-a909-3a43e94055a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:19.644177 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1097/2212] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:57:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:19.653115 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548a6be6-0cae-4e14-a357-5f0a413f1c08 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:19.655349 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-548a6be6-0cae-4e14-a357-5f0a413f1c08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:19.757066 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548a6be6-0cae-4e14-a357-5f0a413f1c08 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:19.769864 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f1d15b-b7a8-4d04-b560-a019174b2bf6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df648c909ddb41418128b43f925f5ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:19.770991 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f1d15b-b7a8-4d04-b560-a019174b2bf6 service cinder] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:19.771639 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f1d15b-b7a8-4d04-b560-a019174b2bf6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:19.772119 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f1d15b-b7a8-4d04-b560-a019174b2bf6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:19.792304 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f1d15b-b7a8-4d04-b560-a019174b2bf6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:19.795185 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f1d15b-b7a8-4d04-b560-a019174b2bf6 service cinder] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:19.808409 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1116/2213] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:57:19 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:57:21.049520 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e783d51f-2850-4c5d-81b6-d5b3f2fc4877 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:21.050070 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e783d51f-2850-4c5d-81b6-d5b3f2fc4877 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:21.050070 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e783d51f-2850-4c5d-81b6-d5b3f2fc4877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:21.081882 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-e783d51f-2850-4c5d-81b6-d5b3f2fc4877 None None] MFA Rules not processed for user `9a4539c267734afcaf126bb61a501d39`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:21.083455 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e783d51f-2850-4c5d-81b6-d5b3f2fc4877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:21.160658 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1098/2214] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:57:21 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:21.176216 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f1d15b-b7a8-4d04-b560-a019174b2bf6 service cinder] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:21.177907 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-85f1d15b-b7a8-4d04-b560-a019174b2bf6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:21.266231 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f1d15b-b7a8-4d04-b560-a019174b2bf6 service cinder] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:21.275512 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9833b5bb-3b27-4bb4-8597-981a716d55ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3017e5d92bef4cc2aeae4f28c78ba233', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:21.276147 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9833b5bb-3b27-4bb4-8597-981a716d55ea service nova] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:21.276966 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9833b5bb-3b27-4bb4-8597-981a716d55ea service nova] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:21.276966 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9833b5bb-3b27-4bb4-8597-981a716d55ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:21.278833 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-9833b5bb-3b27-4bb4-8597-981a716d55ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:21.305235 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:21.374317 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9833b5bb-3b27-4bb4-8597-981a716d55ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:21.377120 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9833b5bb-3b27-4bb4-8597-981a716d55ea service nova] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:21.392215 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1117/2215] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:57:21 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:57:21.798979 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e783d51f-2850-4c5d-81b6-d5b3f2fc4877 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:21.806182 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e783d51f-2850-4c5d-81b6-d5b3f2fc4877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:21.841993 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:21.894995 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e783d51f-2850-4c5d-81b6-d5b3f2fc4877 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:21.904398 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b46fa8-3761-4b4d-8011-616c60f35497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:21.905155 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b46fa8-3761-4b4d-8011-616c60f35497 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:21.905487 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b46fa8-3761-4b4d-8011-616c60f35497 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:21.905773 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b46fa8-3761-4b4d-8011-616c60f35497 admin admin] PATH_INFO: `/v3/users/4f478c7228114e31a83c5b42e6ad08a5` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:21.907047 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b46fa8-3761-4b4d-8011-616c60f35497 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f478c7228114e31a83c5b42e6ad08a5)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:21.909458 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b46fa8-3761-4b4d-8011-616c60f35497 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:22.007274 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-77b46fa8-3761-4b4d-8011-616c60f35497 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f478c7228114e31a83c5b42e6ad08a5'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:22.024474 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-77b46fa8-3761-4b4d-8011-616c60f35497 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f478c7228114e31a83c5b42e6ad08a5'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:22.030021 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-77b46fa8-3761-4b4d-8011-616c60f35497 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f478c7228114e31a83c5b42e6ad08a5'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:22.030893 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-77b46fa8-3761-4b4d-8011-616c60f35497 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f478c7228114e31a83c5b42e6ad08a5'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:22.041128 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-77b46fa8-3761-4b4d-8011-616c60f35497 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f478c7228114e31a83c5b42e6ad08a5'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:22.072865 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1099/2216] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 14:57:21 2022] DELETE /identity/v3/users/4f478c7228114e31a83c5b42e6ad08a5 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:22.078383 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65959b7a-9233-4032-8ad8-fcecead3089c None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:22.078868 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65959b7a-9233-4032-8ad8-fcecead3089c None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:22.079329 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65959b7a-9233-4032-8ad8-fcecead3089c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:22.107186 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-65959b7a-9233-4032-8ad8-fcecead3089c None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:22.108854 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-65959b7a-9233-4032-8ad8-fcecead3089c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:22.219628 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1118/2217] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:57:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:22.231176 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b46fa8-3761-4b4d-8011-616c60f35497 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:22.233797 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-77b46fa8-3761-4b4d-8011-616c60f35497 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:22.324657 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b46fa8-3761-4b4d-8011-616c60f35497 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:22.331174 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48a9fbc-913c-4f14-9cb2-cd0feb2203dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:22.331900 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a9fbc-913c-4f14-9cb2-cd0feb2203dd service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:22.332192 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a9fbc-913c-4f14-9cb2-cd0feb2203dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:22.332500 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a9fbc-913c-4f14-9cb2-cd0feb2203dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:22.345458 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48a9fbc-913c-4f14-9cb2-cd0feb2203dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:22.347044 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48a9fbc-913c-4f14-9cb2-cd0feb2203dd service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:22.369833 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1100/2218] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:57:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:57:22.931148 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65959b7a-9233-4032-8ad8-fcecead3089c None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:22.933652 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-65959b7a-9233-4032-8ad8-fcecead3089c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:22.956378 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65959b7a-9233-4032-8ad8-fcecead3089c None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:22.963159 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74ef30c-93f6-4632-8a0b-6365e9fe8753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:22.964164 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ef30c-93f6-4632-8a0b-6365e9fe8753 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:22.964625 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ef30c-93f6-4632-8a0b-6365e9fe8753 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:22.965098 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ef30c-93f6-4632-8a0b-6365e9fe8753 admin admin] PATH_INFO: `/v3/projects/30e01c8bd0ea4503b90b8ff58d1e4e09` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:22.966576 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74ef30c-93f6-4632-8a0b-6365e9fe8753 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30e01c8bd0ea4503b90b8ff58d1e4e09)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:22.968565 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74ef30c-93f6-4632-8a0b-6365e9fe8753 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:23.042459 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-b74ef30c-93f6-4632-8a0b-6365e9fe8753 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30e01c8bd0ea4503b90b8ff58d1e4e09', 'request_id': 'req-b74ef30c-93f6-4632-8a0b-6365e9fe8753'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:23.050525 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-b74ef30c-93f6-4632-8a0b-6365e9fe8753 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30e01c8bd0ea4503b90b8ff58d1e4e09', 'request_id': 'req-b74ef30c-93f6-4632-8a0b-6365e9fe8753'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:23.064833 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-b74ef30c-93f6-4632-8a0b-6365e9fe8753 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30e01c8bd0ea4503b90b8ff58d1e4e09', 'request_id': 'req-b74ef30c-93f6-4632-8a0b-6365e9fe8753'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:23.090152 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-b74ef30c-93f6-4632-8a0b-6365e9fe8753 admin admin] The token cache is being invalidate because project 30e01c8bd0ea4503b90b8ff58d1e4e09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:57:23.090762 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-b74ef30c-93f6-4632-8a0b-6365e9fe8753 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:23.092431 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-b74ef30c-93f6-4632-8a0b-6365e9fe8753 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:23.098922 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1119/2219] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 14:57:22 2022] DELETE /identity/v3/projects/30e01c8bd0ea4503b90b8ff58d1e4e09 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:23.099943 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48a9fbc-913c-4f14-9cb2-cd0feb2203dd service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:23.115480 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48a9fbc-913c-4f14-9cb2-cd0feb2203dd service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:23.197791 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:23.224368 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1534390-6afa-46ed-89a9-d363fe64d6b9 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:23.225166 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1534390-6afa-46ed-89a9-d363fe64d6b9 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:23.225166 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1534390-6afa-46ed-89a9-d363fe64d6b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:23.242329 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f842f7-5e1d-4f46-804a-be518c67aa16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:23.243046 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f842f7-5e1d-4f46-804a-be518c67aa16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:23.243318 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f842f7-5e1d-4f46-804a-be518c67aa16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:23.243969 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f842f7-5e1d-4f46-804a-be518c67aa16 admin admin] PATH_INFO: `/v3/users/cdd3427966304bf481f1b12a2f03ccea` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:23.245564 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f842f7-5e1d-4f46-804a-be518c67aa16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdd3427966304bf481f1b12a2f03ccea)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:23.248057 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f842f7-5e1d-4f46-804a-be518c67aa16 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:23.261049 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-d1534390-6afa-46ed-89a9-d363fe64d6b9 None None] MFA Rules not processed for user `cf6e0ff5391247558bfad031e08a1c1a`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:23.262606 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-d1534390-6afa-46ed-89a9-d363fe64d6b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:23.381825 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:23.384853 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-74f842f7-5e1d-4f46-804a-be518c67aa16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdd3427966304bf481f1b12a2f03ccea'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:23.412809 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-74f842f7-5e1d-4f46-804a-be518c67aa16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdd3427966304bf481f1b12a2f03ccea'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:23.419283 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-74f842f7-5e1d-4f46-804a-be518c67aa16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdd3427966304bf481f1b12a2f03ccea'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:23.423325 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-74f842f7-5e1d-4f46-804a-be518c67aa16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdd3427966304bf481f1b12a2f03ccea'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:23.438857 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-74f842f7-5e1d-4f46-804a-be518c67aa16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdd3427966304bf481f1b12a2f03ccea'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:23.449654 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1120/2220] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:57:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:23.533793 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1101/2221] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 14:57:23 2022] DELETE /identity/v3/users/cdd3427966304bf481f1b12a2f03ccea => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:24.049201 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1534390-6afa-46ed-89a9-d363fe64d6b9 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:24.050836 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-d1534390-6afa-46ed-89a9-d363fe64d6b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:24.094361 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1534390-6afa-46ed-89a9-d363fe64d6b9 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:24.192341 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4f48cf-e651-4d4d-a32b-106ba03865c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:24.193029 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f48cf-e651-4d4d-a32b-106ba03865c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:24.193565 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f48cf-e651-4d4d-a32b-106ba03865c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:24.193676 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f48cf-e651-4d4d-a32b-106ba03865c8 admin admin] PATH_INFO: `/v3/projects/8a5f3bbf9bda4d93a4d57e5e70c23260` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:24.194943 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4f48cf-e651-4d4d-a32b-106ba03865c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a5f3bbf9bda4d93a4d57e5e70c23260)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:24.196890 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4f48cf-e651-4d4d-a32b-106ba03865c8 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:24.274168 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-5d4f48cf-e651-4d4d-a32b-106ba03865c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a5f3bbf9bda4d93a4d57e5e70c23260', 'request_id': 'req-5d4f48cf-e651-4d4d-a32b-106ba03865c8'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:24.283966 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-5d4f48cf-e651-4d4d-a32b-106ba03865c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a5f3bbf9bda4d93a4d57e5e70c23260', 'request_id': 'req-5d4f48cf-e651-4d4d-a32b-106ba03865c8'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:24.294601 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-5d4f48cf-e651-4d4d-a32b-106ba03865c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a5f3bbf9bda4d93a4d57e5e70c23260', 'request_id': 'req-5d4f48cf-e651-4d4d-a32b-106ba03865c8'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:24.310569 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-5d4f48cf-e651-4d4d-a32b-106ba03865c8 admin admin] The token cache is being invalidate because project 8a5f3bbf9bda4d93a4d57e5e70c23260 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:57:24.310873 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-5d4f48cf-e651-4d4d-a32b-106ba03865c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:24.311592 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-5d4f48cf-e651-4d4d-a32b-106ba03865c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:24.317385 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f842f7-5e1d-4f46-804a-be518c67aa16 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:24.317919 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1121/2222] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 14:57:24 2022] DELETE /identity/v3/projects/8a5f3bbf9bda4d93a4d57e5e70c23260 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:24.328505 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f842f7-5e1d-4f46-804a-be518c67aa16 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:24.406623 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62936f4-2c3b-464b-bc08-8e288f9537f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:24.407462 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62936f4-2c3b-464b-bc08-8e288f9537f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:24.407745 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62936f4-2c3b-464b-bc08-8e288f9537f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:24.408086 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62936f4-2c3b-464b-bc08-8e288f9537f6 admin admin] PATH_INFO: `/v3/users/0cc4367fb6c344a6b53d3148c18aae7f` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:24.409288 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62936f4-2c3b-464b-bc08-8e288f9537f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cc4367fb6c344a6b53d3148c18aae7f)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:24.411292 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62936f4-2c3b-464b-bc08-8e288f9537f6 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:24.511177 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f62936f4-2c3b-464b-bc08-8e288f9537f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cc4367fb6c344a6b53d3148c18aae7f'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:24.531469 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f62936f4-2c3b-464b-bc08-8e288f9537f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cc4367fb6c344a6b53d3148c18aae7f'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:24.532457 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f62936f4-2c3b-464b-bc08-8e288f9537f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cc4367fb6c344a6b53d3148c18aae7f'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:24.533131 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f62936f4-2c3b-464b-bc08-8e288f9537f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cc4367fb6c344a6b53d3148c18aae7f'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:24.545386 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f62936f4-2c3b-464b-bc08-8e288f9537f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cc4367fb6c344a6b53d3148c18aae7f'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:24.552396 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:24.574880 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1102/2223] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 14:57:24 2022] DELETE /identity/v3/users/0cc4367fb6c344a6b53d3148c18aae7f => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:25.190563 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4f48cf-e651-4d4d-a32b-106ba03865c8 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:25.192090 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-5d4f48cf-e651-4d4d-a32b-106ba03865c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:25.222483 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4f48cf-e651-4d4d-a32b-106ba03865c8 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:25.306830 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5699902b-6f52-49fd-afa4-35902e2c8283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:25.307518 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5699902b-6f52-49fd-afa4-35902e2c8283 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:25.307763 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5699902b-6f52-49fd-afa4-35902e2c8283 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:25.308041 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5699902b-6f52-49fd-afa4-35902e2c8283 admin admin] PATH_INFO: `/v3/projects/5d7935a87a574b4e8377f486ddba9f7e` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:25.309271 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5699902b-6f52-49fd-afa4-35902e2c8283 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d7935a87a574b4e8377f486ddba9f7e)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:25.311273 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5699902b-6f52-49fd-afa4-35902e2c8283 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:25.341636 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:25.384660 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-5699902b-6f52-49fd-afa4-35902e2c8283 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d7935a87a574b4e8377f486ddba9f7e', 'request_id': 'req-5699902b-6f52-49fd-afa4-35902e2c8283'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:25.394915 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-5699902b-6f52-49fd-afa4-35902e2c8283 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d7935a87a574b4e8377f486ddba9f7e', 'request_id': 'req-5699902b-6f52-49fd-afa4-35902e2c8283'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:25.407922 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-5699902b-6f52-49fd-afa4-35902e2c8283 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d7935a87a574b4e8377f486ddba9f7e', 'request_id': 'req-5699902b-6f52-49fd-afa4-35902e2c8283'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:25.435785 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-5699902b-6f52-49fd-afa4-35902e2c8283 admin admin] The token cache is being invalidate because project 5d7935a87a574b4e8377f486ddba9f7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:57:25.436376 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-5699902b-6f52-49fd-afa4-35902e2c8283 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:25.437236 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-5699902b-6f52-49fd-afa4-35902e2c8283 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:25.439483 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1122/2224] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 14:57:25 2022] DELETE /identity/v3/projects/5d7935a87a574b4e8377f486ddba9f7e => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:29.815401 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62936f4-2c3b-464b-bc08-8e288f9537f6 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:29.817116 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f62936f4-2c3b-464b-bc08-8e288f9537f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:29.833443 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62936f4-2c3b-464b-bc08-8e288f9537f6 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:29.910191 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a87e48-9e6f-4605-8f92-dd1b96580a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:29.911039 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a87e48-9e6f-4605-8f92-dd1b96580a0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:29.911367 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a87e48-9e6f-4605-8f92-dd1b96580a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:29.911652 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a87e48-9e6f-4605-8f92-dd1b96580a0d admin admin] PATH_INFO: `/v3/users/d65b64ac6eaf4ababb473816cd40cf01` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:29.913412 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a87e48-9e6f-4605-8f92-dd1b96580a0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d65b64ac6eaf4ababb473816cd40cf01)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:29.915449 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a87e48-9e6f-4605-8f92-dd1b96580a0d admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:29.995990 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-03a87e48-9e6f-4605-8f92-dd1b96580a0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd65b64ac6eaf4ababb473816cd40cf01'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:30.006638 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-03a87e48-9e6f-4605-8f92-dd1b96580a0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd65b64ac6eaf4ababb473816cd40cf01'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:30.007833 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-03a87e48-9e6f-4605-8f92-dd1b96580a0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd65b64ac6eaf4ababb473816cd40cf01'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:30.008523 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-03a87e48-9e6f-4605-8f92-dd1b96580a0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd65b64ac6eaf4ababb473816cd40cf01'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:30.019894 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-03a87e48-9e6f-4605-8f92-dd1b96580a0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd65b64ac6eaf4ababb473816cd40cf01'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:30.038775 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1103/2225] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 14:57:29 2022] DELETE /identity/v3/users/d65b64ac6eaf4ababb473816cd40cf01 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:30.043677 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955c7e2d-5c42-47e1-becc-ff7d27e6850a None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:30.044144 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955c7e2d-5c42-47e1-becc-ff7d27e6850a None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:30.044273 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955c7e2d-5c42-47e1-becc-ff7d27e6850a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:30.065534 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-955c7e2d-5c42-47e1-becc-ff7d27e6850a None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:30.066906 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-955c7e2d-5c42-47e1-becc-ff7d27e6850a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:30.135415 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1123/2226] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:57:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:30.146056 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a87e48-9e6f-4605-8f92-dd1b96580a0d admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:30.148255 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-03a87e48-9e6f-4605-8f92-dd1b96580a0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:30.234534 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a87e48-9e6f-4605-8f92-dd1b96580a0d admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:30.240888 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2565d6cb-fe16-4ca9-8965-0aaa7bbd6a4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:30.241743 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2565d6cb-fe16-4ca9-8965-0aaa7bbd6a4c service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:30.242037 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2565d6cb-fe16-4ca9-8965-0aaa7bbd6a4c service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:30.242306 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2565d6cb-fe16-4ca9-8965-0aaa7bbd6a4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:30.253784 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2565d6cb-fe16-4ca9-8965-0aaa7bbd6a4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:30.255741 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2565d6cb-fe16-4ca9-8965-0aaa7bbd6a4c service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:30.269038 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1104/2227] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:57:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:57:30.613024 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955c7e2d-5c42-47e1-becc-ff7d27e6850a None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:30.614847 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-955c7e2d-5c42-47e1-becc-ff7d27e6850a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:30.631477 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955c7e2d-5c42-47e1-becc-ff7d27e6850a None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:30.637574 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f0edbe-746b-4a06-8b4f-cc51ce4006f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:30.638247 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f0edbe-746b-4a06-8b4f-cc51ce4006f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:30.638567 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f0edbe-746b-4a06-8b4f-cc51ce4006f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:30.638833 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f0edbe-746b-4a06-8b4f-cc51ce4006f0 admin admin] PATH_INFO: `/v3/projects/2178b1cf56cc476fb97295f4ed9b6f80` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:30.640101 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f0edbe-746b-4a06-8b4f-cc51ce4006f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2178b1cf56cc476fb97295f4ed9b6f80)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:30.642070 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f0edbe-746b-4a06-8b4f-cc51ce4006f0 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:30.696784 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-68f0edbe-746b-4a06-8b4f-cc51ce4006f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2178b1cf56cc476fb97295f4ed9b6f80', 'request_id': 'req-68f0edbe-746b-4a06-8b4f-cc51ce4006f0'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:30.703696 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-68f0edbe-746b-4a06-8b4f-cc51ce4006f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2178b1cf56cc476fb97295f4ed9b6f80', 'request_id': 'req-68f0edbe-746b-4a06-8b4f-cc51ce4006f0'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:30.712853 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-68f0edbe-746b-4a06-8b4f-cc51ce4006f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2178b1cf56cc476fb97295f4ed9b6f80', 'request_id': 'req-68f0edbe-746b-4a06-8b4f-cc51ce4006f0'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:30.727201 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-68f0edbe-746b-4a06-8b4f-cc51ce4006f0 admin admin] The token cache is being invalidate because project 2178b1cf56cc476fb97295f4ed9b6f80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:57:30.727201 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-68f0edbe-746b-4a06-8b4f-cc51ce4006f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:30.727201 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-68f0edbe-746b-4a06-8b4f-cc51ce4006f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:30.727201 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1124/2228] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 14:57:30 2022] DELETE /identity/v3/projects/2178b1cf56cc476fb97295f4ed9b6f80 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:30.731821 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a2fb82-a7d9-4731-84fc-790cc2456103 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:30.732108 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a2fb82-a7d9-4731-84fc-790cc2456103 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:30.732388 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a2fb82-a7d9-4731-84fc-790cc2456103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:30.747840 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:30.755059 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-14a2fb82-a7d9-4731-84fc-790cc2456103 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:30.757597 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-14a2fb82-a7d9-4731-84fc-790cc2456103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:30.831548 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1105/2229] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:57:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:30.841939 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff3850-3e99-4fe0-9248-2dbd95607aaa None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:30.842685 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff3850-3e99-4fe0-9248-2dbd95607aaa None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:30.843110 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff3850-3e99-4fe0-9248-2dbd95607aaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:30.867200 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-96ff3850-3e99-4fe0-9248-2dbd95607aaa None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:30.868293 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-96ff3850-3e99-4fe0-9248-2dbd95607aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:30.878539 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1125/2230] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:57:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:30.882625 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a2fb82-a7d9-4731-84fc-790cc2456103 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:30.893201 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a2fb82-a7d9-4731-84fc-790cc2456103 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:30.902558 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a82ff0-4324-452f-97ab-32c95ca3b81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:30.903616 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a82ff0-4324-452f-97ab-32c95ca3b81b admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:30.903616 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a82ff0-4324-452f-97ab-32c95ca3b81b admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:30.904018 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a82ff0-4324-452f-97ab-32c95ca3b81b admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:30.904386 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a82ff0-4324-452f-97ab-32c95ca3b81b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:57:30.904912 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a82ff0-4324-452f-97ab-32c95ca3b81b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:30.906927 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a82ff0-4324-452f-97ab-32c95ca3b81b admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:30.920100 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1106/2231] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 19 14:57:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:57:30.924375 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ff3850-3e99-4fe0-9248-2dbd95607aaa None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:30.934421 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ff3850-3e99-4fe0-9248-2dbd95607aaa None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:30.941183 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413a6ee3-fe88-4e76-8e12-534fedb7628a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:30.946571 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413a6ee3-fe88-4e76-8e12-534fedb7628a admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:30.946571 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413a6ee3-fe88-4e76-8e12-534fedb7628a admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:30.946571 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413a6ee3-fe88-4e76-8e12-534fedb7628a admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:30.946571 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413a6ee3-fe88-4e76-8e12-534fedb7628a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:30.948297 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413a6ee3-fe88-4e76-8e12-534fedb7628a admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:30.974112 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:30.986927 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a82ff0-4324-452f-97ab-32c95ca3b81b admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:30.987972 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1126/2232] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 14:57:30 2022] POST /identity/v3/projects => generated 375 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 14:57:31.003996 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a82ff0-4324-452f-97ab-32c95ca3b81b admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:31.080493 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13faced5-8c0d-494d-b7a2-1338068b9602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:31.081151 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13faced5-8c0d-494d-b7a2-1338068b9602 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:31.081438 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13faced5-8c0d-494d-b7a2-1338068b9602 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:31.081707 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13faced5-8c0d-494d-b7a2-1338068b9602 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:31.082358 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13faced5-8c0d-494d-b7a2-1338068b9602 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:31.085332 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13faced5-8c0d-494d-b7a2-1338068b9602 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:31.129032 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1107/2233] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 14:57:30 2022] POST /identity/v3/users => generated 288 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:57:31.131084 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413a6ee3-fe88-4e76-8e12-534fedb7628a admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:31.144583 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413a6ee3-fe88-4e76-8e12-534fedb7628a admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:31.151059 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b2184d-ddde-457a-bfef-9ea8f67d3bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:31.151691 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b2184d-ddde-457a-bfef-9ea8f67d3bdf admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:31.151969 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b2184d-ddde-457a-bfef-9ea8f67d3bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:31.152240 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b2184d-ddde-457a-bfef-9ea8f67d3bdf admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:31.153379 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b2184d-ddde-457a-bfef-9ea8f67d3bdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:31.155319 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b2184d-ddde-457a-bfef-9ea8f67d3bdf admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:31.173426 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1127/2234] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:57:31 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:57:31.174907 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13faced5-8c0d-494d-b7a2-1338068b9602 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:31.190411 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13faced5-8c0d-494d-b7a2-1338068b9602 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:31.195715 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cacc3d-2756-4f99-8889-d18ecf7baca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:31.196316 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cacc3d-2756-4f99-8889-d18ecf7baca0 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:31.196592 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cacc3d-2756-4f99-8889-d18ecf7baca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:31.196857 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cacc3d-2756-4f99-8889-d18ecf7baca0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:31.197534 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cacc3d-2756-4f99-8889-d18ecf7baca0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:31.199249 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cacc3d-2756-4f99-8889-d18ecf7baca0 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:31.212380 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1108/2235] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:57:31 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:57:31.216675 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b2184d-ddde-457a-bfef-9ea8f67d3bdf admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:31.228412 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b2184d-ddde-457a-bfef-9ea8f67d3bdf admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:31.233117 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc4002-fc9c-44e3-81e8-b11a2cb29613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:31.233788 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc4002-fc9c-44e3-81e8-b11a2cb29613 admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:31.234179 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc4002-fc9c-44e3-81e8-b11a2cb29613 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:31.234323 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc4002-fc9c-44e3-81e8-b11a2cb29613 admin admin] PATH_INFO: `/v3/projects/15ab60fee2c14ad995b6f409c6c9ee9f/users/ee3041c5f32d47e091e380210be2ae4e/roles/74de6794e3b3422b93d26f993d260c35` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:31.253466 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bc4002-fc9c-44e3-81e8-b11a2cb29613 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15ab60fee2c14ad995b6f409c6c9ee9f, user_id=ee3041c5f32d47e091e380210be2ae4e, role_id=74de6794e3b3422b93d26f993d260c35)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:31.256635 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bc4002-fc9c-44e3-81e8-b11a2cb29613 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:31.271862 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1128/2236] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 14:57:31 2022] PUT /identity/v3/projects/15ab60fee2c14ad995b6f409c6c9ee9f/users/ee3041c5f32d47e091e380210be2ae4e/roles/74de6794e3b3422b93d26f993d260c35 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:31.282871 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80263a02-064e-40d7-b59d-d6d68bee969d None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:31.283161 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80263a02-064e-40d7-b59d-d6d68bee969d None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:31.283431 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80263a02-064e-40d7-b59d-d6d68bee969d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:31.319689 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-80263a02-064e-40d7-b59d-d6d68bee969d None None] MFA Rules not processed for user `ee3041c5f32d47e091e380210be2ae4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:31.320953 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-80263a02-064e-40d7-b59d-d6d68bee969d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:31.407970 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1109/2237] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:57:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:31.415692 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc4002-fc9c-44e3-81e8-b11a2cb29613 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:31.417505 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-06bc4002-fc9c-44e3-81e8-b11a2cb29613 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:31.483547 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc4002-fc9c-44e3-81e8-b11a2cb29613 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:31.488300 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2c1e55-e58c-45ee-bb72-e606f5e5617b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df648c909ddb41418128b43f925f5ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:31.488960 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c1e55-e58c-45ee-bb72-e606f5e5617b service cinder] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:31.489234 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c1e55-e58c-45ee-bb72-e606f5e5617b service cinder] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:31.489533 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c1e55-e58c-45ee-bb72-e606f5e5617b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:31.499051 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2c1e55-e58c-45ee-bb72-e606f5e5617b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:31.500472 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2c1e55-e58c-45ee-bb72-e606f5e5617b service cinder] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:31.510301 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1129/2238] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:57:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:57:32.918117 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923374d5-4c4d-49da-bef7-f1a27fd67489 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:32.918913 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923374d5-4c4d-49da-bef7-f1a27fd67489 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:32.918913 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923374d5-4c4d-49da-bef7-f1a27fd67489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:32.926466 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:32.942663 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-923374d5-4c4d-49da-bef7-f1a27fd67489 None None] MFA Rules not processed for user `ee3041c5f32d47e091e380210be2ae4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:32.944857 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-923374d5-4c4d-49da-bef7-f1a27fd67489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:32.954351 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1110/2239] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:57:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:33.781588 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e385072-0084-45f1-a66b-24c3b16cef86 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:33.782135 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e385072-0084-45f1-a66b-24c3b16cef86 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:33.782365 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e385072-0084-45f1-a66b-24c3b16cef86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:33.807428 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-5e385072-0084-45f1-a66b-24c3b16cef86 None None] MFA Rules not processed for user `f063128266bb4a34bb0f0639dfa63334`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:33.809258 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-5e385072-0084-45f1-a66b-24c3b16cef86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:33.882887 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1130/2240] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:57:33 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 14:57:35.277029 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923374d5-4c4d-49da-bef7-f1a27fd67489 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:35.282734 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-923374d5-4c4d-49da-bef7-f1a27fd67489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:35.377848 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923374d5-4c4d-49da-bef7-f1a27fd67489 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:35.384104 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609ea658-037a-49dc-ac39-2f18f714cfc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:35.384952 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ea658-037a-49dc-ac39-2f18f714cfc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:35.385083 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ea658-037a-49dc-ac39-2f18f714cfc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:35.385437 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ea658-037a-49dc-ac39-2f18f714cfc1 admin admin] PATH_INFO: `/v3/users/9fe13f26843e407692ca53a19e9b8113` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:35.387252 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609ea658-037a-49dc-ac39-2f18f714cfc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fe13f26843e407692ca53a19e9b8113)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:35.392075 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609ea658-037a-49dc-ac39-2f18f714cfc1 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:35.470455 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-609ea658-037a-49dc-ac39-2f18f714cfc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fe13f26843e407692ca53a19e9b8113'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:35.480782 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-609ea658-037a-49dc-ac39-2f18f714cfc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fe13f26843e407692ca53a19e9b8113'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:35.481525 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-609ea658-037a-49dc-ac39-2f18f714cfc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fe13f26843e407692ca53a19e9b8113'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:35.482153 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-609ea658-037a-49dc-ac39-2f18f714cfc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fe13f26843e407692ca53a19e9b8113'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:35.491240 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-609ea658-037a-49dc-ac39-2f18f714cfc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fe13f26843e407692ca53a19e9b8113'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:35.527209 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1111/2241] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 14:57:35 2022] DELETE /identity/v3/users/9fe13f26843e407692ca53a19e9b8113 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:35.534184 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e202294-587c-4738-aa77-332f25d9e5e9 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:35.536514 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e202294-587c-4738-aa77-332f25d9e5e9 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:35.537571 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e202294-587c-4738-aa77-332f25d9e5e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:35.569078 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-9e202294-587c-4738-aa77-332f25d9e5e9 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:35.570532 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-9e202294-587c-4738-aa77-332f25d9e5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:35.649473 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1131/2242] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:57:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:35.665192 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609ea658-037a-49dc-ac39-2f18f714cfc1 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:35.666672 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-609ea658-037a-49dc-ac39-2f18f714cfc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:35.781373 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609ea658-037a-49dc-ac39-2f18f714cfc1 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:35.785819 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee963452-63a3-4aaa-83fa-8f0d329e286a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:35.786780 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee963452-63a3-4aaa-83fa-8f0d329e286a service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:35.787187 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee963452-63a3-4aaa-83fa-8f0d329e286a service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:35.787532 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee963452-63a3-4aaa-83fa-8f0d329e286a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:35.798863 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee963452-63a3-4aaa-83fa-8f0d329e286a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:35.800494 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee963452-63a3-4aaa-83fa-8f0d329e286a service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:35.818254 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1112/2243] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:57:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 14:57:36.240957 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e202294-587c-4738-aa77-332f25d9e5e9 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:36.243534 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-9e202294-587c-4738-aa77-332f25d9e5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:36.259516 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e202294-587c-4738-aa77-332f25d9e5e9 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:36.270274 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1d739e-75c1-412b-a1a6-0fce8c5a37b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:36.271297 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1d739e-75c1-412b-a1a6-0fce8c5a37b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:36.271777 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1d739e-75c1-412b-a1a6-0fce8c5a37b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:36.272031 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1d739e-75c1-412b-a1a6-0fce8c5a37b2 admin admin] PATH_INFO: `/v3/projects/90f93a5441d04fb1816969481454e5a9` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:36.281985 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1d739e-75c1-412b-a1a6-0fce8c5a37b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90f93a5441d04fb1816969481454e5a9)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:36.283975 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1d739e-75c1-412b-a1a6-0fce8c5a37b2 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:36.313265 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:36.396149 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-0b1d739e-75c1-412b-a1a6-0fce8c5a37b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90f93a5441d04fb1816969481454e5a9', 'request_id': 'req-0b1d739e-75c1-412b-a1a6-0fce8c5a37b2'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:36.403902 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-0b1d739e-75c1-412b-a1a6-0fce8c5a37b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90f93a5441d04fb1816969481454e5a9', 'request_id': 'req-0b1d739e-75c1-412b-a1a6-0fce8c5a37b2'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:36.416859 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-0b1d739e-75c1-412b-a1a6-0fce8c5a37b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90f93a5441d04fb1816969481454e5a9', 'request_id': 'req-0b1d739e-75c1-412b-a1a6-0fce8c5a37b2'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:36.436919 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-0b1d739e-75c1-412b-a1a6-0fce8c5a37b2 admin admin] The token cache is being invalidate because project 90f93a5441d04fb1816969481454e5a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:57:36.437409 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-0b1d739e-75c1-412b-a1a6-0fce8c5a37b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:36.438249 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-0b1d739e-75c1-412b-a1a6-0fce8c5a37b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:57:36.440305 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1132/2244] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 14:57:36 2022] DELETE /identity/v3/projects/90f93a5441d04fb1816969481454e5a9 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:36.447386 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bae038-832c-41c7-ab8d-1f9864f25487 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:36.447899 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bae038-832c-41c7-ab8d-1f9864f25487 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:36.448398 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bae038-832c-41c7-ab8d-1f9864f25487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:36.472363 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-c3bae038-832c-41c7-ab8d-1f9864f25487 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:36.473771 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-c3bae038-832c-41c7-ab8d-1f9864f25487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:36.486579 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:36.547013 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1113/2245] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:57:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:36.555278 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cf00d8-3c29-4f3e-8af2-b81ffe77397a None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:36.555864 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cf00d8-3c29-4f3e-8af2-b81ffe77397a None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:36.555864 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cf00d8-3c29-4f3e-8af2-b81ffe77397a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:36.579614 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-26cf00d8-3c29-4f3e-8af2-b81ffe77397a None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:36.580937 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-26cf00d8-3c29-4f3e-8af2-b81ffe77397a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:36.590892 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1133/2246] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:57:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:36.595489 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bae038-832c-41c7-ab8d-1f9864f25487 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:36.605681 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bae038-832c-41c7-ab8d-1f9864f25487 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:36.611035 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697909ad-a107-487c-8445-e135e26b0e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:36.611667 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697909ad-a107-487c-8445-e135e26b0e7f admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:36.611950 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697909ad-a107-487c-8445-e135e26b0e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:36.612552 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697909ad-a107-487c-8445-e135e26b0e7f admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:36.613047 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697909ad-a107-487c-8445-e135e26b0e7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:57:36.613403 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697909ad-a107-487c-8445-e135e26b0e7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:36.615226 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697909ad-a107-487c-8445-e135e26b0e7f admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:36.633077 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1114/2247] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 19 14:57:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:57:36.635194 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cf00d8-3c29-4f3e-8af2-b81ffe77397a None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:36.647241 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cf00d8-3c29-4f3e-8af2-b81ffe77397a None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:36.652568 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f83ba40-4db2-4cfe-8c00-a04f0a4571c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:36.653223 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f83ba40-4db2-4cfe-8c00-a04f0a4571c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:36.653505 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f83ba40-4db2-4cfe-8c00-a04f0a4571c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:36.653777 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f83ba40-4db2-4cfe-8c00-a04f0a4571c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:36.654414 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f83ba40-4db2-4cfe-8c00-a04f0a4571c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:36.656345 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f83ba40-4db2-4cfe-8c00-a04f0a4571c5 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:36.688392 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1134/2248] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 14:57:36 2022] POST /identity/v3/projects => generated 371 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:57:36.693360 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697909ad-a107-487c-8445-e135e26b0e7f admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:36.706570 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697909ad-a107-487c-8445-e135e26b0e7f admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:36.789558 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91763f4f-91a8-4d80-b1e2-0cec9fb253bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:36.790262 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91763f4f-91a8-4d80-b1e2-0cec9fb253bc admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:36.790636 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91763f4f-91a8-4d80-b1e2-0cec9fb253bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:36.790980 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91763f4f-91a8-4d80-b1e2-0cec9fb253bc admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:36.791683 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91763f4f-91a8-4d80-b1e2-0cec9fb253bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:36.793788 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91763f4f-91a8-4d80-b1e2-0cec9fb253bc admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:36.825081 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1115/2249] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 14:57:36 2022] POST /identity/v3/users => generated 286 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:57:36.829641 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f83ba40-4db2-4cfe-8c00-a04f0a4571c5 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:36.842913 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f83ba40-4db2-4cfe-8c00-a04f0a4571c5 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:36.847898 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46567f04-2d1a-4810-87fe-cea2e9ce0373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:36.848513 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46567f04-2d1a-4810-87fe-cea2e9ce0373 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:36.848887 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46567f04-2d1a-4810-87fe-cea2e9ce0373 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:36.849502 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46567f04-2d1a-4810-87fe-cea2e9ce0373 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:36.850261 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46567f04-2d1a-4810-87fe-cea2e9ce0373 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:36.851919 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46567f04-2d1a-4810-87fe-cea2e9ce0373 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:36.863223 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1135/2250] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:57:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 14:57:36.867790 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91763f4f-91a8-4d80-b1e2-0cec9fb253bc admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:36.881409 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91763f4f-91a8-4d80-b1e2-0cec9fb253bc admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:36.887488 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb15a0ae-3b7d-450e-9711-42287f5a6547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:36.888202 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb15a0ae-3b7d-450e-9711-42287f5a6547 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:36.888518 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb15a0ae-3b7d-450e-9711-42287f5a6547 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:36.888860 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb15a0ae-3b7d-450e-9711-42287f5a6547 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:36.889606 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb15a0ae-3b7d-450e-9711-42287f5a6547 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:36.891324 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb15a0ae-3b7d-450e-9711-42287f5a6547 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:36.905810 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1116/2251] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:57:36 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:57:36.911961 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46567f04-2d1a-4810-87fe-cea2e9ce0373 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:36.939670 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46567f04-2d1a-4810-87fe-cea2e9ce0373 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:36.947278 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb2f05f-2887-45ac-8b18-8fccfb44f08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:36.948810 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb2f05f-2887-45ac-8b18-8fccfb44f08e admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:36.949252 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb2f05f-2887-45ac-8b18-8fccfb44f08e admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:36.949882 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb2f05f-2887-45ac-8b18-8fccfb44f08e admin admin] PATH_INFO: `/v3/projects/831597dbd7f4411d8bc2084dd5e65530/users/d41b4cfa07944135aee7d11807fc4f93/roles/74de6794e3b3422b93d26f993d260c35` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:36.975369 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb2f05f-2887-45ac-8b18-8fccfb44f08e admin admin] RBAC: Authorizing `identity:create_grant(project_id=831597dbd7f4411d8bc2084dd5e65530, user_id=d41b4cfa07944135aee7d11807fc4f93, role_id=74de6794e3b3422b93d26f993d260c35)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:36.978437 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb2f05f-2887-45ac-8b18-8fccfb44f08e admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:37.003212 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1136/2252] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 14:57:36 2022] PUT /identity/v3/projects/831597dbd7f4411d8bc2084dd5e65530/users/d41b4cfa07944135aee7d11807fc4f93/roles/74de6794e3b3422b93d26f993d260c35 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:57:37.009047 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a48a9-2372-4760-85c8-752bb6522df0 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:37.009417 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a48a9-2372-4760-85c8-752bb6522df0 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:37.009754 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a48a9-2372-4760-85c8-752bb6522df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:37.034485 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-c39a48a9-2372-4760-85c8-752bb6522df0 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:37.035813 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-c39a48a9-2372-4760-85c8-752bb6522df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:37.117356 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1117/2253] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:57:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:37.131131 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb2f05f-2887-45ac-8b18-8fccfb44f08e admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:37.133076 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-5bb2f05f-2887-45ac-8b18-8fccfb44f08e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:37.197212 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb2f05f-2887-45ac-8b18-8fccfb44f08e admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:37.201569 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c065de-6521-452b-9404-c125302ea170 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:37.202257 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c065de-6521-452b-9404-c125302ea170 service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:37.202550 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c065de-6521-452b-9404-c125302ea170 service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:37.202964 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c065de-6521-452b-9404-c125302ea170 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:37.214710 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c065de-6521-452b-9404-c125302ea170 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:37.216170 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c065de-6521-452b-9404-c125302ea170 service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:37.227817 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1137/2254] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:57:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:57:38.099110 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5525fc-d6d7-45f1-b3c9-b221d90040e9 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:38.099757 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5525fc-d6d7-45f1-b3c9-b221d90040e9 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:38.099957 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5525fc-d6d7-45f1-b3c9-b221d90040e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:38.134205 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-fa5525fc-d6d7-45f1-b3c9-b221d90040e9 None None] MFA Rules not processed for user `d41b4cfa07944135aee7d11807fc4f93`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:38.135585 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-fa5525fc-d6d7-45f1-b3c9-b221d90040e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:38.149154 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:38.224024 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1118/2255] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:57:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 14:57:38.232527 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c065de-6521-452b-9404-c125302ea170 service neutron] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:57:38.234991 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-f5c065de-6521-452b-9404-c125302ea170 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:38.296096 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:38.328650 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c065de-6521-452b-9404-c125302ea170 service neutron] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:57:38.333233 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190a6e20-86cf-490a-a392-879a86f8789f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df648c909ddb41418128b43f925f5ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:57:38.333946 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a6e20-86cf-490a-a392-879a86f8789f service cinder] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:38.334220 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a6e20-86cf-490a-a392-879a86f8789f service cinder] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:38.334484 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a6e20-86cf-490a-a392-879a86f8789f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:38.344163 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190a6e20-86cf-490a-a392-879a86f8789f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:57:38.345904 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190a6e20-86cf-490a-a392-879a86f8789f service cinder] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:57:38.357313 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1138/2256] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:57:38 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:57:39.821781 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b671e4-4db0-426b-8eb6-560ec507db68 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:57:39.822315 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b671e4-4db0-426b-8eb6-560ec507db68 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:57:39.822315 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b671e4-4db0-426b-8eb6-560ec507db68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:57:39.845769 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-28b671e4-4db0-426b-8eb6-560ec507db68 None None] MFA Rules not processed for user `d41b4cfa07944135aee7d11807fc4f93`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:57:39.847088 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-28b671e4-4db0-426b-8eb6-560ec507db68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:57:39.856248 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1119/2257] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:57:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:57:48.352815 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=10 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:49.839564 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=24 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:02.594031 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d30da21-7726-40cf-800e-f5c72d7ad993 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:02.594569 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d30da21-7726-40cf-800e-f5c72d7ad993 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:02.594569 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d30da21-7726-40cf-800e-f5c72d7ad993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:02.618709 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-3d30da21-7726-40cf-800e-f5c72d7ad993 None None] MFA Rules not processed for user `2c2b1ac1a17c43d28da8f7e9a199dea4`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:58:02.619938 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-3d30da21-7726-40cf-800e-f5c72d7ad993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:02.680368 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1139/2258] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Sep 19 14:58:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:58:02.732221 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b671e4-4db0-426b-8eb6-560ec507db68 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:02.733778 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-28b671e4-4db0-426b-8eb6-560ec507db68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:02.808529 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b671e4-4db0-426b-8eb6-560ec507db68 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:02.813836 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723714be-54ae-4499-b0b7-1ba1915bf481 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cb60a5e90343e69a38db4356cb3a90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:02.814483 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723714be-54ae-4499-b0b7-1ba1915bf481 service swift] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:02.814752 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723714be-54ae-4499-b0b7-1ba1915bf481 service swift] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:02.815035 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723714be-54ae-4499-b0b7-1ba1915bf481 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:02.824460 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723714be-54ae-4499-b0b7-1ba1915bf481 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:02.826119 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723714be-54ae-4499-b0b7-1ba1915bf481 service swift] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:02.835349 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1120/2259] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Sep 19 14:58:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 14:58:03.580683 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76589c68-9aa5-4733-8286-2575863f8931 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:03.581030 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76589c68-9aa5-4733-8286-2575863f8931 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:03.581265 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76589c68-9aa5-4733-8286-2575863f8931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:03.613253 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-76589c68-9aa5-4733-8286-2575863f8931 None None] MFA Rules not processed for user `2c2b1ac1a17c43d28da8f7e9a199dea4`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:58:03.616733 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-76589c68-9aa5-4733-8286-2575863f8931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:03.625881 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1140/2260] 10.222.0.26 () {58 vars in 967 bytes} [Mon Sep 19 14:58:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:58:03.643924 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723714be-54ae-4499-b0b7-1ba1915bf481 service swift] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:03.658387 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723714be-54ae-4499-b0b7-1ba1915bf481 service swift] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:03.668332 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d03a125-0e2b-40db-aa84-067bd6b10c72 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cb60a5e90343e69a38db4356cb3a90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:03.668961 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d03a125-0e2b-40db-aa84-067bd6b10c72 service swift] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:03.669973 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d03a125-0e2b-40db-aa84-067bd6b10c72 service swift] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:03.669973 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d03a125-0e2b-40db-aa84-067bd6b10c72 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:03.680899 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d03a125-0e2b-40db-aa84-067bd6b10c72 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:03.682621 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d03a125-0e2b-40db-aa84-067bd6b10c72 service swift] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:03.700486 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1121/2261] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Sep 19 14:58:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 14:58:03.984481 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547db93-1731-4080-89dc-70a1b59b73d7 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:03.990429 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547db93-1731-4080-89dc-70a1b59b73d7 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:03.990429 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547db93-1731-4080-89dc-70a1b59b73d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:04.007762 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-0547db93-1731-4080-89dc-70a1b59b73d7 None None] MFA Rules not processed for user `2c2b1ac1a17c43d28da8f7e9a199dea4`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:58:04.008978 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-0547db93-1731-4080-89dc-70a1b59b73d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:04.017237 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1141/2262] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Sep 19 14:58:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:58:04.029926 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d03a125-0e2b-40db-aa84-067bd6b10c72 service swift] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:04.041650 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d03a125-0e2b-40db-aa84-067bd6b10c72 service swift] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:04.049112 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb79d45-4826-4ebc-bab4-e0d5bb275074 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cb60a5e90343e69a38db4356cb3a90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:04.049775 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb79d45-4826-4ebc-bab4-e0d5bb275074 service swift] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:04.050034 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb79d45-4826-4ebc-bab4-e0d5bb275074 service swift] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:04.050291 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb79d45-4826-4ebc-bab4-e0d5bb275074 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:04.059587 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb79d45-4826-4ebc-bab4-e0d5bb275074 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:04.061878 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb79d45-4826-4ebc-bab4-e0d5bb275074 service swift] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:04.071437 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1122/2263] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Sep 19 14:58:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 14:58:04.446421 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03627ee-9a72-43e6-b8f7-af578af6ef38 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:04.446699 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03627ee-9a72-43e6-b8f7-af578af6ef38 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:04.446969 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03627ee-9a72-43e6-b8f7-af578af6ef38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:04.470063 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-b03627ee-9a72-43e6-b8f7-af578af6ef38 None None] MFA Rules not processed for user `2c2b1ac1a17c43d28da8f7e9a199dea4`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:58:04.471288 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-b03627ee-9a72-43e6-b8f7-af578af6ef38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:04.481008 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1142/2264] 10.222.0.26 () {58 vars in 967 bytes} [Mon Sep 19 14:58:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:58:04.493896 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb79d45-4826-4ebc-bab4-e0d5bb275074 service swift] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:04.505859 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb79d45-4826-4ebc-bab4-e0d5bb275074 service swift] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:04.512740 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afef945-9cb8-42d9-b1d1-fb86d1b9dcf7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cb60a5e90343e69a38db4356cb3a90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:04.513491 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afef945-9cb8-42d9-b1d1-fb86d1b9dcf7 service swift] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:04.513757 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afef945-9cb8-42d9-b1d1-fb86d1b9dcf7 service swift] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:04.514238 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afef945-9cb8-42d9-b1d1-fb86d1b9dcf7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:04.524773 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afef945-9cb8-42d9-b1d1-fb86d1b9dcf7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:04.526081 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afef945-9cb8-42d9-b1d1-fb86d1b9dcf7 service swift] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:04.537140 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1123/2265] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Sep 19 14:58:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 14:58:06.839437 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03627ee-9a72-43e6-b8f7-af578af6ef38 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:06.845161 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-b03627ee-9a72-43e6-b8f7-af578af6ef38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:06.874729 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03627ee-9a72-43e6-b8f7-af578af6ef38 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:06.880842 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e23c692-c3ac-4a32-a286-bf5ad0a4794e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:06.881961 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e23c692-c3ac-4a32-a286-bf5ad0a4794e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:06.882469 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e23c692-c3ac-4a32-a286-bf5ad0a4794e admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:06.882934 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e23c692-c3ac-4a32-a286-bf5ad0a4794e admin admin] PATH_INFO: `/v3/users/ee3041c5f32d47e091e380210be2ae4e` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:06.885163 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e23c692-c3ac-4a32-a286-bf5ad0a4794e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee3041c5f32d47e091e380210be2ae4e)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:06.888400 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e23c692-c3ac-4a32-a286-bf5ad0a4794e admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:06.960693 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-4e23c692-c3ac-4a32-a286-bf5ad0a4794e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee3041c5f32d47e091e380210be2ae4e'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:06.973086 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-4e23c692-c3ac-4a32-a286-bf5ad0a4794e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee3041c5f32d47e091e380210be2ae4e'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:06.975161 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-4e23c692-c3ac-4a32-a286-bf5ad0a4794e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee3041c5f32d47e091e380210be2ae4e'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:06.976961 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-4e23c692-c3ac-4a32-a286-bf5ad0a4794e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee3041c5f32d47e091e380210be2ae4e'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:06.996277 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-4e23c692-c3ac-4a32-a286-bf5ad0a4794e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee3041c5f32d47e091e380210be2ae4e'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:07.016459 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1143/2266] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 14:58:06 2022] DELETE /identity/v3/users/ee3041c5f32d47e091e380210be2ae4e => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:58:07.021787 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824657c3-ee4c-4dde-acd5-0f1c75eed7ff None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:07.023792 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824657c3-ee4c-4dde-acd5-0f1c75eed7ff None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:07.023792 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824657c3-ee4c-4dde-acd5-0f1c75eed7ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:07.048918 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-824657c3-ee4c-4dde-acd5-0f1c75eed7ff None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:58:07.050309 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-824657c3-ee4c-4dde-acd5-0f1c75eed7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:07.148924 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1124/2267] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:58:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 14:58:07.162289 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e23c692-c3ac-4a32-a286-bf5ad0a4794e admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:07.164817 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-4e23c692-c3ac-4a32-a286-bf5ad0a4794e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:07.252914 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e23c692-c3ac-4a32-a286-bf5ad0a4794e admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:07.257633 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e12737d-1f94-4897-b66d-4221f12b9b31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:07.258276 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12737d-1f94-4897-b66d-4221f12b9b31 service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:07.258560 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12737d-1f94-4897-b66d-4221f12b9b31 service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:07.258827 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12737d-1f94-4897-b66d-4221f12b9b31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:07.270198 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e12737d-1f94-4897-b66d-4221f12b9b31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:07.271907 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e12737d-1f94-4897-b66d-4221f12b9b31 service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:07.278716 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:07.285684 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1144/2268] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:58:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:58:07.549752 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824657c3-ee4c-4dde-acd5-0f1c75eed7ff None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:07.552035 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-824657c3-ee4c-4dde-acd5-0f1c75eed7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:07.569087 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824657c3-ee4c-4dde-acd5-0f1c75eed7ff None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:07.576810 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6c5ee6-930c-41ca-ba9e-913a8310535a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:07.577507 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c5ee6-930c-41ca-ba9e-913a8310535a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:07.577770 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c5ee6-930c-41ca-ba9e-913a8310535a admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:07.578035 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c5ee6-930c-41ca-ba9e-913a8310535a admin admin] PATH_INFO: `/v3/projects/15ab60fee2c14ad995b6f409c6c9ee9f` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:07.579692 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6c5ee6-930c-41ca-ba9e-913a8310535a admin admin] RBAC: Authorizing `identity:delete_project(project_id=15ab60fee2c14ad995b6f409c6c9ee9f)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:07.581163 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6c5ee6-930c-41ca-ba9e-913a8310535a admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:07.650939 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:07.662995 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2f6c5ee6-930c-41ca-ba9e-913a8310535a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15ab60fee2c14ad995b6f409c6c9ee9f', 'request_id': 'req-2f6c5ee6-930c-41ca-ba9e-913a8310535a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:07.673869 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2f6c5ee6-930c-41ca-ba9e-913a8310535a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15ab60fee2c14ad995b6f409c6c9ee9f', 'request_id': 'req-2f6c5ee6-930c-41ca-ba9e-913a8310535a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:07.689554 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2f6c5ee6-930c-41ca-ba9e-913a8310535a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15ab60fee2c14ad995b6f409c6c9ee9f', 'request_id': 'req-2f6c5ee6-930c-41ca-ba9e-913a8310535a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:07.705799 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2f6c5ee6-930c-41ca-ba9e-913a8310535a admin admin] The token cache is being invalidate because project 15ab60fee2c14ad995b6f409c6c9ee9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:58:07.706073 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2f6c5ee6-930c-41ca-ba9e-913a8310535a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:07.706949 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2f6c5ee6-930c-41ca-ba9e-913a8310535a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:07.709229 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1125/2269] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 14:58:07 2022] DELETE /identity/v3/projects/15ab60fee2c14ad995b6f409c6c9ee9f => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:58:07.714563 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a13da55-de45-4138-86ec-0bea23fccafe None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:07.714876 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a13da55-de45-4138-86ec-0bea23fccafe None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:07.715214 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a13da55-de45-4138-86ec-0bea23fccafe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:07.736983 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-1a13da55-de45-4138-86ec-0bea23fccafe None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:58:07.738328 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-1a13da55-de45-4138-86ec-0bea23fccafe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:07.804437 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1145/2270] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:58:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:58:07.812806 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d8a3fd-7ce5-4ad9-b543-7b7a7c406be5 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:07.813129 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d8a3fd-7ce5-4ad9-b543-7b7a7c406be5 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:07.813466 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d8a3fd-7ce5-4ad9-b543-7b7a7c406be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:07.848482 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-f0d8a3fd-7ce5-4ad9-b543-7b7a7c406be5 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:58:07.850357 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f0d8a3fd-7ce5-4ad9-b543-7b7a7c406be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:07.858811 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1126/2271] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:58:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:58:07.863452 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a13da55-de45-4138-86ec-0bea23fccafe None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:07.874494 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a13da55-de45-4138-86ec-0bea23fccafe None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:07.880151 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac224277-705d-4d87-998e-3b69b72e505d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:07.881186 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac224277-705d-4d87-998e-3b69b72e505d admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:07.881693 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac224277-705d-4d87-998e-3b69b72e505d admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:07.882134 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac224277-705d-4d87-998e-3b69b72e505d admin admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:07.882925 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac224277-705d-4d87-998e-3b69b72e505d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:58:07.883330 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac224277-705d-4d87-998e-3b69b72e505d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:07.885390 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac224277-705d-4d87-998e-3b69b72e505d admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:07.901415 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1146/2272] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 19 14:58:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:58:07.906102 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d8a3fd-7ce5-4ad9-b543-7b7a7c406be5 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:07.917317 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d8a3fd-7ce5-4ad9-b543-7b7a7c406be5 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:07.922940 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b39d8b8-445c-4d33-ac00-372c24c844f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:07.923605 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b39d8b8-445c-4d33-ac00-372c24c844f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:07.923877 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b39d8b8-445c-4d33-ac00-372c24c844f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:07.924145 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b39d8b8-445c-4d33-ac00-372c24c844f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:07.924776 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b39d8b8-445c-4d33-ac00-372c24c844f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:07.926878 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b39d8b8-445c-4d33-ac00-372c24c844f0 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:07.962298 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1127/2273] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 14:58:07 2022] POST /identity/v3/projects => generated 399 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 14:58:07.966809 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac224277-705d-4d87-998e-3b69b72e505d admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:07.979702 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac224277-705d-4d87-998e-3b69b72e505d admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:08.105027 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bedaafd-55b2-4db8-856c-be5856dd9568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:08.106106 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bedaafd-55b2-4db8-856c-be5856dd9568 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:08.106553 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bedaafd-55b2-4db8-856c-be5856dd9568 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:08.107202 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bedaafd-55b2-4db8-856c-be5856dd9568 admin admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:08.108469 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bedaafd-55b2-4db8-856c-be5856dd9568 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:08.110779 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bedaafd-55b2-4db8-856c-be5856dd9568 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:08.141270 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1147/2274] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 14:58:07 2022] POST /identity/v3/users => generated 300 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:58:08.147053 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b39d8b8-445c-4d33-ac00-372c24c844f0 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:08.165206 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b39d8b8-445c-4d33-ac00-372c24c844f0 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:08.171014 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cef461-9e78-4489-aafa-71d867d35045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:08.171481 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cef461-9e78-4489-aafa-71d867d35045 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:08.171782 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cef461-9e78-4489-aafa-71d867d35045 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:08.172022 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cef461-9e78-4489-aafa-71d867d35045 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:08.172696 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cef461-9e78-4489-aafa-71d867d35045 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:08.174341 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cef461-9e78-4489-aafa-71d867d35045 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:08.192900 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1128/2275] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:58:08 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:58:08.194928 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bedaafd-55b2-4db8-856c-be5856dd9568 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:08.211563 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bedaafd-55b2-4db8-856c-be5856dd9568 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:08.217206 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb57359-9c9f-422e-b490-6181ba8f229f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:08.217827 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb57359-9c9f-422e-b490-6181ba8f229f admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:08.218105 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb57359-9c9f-422e-b490-6181ba8f229f admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:08.218333 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb57359-9c9f-422e-b490-6181ba8f229f admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:08.219037 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb57359-9c9f-422e-b490-6181ba8f229f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:08.220627 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb57359-9c9f-422e-b490-6181ba8f229f admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:08.237030 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1148/2276] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:58:08 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:58:08.238787 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cef461-9e78-4489-aafa-71d867d35045 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:08.249237 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cef461-9e78-4489-aafa-71d867d35045 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:08.254631 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7c2543-8040-4d48-a654-45fe4a3efa29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:08.255302 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7c2543-8040-4d48-a654-45fe4a3efa29 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:08.255593 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7c2543-8040-4d48-a654-45fe4a3efa29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:08.256075 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7c2543-8040-4d48-a654-45fe4a3efa29 admin admin] PATH_INFO: `/v3/projects/e7d459ca945c4de4bff4a6616c45c27c/users/a69b84a5fb9c4262a5f6b3a9f58f9e16/roles/74de6794e3b3422b93d26f993d260c35` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:08.274255 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7c2543-8040-4d48-a654-45fe4a3efa29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7d459ca945c4de4bff4a6616c45c27c, user_id=a69b84a5fb9c4262a5f6b3a9f58f9e16, role_id=74de6794e3b3422b93d26f993d260c35)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:08.277071 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7c2543-8040-4d48-a654-45fe4a3efa29 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:08.294328 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1129/2277] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 14:58:08 2022] PUT /identity/v3/projects/e7d459ca945c4de4bff4a6616c45c27c/users/a69b84a5fb9c4262a5f6b3a9f58f9e16/roles/74de6794e3b3422b93d26f993d260c35 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 14:58:08.305968 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02035651-a463-4b71-99b0-bb61f03f377c None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:08.306253 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02035651-a463-4b71-99b0-bb61f03f377c None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:08.306507 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02035651-a463-4b71-99b0-bb61f03f377c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:08.337823 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-02035651-a463-4b71-99b0-bb61f03f377c None None] MFA Rules not processed for user `a69b84a5fb9c4262a5f6b3a9f58f9e16`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:58:08.338954 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-02035651-a463-4b71-99b0-bb61f03f377c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:08.400451 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:08.411528 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1149/2278] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:58:08 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:58:08.427019 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7c2543-8040-4d48-a654-45fe4a3efa29 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:08.429748 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-4d7c2543-8040-4d48-a654-45fe4a3efa29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:08.495546 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7c2543-8040-4d48-a654-45fe4a3efa29 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:08.500589 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c17b3f-103b-4df8-bbdf-1e90ea50c78d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df648c909ddb41418128b43f925f5ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:08.501444 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c17b3f-103b-4df8-bbdf-1e90ea50c78d service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:08.501728 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c17b3f-103b-4df8-bbdf-1e90ea50c78d service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:08.501997 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c17b3f-103b-4df8-bbdf-1e90ea50c78d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:08.512338 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c17b3f-103b-4df8-bbdf-1e90ea50c78d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:08.513836 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c17b3f-103b-4df8-bbdf-1e90ea50c78d service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:08.527437 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1130/2279] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:58:08 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:58:08.945561 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02035651-a463-4b71-99b0-bb61f03f377c None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:08.947180 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-02035651-a463-4b71-99b0-bb61f03f377c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:09.013844 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02035651-a463-4b71-99b0-bb61f03f377c None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:09.018291 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78ef4d6-b5f4-4bb6-ae75-8468042cc55c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:09.018771 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78ef4d6-b5f4-4bb6-ae75-8468042cc55c service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:09.019133 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78ef4d6-b5f4-4bb6-ae75-8468042cc55c service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:09.019295 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78ef4d6-b5f4-4bb6-ae75-8468042cc55c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:09.021360 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-a78ef4d6-b5f4-4bb6-ae75-8468042cc55c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:09.088771 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78ef4d6-b5f4-4bb6-ae75-8468042cc55c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:09.090261 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78ef4d6-b5f4-4bb6-ae75-8468042cc55c service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:09.100271 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1150/2280] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:58:08 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 14:58:09.215943 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3e309-9e1d-4255-8ef1-c363d84ee3c9 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:09.216499 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3e309-9e1d-4255-8ef1-c363d84ee3c9 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:09.216499 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3e309-9e1d-4255-8ef1-c363d84ee3c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:09.237324 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-2dc3e309-9e1d-4255-8ef1-c363d84ee3c9 None None] MFA Rules not processed for user `d41b4cfa07944135aee7d11807fc4f93`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:58:09.238990 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2dc3e309-9e1d-4255-8ef1-c363d84ee3c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:09.304482 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1131/2281] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:58:09 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:58:13.817377 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78ef4d6-b5f4-4bb6-ae75-8468042cc55c service neutron] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:13.894528 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78ef4d6-b5f4-4bb6-ae75-8468042cc55c service neutron] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:13.901724 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1061148c-eb2d-4976-86a4-fa7ae4651b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:13.902576 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1061148c-eb2d-4976-86a4-fa7ae4651b8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:13.902924 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1061148c-eb2d-4976-86a4-fa7ae4651b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:13.903269 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1061148c-eb2d-4976-86a4-fa7ae4651b8b admin admin] PATH_INFO: `/v3/users/a69b84a5fb9c4262a5f6b3a9f58f9e16` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:13.904590 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1061148c-eb2d-4976-86a4-fa7ae4651b8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a69b84a5fb9c4262a5f6b3a9f58f9e16)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:13.906797 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1061148c-eb2d-4976-86a4-fa7ae4651b8b admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:13.990728 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-1061148c-eb2d-4976-86a4-fa7ae4651b8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a69b84a5fb9c4262a5f6b3a9f58f9e16'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:13.992925 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:14.001940 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-1061148c-eb2d-4976-86a4-fa7ae4651b8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a69b84a5fb9c4262a5f6b3a9f58f9e16'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:14.002904 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-1061148c-eb2d-4976-86a4-fa7ae4651b8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a69b84a5fb9c4262a5f6b3a9f58f9e16'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:14.003660 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-1061148c-eb2d-4976-86a4-fa7ae4651b8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a69b84a5fb9c4262a5f6b3a9f58f9e16'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:14.018208 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-1061148c-eb2d-4976-86a4-fa7ae4651b8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a69b84a5fb9c4262a5f6b3a9f58f9e16'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:14.031147 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1151/2282] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 14:58:13 2022] DELETE /identity/v3/users/a69b84a5fb9c4262a5f6b3a9f58f9e16 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:58:14.035860 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e81328-4391-4d6b-8f04-fd4582ff7768 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:14.036350 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e81328-4391-4d6b-8f04-fd4582ff7768 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:14.036458 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e81328-4391-4d6b-8f04-fd4582ff7768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:14.059226 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-b2e81328-4391-4d6b-8f04-fd4582ff7768 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:58:14.060353 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b2e81328-4391-4d6b-8f04-fd4582ff7768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:14.073399 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:14.135401 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1132/2283] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:58:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:58:14.142910 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1061148c-eb2d-4976-86a4-fa7ae4651b8b admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:14.144423 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-1061148c-eb2d-4976-86a4-fa7ae4651b8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:14.216130 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1061148c-eb2d-4976-86a4-fa7ae4651b8b admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:14.220324 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6d74d6-484a-4536-afe8-bc106cc5d0a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:14.220951 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6d74d6-484a-4536-afe8-bc106cc5d0a2 service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:14.221264 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6d74d6-484a-4536-afe8-bc106cc5d0a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:14.221536 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6d74d6-484a-4536-afe8-bc106cc5d0a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:14.231876 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6d74d6-484a-4536-afe8-bc106cc5d0a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:14.233376 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6d74d6-484a-4536-afe8-bc106cc5d0a2 service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:14.244087 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1152/2284] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:58:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:58:14.546052 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e81328-4391-4d6b-8f04-fd4582ff7768 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:14.547852 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b2e81328-4391-4d6b-8f04-fd4582ff7768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:14.571359 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e81328-4391-4d6b-8f04-fd4582ff7768 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:14.577457 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b0f959-3739-4b27-964e-43d69da773e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:14.578340 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b0f959-3739-4b27-964e-43d69da773e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:14.578740 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b0f959-3739-4b27-964e-43d69da773e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:14.579064 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b0f959-3739-4b27-964e-43d69da773e0 admin admin] PATH_INFO: `/v3/projects/e7d459ca945c4de4bff4a6616c45c27c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:14.580378 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b0f959-3739-4b27-964e-43d69da773e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7d459ca945c4de4bff4a6616c45c27c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:14.582701 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b0f959-3739-4b27-964e-43d69da773e0 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:14.638220 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e9b0f959-3739-4b27-964e-43d69da773e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7d459ca945c4de4bff4a6616c45c27c', 'request_id': 'req-e9b0f959-3739-4b27-964e-43d69da773e0'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:14.644594 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e9b0f959-3739-4b27-964e-43d69da773e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7d459ca945c4de4bff4a6616c45c27c', 'request_id': 'req-e9b0f959-3739-4b27-964e-43d69da773e0'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:14.653824 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e9b0f959-3739-4b27-964e-43d69da773e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7d459ca945c4de4bff4a6616c45c27c', 'request_id': 'req-e9b0f959-3739-4b27-964e-43d69da773e0'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:14.665768 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e9b0f959-3739-4b27-964e-43d69da773e0 admin admin] The token cache is being invalidate because project e7d459ca945c4de4bff4a6616c45c27c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:58:14.665768 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e9b0f959-3739-4b27-964e-43d69da773e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:14.666515 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e9b0f959-3739-4b27-964e-43d69da773e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:14.668171 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1133/2285] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 14:58:14 2022] DELETE /identity/v3/projects/e7d459ca945c4de4bff4a6616c45c27c => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:58:21.133331 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6d74d6-484a-4536-afe8-bc106cc5d0a2 service neutron] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:21.135371 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-5c6d74d6-484a-4536-afe8-bc106cc5d0a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:21.257146 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6d74d6-484a-4536-afe8-bc106cc5d0a2 service neutron] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:21.334600 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39340f61-07a8-449d-abea-d39dcefe3c2d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da0a58c526f34afda909e4ede2b1e1c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:21.335214 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39340f61-07a8-449d-abea-d39dcefe3c2d service placement] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:21.335486 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39340f61-07a8-449d-abea-d39dcefe3c2d service placement] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:21.335750 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39340f61-07a8-449d-abea-d39dcefe3c2d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:21.337532 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-39340f61-07a8-449d-abea-d39dcefe3c2d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:21.349580 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39340f61-07a8-449d-abea-d39dcefe3c2d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:21.351159 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39340f61-07a8-449d-abea-d39dcefe3c2d service placement] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:21.356866 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:21.362384 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1153/2286] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:58:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:58:24.661453 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=46,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:32.049732 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0027cc90-149e-409a-a22d-a09b9a0a8243 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:32.050426 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0027cc90-149e-409a-a22d-a09b9a0a8243 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:32.050426 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0027cc90-149e-409a-a22d-a09b9a0a8243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:32.084149 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-0027cc90-149e-409a-a22d-a09b9a0a8243 None None] MFA Rules not processed for user `2c2b1ac1a17c43d28da8f7e9a199dea4`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:58:32.086275 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-0027cc90-149e-409a-a22d-a09b9a0a8243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:32.176221 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1134/2287] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Sep 19 14:58:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:58:32.193790 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39340f61-07a8-449d-abea-d39dcefe3c2d service placement] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:32.195595 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-39340f61-07a8-449d-abea-d39dcefe3c2d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:32.282048 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39340f61-07a8-449d-abea-d39dcefe3c2d service placement] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:32.288341 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e26678-692f-41ef-bbbb-ed2a231936e9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cb60a5e90343e69a38db4356cb3a90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:32.289100 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e26678-692f-41ef-bbbb-ed2a231936e9 service swift] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:32.289380 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e26678-692f-41ef-bbbb-ed2a231936e9 service swift] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:32.289742 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e26678-692f-41ef-bbbb-ed2a231936e9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:32.300834 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e26678-692f-41ef-bbbb-ed2a231936e9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:32.303325 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e26678-692f-41ef-bbbb-ed2a231936e9 service swift] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:32.319389 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1154/2288] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Sep 19 14:58:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 14:58:42.166909 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=25 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:42.311323 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=32 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:46.687890 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ff21d-5139-4d01-b348-4c337eaadb8c None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:46.688552 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ff21d-5139-4d01-b348-4c337eaadb8c None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:46.688552 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ff21d-5139-4d01-b348-4c337eaadb8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:46.720800 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-c95ff21d-5139-4d01-b348-4c337eaadb8c None None] MFA Rules not processed for user `53fe9d2b2e8b4d22acb170b18f697515`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:58:46.722608 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-c95ff21d-5139-4d01-b348-4c337eaadb8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:46.857090 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1135/2289] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:58:46 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:58:53.207326 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca5212c-f60c-48dc-be2d-b599e1cfcebd None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:53.208046 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca5212c-f60c-48dc-be2d-b599e1cfcebd None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:53.208046 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca5212c-f60c-48dc-be2d-b599e1cfcebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:53.239228 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-fca5212c-f60c-48dc-be2d-b599e1cfcebd None None] MFA Rules not processed for user `2c2b1ac1a17c43d28da8f7e9a199dea4`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:58:53.241296 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-fca5212c-f60c-48dc-be2d-b599e1cfcebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:53.253206 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1155/2290] 10.222.0.26 () {58 vars in 967 bytes} [Mon Sep 19 14:58:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 14:58:53.267106 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95ff21d-5139-4d01-b348-4c337eaadb8c None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:53.280925 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95ff21d-5139-4d01-b348-4c337eaadb8c None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:53.289492 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69319a29-aaf7-408e-8cbb-b18b1090a6e5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cb60a5e90343e69a38db4356cb3a90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:53.290119 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69319a29-aaf7-408e-8cbb-b18b1090a6e5 service swift] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:53.290395 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69319a29-aaf7-408e-8cbb-b18b1090a6e5 service swift] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:53.290730 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69319a29-aaf7-408e-8cbb-b18b1090a6e5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:53.303671 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69319a29-aaf7-408e-8cbb-b18b1090a6e5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:53.305417 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69319a29-aaf7-408e-8cbb-b18b1090a6e5 service swift] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:53.314624 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1136/2291] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Sep 19 14:58:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 14:58:55.547974 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca5212c-f60c-48dc-be2d-b599e1cfcebd None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:55.549593 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-fca5212c-f60c-48dc-be2d-b599e1cfcebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:55.674905 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca5212c-f60c-48dc-be2d-b599e1cfcebd None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:55.681783 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1269f3f0-1202-40bd-8f75-a86d8d9bc768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:55.682771 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269f3f0-1202-40bd-8f75-a86d8d9bc768 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:55.683430 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269f3f0-1202-40bd-8f75-a86d8d9bc768 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:55.683930 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269f3f0-1202-40bd-8f75-a86d8d9bc768 admin admin] PATH_INFO: `/v3/users/d41b4cfa07944135aee7d11807fc4f93` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:55.686760 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1269f3f0-1202-40bd-8f75-a86d8d9bc768 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d41b4cfa07944135aee7d11807fc4f93)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:55.689111 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1269f3f0-1202-40bd-8f75-a86d8d9bc768 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:55.766254 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-1269f3f0-1202-40bd-8f75-a86d8d9bc768 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd41b4cfa07944135aee7d11807fc4f93'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:55.776306 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-1269f3f0-1202-40bd-8f75-a86d8d9bc768 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd41b4cfa07944135aee7d11807fc4f93'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:55.777699 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-1269f3f0-1202-40bd-8f75-a86d8d9bc768 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd41b4cfa07944135aee7d11807fc4f93'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:55.778586 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-1269f3f0-1202-40bd-8f75-a86d8d9bc768 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd41b4cfa07944135aee7d11807fc4f93'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:55.802276 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-1269f3f0-1202-40bd-8f75-a86d8d9bc768 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd41b4cfa07944135aee7d11807fc4f93'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:55.822735 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1156/2292] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 14:58:55 2022] DELETE /identity/v3/users/d41b4cfa07944135aee7d11807fc4f93 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:58:56.027081 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69319a29-aaf7-408e-8cbb-b18b1090a6e5 service swift] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:56.050764 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69319a29-aaf7-408e-8cbb-b18b1090a6e5 service swift] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:56.136296 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408f4388-e109-49e1-9892-6650c22cc5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:56.137246 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f4388-e109-49e1-9892-6650c22cc5d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:56.137693 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f4388-e109-49e1-9892-6650c22cc5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:56.138108 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f4388-e109-49e1-9892-6650c22cc5d1 admin admin] PATH_INFO: `/v3/projects/831597dbd7f4411d8bc2084dd5e65530` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:56.139769 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408f4388-e109-49e1-9892-6650c22cc5d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=831597dbd7f4411d8bc2084dd5e65530)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:56.143021 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408f4388-e109-49e1-9892-6650c22cc5d1 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:56.202683 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-408f4388-e109-49e1-9892-6650c22cc5d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '831597dbd7f4411d8bc2084dd5e65530', 'request_id': 'req-408f4388-e109-49e1-9892-6650c22cc5d1'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:56.211759 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-408f4388-e109-49e1-9892-6650c22cc5d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '831597dbd7f4411d8bc2084dd5e65530', 'request_id': 'req-408f4388-e109-49e1-9892-6650c22cc5d1'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:56.221104 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-408f4388-e109-49e1-9892-6650c22cc5d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '831597dbd7f4411d8bc2084dd5e65530', 'request_id': 'req-408f4388-e109-49e1-9892-6650c22cc5d1'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:56.233660 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-408f4388-e109-49e1-9892-6650c22cc5d1 admin admin] The token cache is being invalidate because project 831597dbd7f4411d8bc2084dd5e65530 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:58:56.233977 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-408f4388-e109-49e1-9892-6650c22cc5d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:56.234732 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-408f4388-e109-49e1-9892-6650c22cc5d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:58:56.236528 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1137/2293] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 14:58:56 2022] DELETE /identity/v3/projects/831597dbd7f4411d8bc2084dd5e65530 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:58:56.243632 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0fbfcd-de99-4bee-9ccc-9ac2682d6564 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:56.243915 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0fbfcd-de99-4bee-9ccc-9ac2682d6564 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:56.244189 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0fbfcd-de99-4bee-9ccc-9ac2682d6564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:56.274335 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-1c0fbfcd-de99-4bee-9ccc-9ac2682d6564 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:58:56.275611 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-1c0fbfcd-de99-4bee-9ccc-9ac2682d6564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:56.346187 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1157/2294] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:58:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:58:56.355645 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1c6108-47eb-40c8-aea7-b2cc3a8dc369 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:56.356096 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1c6108-47eb-40c8-aea7-b2cc3a8dc369 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:56.356607 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1c6108-47eb-40c8-aea7-b2cc3a8dc369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:56.385609 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-8c1c6108-47eb-40c8-aea7-b2cc3a8dc369 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:58:56.386840 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-8c1c6108-47eb-40c8-aea7-b2cc3a8dc369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:56.395181 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1138/2295] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:58:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 14:58:56.399808 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0fbfcd-de99-4bee-9ccc-9ac2682d6564 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:56.410779 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0fbfcd-de99-4bee-9ccc-9ac2682d6564 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:56.416187 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb1fb03-f0e9-4d77-b1c6-8ecd96efb911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:56.416805 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb1fb03-f0e9-4d77-b1c6-8ecd96efb911 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:56.417119 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb1fb03-f0e9-4d77-b1c6-8ecd96efb911 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:56.417389 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb1fb03-f0e9-4d77-b1c6-8ecd96efb911 admin admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:56.418050 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb1fb03-f0e9-4d77-b1c6-8ecd96efb911 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 14:58:56.418348 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb1fb03-f0e9-4d77-b1c6-8ecd96efb911 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:56.419975 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb1fb03-f0e9-4d77-b1c6-8ecd96efb911 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:56.429983 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:56.434284 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1158/2296] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 19 14:58:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 14:58:56.438818 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1c6108-47eb-40c8-aea7-b2cc3a8dc369 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:56.450257 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1c6108-47eb-40c8-aea7-b2cc3a8dc369 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:56.455223 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f60d778-dfd7-4703-b1e8-4efc73f7e91d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:56.455776 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f60d778-dfd7-4703-b1e8-4efc73f7e91d admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:56.456051 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f60d778-dfd7-4703-b1e8-4efc73f7e91d admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:56.456634 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f60d778-dfd7-4703-b1e8-4efc73f7e91d admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:56.457567 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f60d778-dfd7-4703-b1e8-4efc73f7e91d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:56.459665 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f60d778-dfd7-4703-b1e8-4efc73f7e91d admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:56.486263 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:56.503274 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1139/2297] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 14:58:56 2022] POST /identity/v3/projects => generated 375 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:58:56.507837 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb1fb03-f0e9-4d77-b1c6-8ecd96efb911 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:56.518151 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb1fb03-f0e9-4d77-b1c6-8ecd96efb911 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:56.605327 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aa8e79-0255-4c2f-8ff2-af3a1ed9a675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:56.606327 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aa8e79-0255-4c2f-8ff2-af3a1ed9a675 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:56.606786 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aa8e79-0255-4c2f-8ff2-af3a1ed9a675 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:56.607206 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aa8e79-0255-4c2f-8ff2-af3a1ed9a675 admin admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:56.608266 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aa8e79-0255-4c2f-8ff2-af3a1ed9a675 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:56.611724 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aa8e79-0255-4c2f-8ff2-af3a1ed9a675 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:56.646834 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1159/2298] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 14:58:56 2022] POST /identity/v3/users => generated 288 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 14:58:56.650632 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f60d778-dfd7-4703-b1e8-4efc73f7e91d admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:56.663797 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f60d778-dfd7-4703-b1e8-4efc73f7e91d admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:56.669142 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004ea071-e760-488d-9f48-7fffdb6da730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:56.669913 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ea071-e760-488d-9f48-7fffdb6da730 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:56.670382 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ea071-e760-488d-9f48-7fffdb6da730 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:56.670842 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ea071-e760-488d-9f48-7fffdb6da730 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:56.672016 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004ea071-e760-488d-9f48-7fffdb6da730 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:56.675107 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004ea071-e760-488d-9f48-7fffdb6da730 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:56.690444 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1140/2299] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:58:56 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 14:58:56.696579 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aa8e79-0255-4c2f-8ff2-af3a1ed9a675 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:56.714569 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aa8e79-0255-4c2f-8ff2-af3a1ed9a675 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:56.722138 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6e72e2-b782-43f3-a44b-d7b9ac9adf8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:56.723142 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e72e2-b782-43f3-a44b-d7b9ac9adf8a admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:56.723630 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e72e2-b782-43f3-a44b-d7b9ac9adf8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:56.724112 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e72e2-b782-43f3-a44b-d7b9ac9adf8a admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:56.725353 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6e72e2-b782-43f3-a44b-d7b9ac9adf8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:56.728327 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6e72e2-b782-43f3-a44b-d7b9ac9adf8a admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:56.745128 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1160/2300] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 14:58:56 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 14:58:56.750677 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004ea071-e760-488d-9f48-7fffdb6da730 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:56.764553 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004ea071-e760-488d-9f48-7fffdb6da730 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:56.781252 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8751a9-29d4-4962-9f1d-f3823001b899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:56.782488 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8751a9-29d4-4962-9f1d-f3823001b899 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:56.782837 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8751a9-29d4-4962-9f1d-f3823001b899 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:56.783177 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8751a9-29d4-4962-9f1d-f3823001b899 admin admin] PATH_INFO: `/v3/projects/9dd82bfab7f747548140ac32fef2d3d9/users/a1c7290905db4ef9b677f2b21feeecb7/roles/74de6794e3b3422b93d26f993d260c35` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:56.807056 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8751a9-29d4-4962-9f1d-f3823001b899 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dd82bfab7f747548140ac32fef2d3d9, user_id=a1c7290905db4ef9b677f2b21feeecb7, role_id=74de6794e3b3422b93d26f993d260c35)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:56.809810 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8751a9-29d4-4962-9f1d-f3823001b899 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:56.828560 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1141/2301] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 14:58:56 2022] PUT /identity/v3/projects/9dd82bfab7f747548140ac32fef2d3d9/users/a1c7290905db4ef9b677f2b21feeecb7/roles/74de6794e3b3422b93d26f993d260c35 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:58:56.840019 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe793ad7-fac8-403c-bebf-08b0d6e2640c None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:56.840314 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe793ad7-fac8-403c-bebf-08b0d6e2640c None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:56.840616 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe793ad7-fac8-403c-bebf-08b0d6e2640c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:56.885750 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-fe793ad7-fac8-403c-bebf-08b0d6e2640c None None] MFA Rules not processed for user `a1c7290905db4ef9b677f2b21feeecb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:58:56.888244 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-fe793ad7-fac8-403c-bebf-08b0d6e2640c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:56.995748 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1161/2302] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:58:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 14:58:57.006116 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8751a9-29d4-4962-9f1d-f3823001b899 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:57.009162 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ad8751a9-29d4-4962-9f1d-f3823001b899 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:57.119785 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8751a9-29d4-4962-9f1d-f3823001b899 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:57.125745 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94299eec-5200-430d-87f1-d3d32acc3776 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df648c909ddb41418128b43f925f5ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:57.126419 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94299eec-5200-430d-87f1-d3d32acc3776 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:57.126892 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94299eec-5200-430d-87f1-d3d32acc3776 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:57.127362 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94299eec-5200-430d-87f1-d3d32acc3776 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:57.143317 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94299eec-5200-430d-87f1-d3d32acc3776 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:57.145269 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94299eec-5200-430d-87f1-d3d32acc3776 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:57.160685 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1142/2303] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:58:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:58:58.510449 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e9b0cb-da11-476a-801d-77f53c22f3b6 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:58.511033 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e9b0cb-da11-476a-801d-77f53c22f3b6 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:58.511190 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e9b0cb-da11-476a-801d-77f53c22f3b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:58.533163 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-61e9b0cb-da11-476a-801d-77f53c22f3b6 None None] MFA Rules not processed for user `2c2b1ac1a17c43d28da8f7e9a199dea4`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:58:58.534387 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-61e9b0cb-da11-476a-801d-77f53c22f3b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:58.609168 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1162/2304] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Sep 19 14:58:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 14:58:58.631707 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94299eec-5200-430d-87f1-d3d32acc3776 service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:58:58.633682 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-94299eec-5200-430d-87f1-d3d32acc3776 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:58:58.725948 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94299eec-5200-430d-87f1-d3d32acc3776 service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:58:58.734062 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cfc8f7-d312-4d8e-93b0-dab6decc0c0a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cb60a5e90343e69a38db4356cb3a90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:58:58.735283 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cfc8f7-d312-4d8e-93b0-dab6decc0c0a service swift] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:58:58.735283 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cfc8f7-d312-4d8e-93b0-dab6decc0c0a service swift] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:58:58.735283 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cfc8f7-d312-4d8e-93b0-dab6decc0c0a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:58:58.752328 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cfc8f7-d312-4d8e-93b0-dab6decc0c0a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:58:58.754624 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cfc8f7-d312-4d8e-93b0-dab6decc0c0a service swift] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:58:58.769437 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1143/2305] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Sep 19 14:58:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 14:59:08.601509 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=91,keystone:INSERT=3 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:59:08.760574 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:INSERT=2,keystone:SELECT=75 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:59:11.137712 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e9b0cb-da11-476a-801d-77f53c22f3b6 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:59:11.259053 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e9b0cb-da11-476a-801d-77f53c22f3b6 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:59:11.266767 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a054aa77-d98a-40df-9954-53adc7db6fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:59:11.267801 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054aa77-d98a-40df-9954-53adc7db6fac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:59:11.268118 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054aa77-d98a-40df-9954-53adc7db6fac admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:59:11.268405 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054aa77-d98a-40df-9954-53adc7db6fac admin admin] PATH_INFO: `/v3/users/a1c7290905db4ef9b677f2b21feeecb7` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:59:11.270624 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a054aa77-d98a-40df-9954-53adc7db6fac admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1c7290905db4ef9b677f2b21feeecb7)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:59:11.274084 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a054aa77-d98a-40df-9954-53adc7db6fac admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:59:11.371310 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-a054aa77-d98a-40df-9954-53adc7db6fac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1c7290905db4ef9b677f2b21feeecb7'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:59:11.383142 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-a054aa77-d98a-40df-9954-53adc7db6fac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1c7290905db4ef9b677f2b21feeecb7'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:59:11.385016 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-a054aa77-d98a-40df-9954-53adc7db6fac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1c7290905db4ef9b677f2b21feeecb7'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:59:11.385489 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-a054aa77-d98a-40df-9954-53adc7db6fac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1c7290905db4ef9b677f2b21feeecb7'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:59:11.406323 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-a054aa77-d98a-40df-9954-53adc7db6fac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1c7290905db4ef9b677f2b21feeecb7'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:59:11.425470 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1163/2306] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 14:59:11 2022] DELETE /identity/v3/users/a1c7290905db4ef9b677f2b21feeecb7 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:59:11.431062 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c7abc1-03e3-495f-bb72-bd70b35ff36a None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:59:11.431735 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c7abc1-03e3-495f-bb72-bd70b35ff36a None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:59:11.431735 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c7abc1-03e3-495f-bb72-bd70b35ff36a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:59:11.454553 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-23c7abc1-03e3-495f-bb72-bd70b35ff36a None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:59:11.456932 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-23c7abc1-03e3-495f-bb72-bd70b35ff36a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:59:11.537220 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1144/2307] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 14:59:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 14:59:11.549752 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a054aa77-d98a-40df-9954-53adc7db6fac admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:59:11.551582 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-a054aa77-d98a-40df-9954-53adc7db6fac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:59:11.644105 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a054aa77-d98a-40df-9954-53adc7db6fac admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:59:11.648825 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602168eb-dd6b-4c4a-a218-de9e75ae7a0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:59:11.649478 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602168eb-dd6b-4c4a-a218-de9e75ae7a0c service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:59:11.649769 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602168eb-dd6b-4c4a-a218-de9e75ae7a0c service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:59:11.650089 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602168eb-dd6b-4c4a-a218-de9e75ae7a0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:59:11.670667 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602168eb-dd6b-4c4a-a218-de9e75ae7a0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:59:11.671286 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602168eb-dd6b-4c4a-a218-de9e75ae7a0c service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:59:11.683539 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1164/2308] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:59:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 14:59:12.041368 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c7abc1-03e3-495f-bb72-bd70b35ff36a None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:59:12.044231 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-23c7abc1-03e3-495f-bb72-bd70b35ff36a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:59:12.076750 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c7abc1-03e3-495f-bb72-bd70b35ff36a None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:59:12.086006 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc399cd3-45e2-4e16-82a8-cd4e0d2e593d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:59:12.087031 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc399cd3-45e2-4e16-82a8-cd4e0d2e593d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:59:12.087476 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc399cd3-45e2-4e16-82a8-cd4e0d2e593d admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:59:12.087842 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc399cd3-45e2-4e16-82a8-cd4e0d2e593d admin admin] PATH_INFO: `/v3/projects/9dd82bfab7f747548140ac32fef2d3d9` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:59:12.089292 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc399cd3-45e2-4e16-82a8-cd4e0d2e593d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9dd82bfab7f747548140ac32fef2d3d9)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:59:12.091420 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc399cd3-45e2-4e16-82a8-cd4e0d2e593d admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:59:12.167907 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-dc399cd3-45e2-4e16-82a8-cd4e0d2e593d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9dd82bfab7f747548140ac32fef2d3d9', 'request_id': 'req-dc399cd3-45e2-4e16-82a8-cd4e0d2e593d'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:59:12.180785 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-dc399cd3-45e2-4e16-82a8-cd4e0d2e593d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9dd82bfab7f747548140ac32fef2d3d9', 'request_id': 'req-dc399cd3-45e2-4e16-82a8-cd4e0d2e593d'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:59:12.195348 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-dc399cd3-45e2-4e16-82a8-cd4e0d2e593d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9dd82bfab7f747548140ac32fef2d3d9', 'request_id': 'req-dc399cd3-45e2-4e16-82a8-cd4e0d2e593d'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:59:12.210281 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-dc399cd3-45e2-4e16-82a8-cd4e0d2e593d admin admin] The token cache is being invalidate because project 9dd82bfab7f747548140ac32fef2d3d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 14:59:12.210593 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-dc399cd3-45e2-4e16-82a8-cd4e0d2e593d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:59:12.211852 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-dc399cd3-45e2-4e16-82a8-cd4e0d2e593d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 14:59:12.213821 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1145/2309] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 14:59:12 2022] DELETE /identity/v3/projects/9dd82bfab7f747548140ac32fef2d3d9 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 14:59:16.899774 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500c44cc-ce45-40e8-8bff-d51ab9424814 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:59:16.900688 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500c44cc-ce45-40e8-8bff-d51ab9424814 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:59:16.900688 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500c44cc-ce45-40e8-8bff-d51ab9424814 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:59:16.903798 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1165/2310] 10.222.0.26 () {54 vars in 921 bytes} [Mon Sep 19 14:59:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:59:16.914163 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af8d930-3c40-4403-bafd-42fb9b580ff5 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:59:16.915142 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af8d930-3c40-4403-bafd-42fb9b580ff5 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:59:16.915142 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af8d930-3c40-4403-bafd-42fb9b580ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:59:16.944507 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-1af8d930-3c40-4403-bafd-42fb9b580ff5 None None] MFA Rules not processed for user `3017e5d92bef4cc2aeae4f28c78ba233`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:59:16.946407 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-1af8d930-3c40-4403-bafd-42fb9b580ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:59:17.079349 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1146/2311] 10.222.0.26 () {58 vars in 1018 bytes} [Mon Sep 19 14:59:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:59:17.099853 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500c44cc-ce45-40e8-8bff-d51ab9424814 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:59:17.102881 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-500c44cc-ce45-40e8-8bff-d51ab9424814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:59:17.145689 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:59:17.204865 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500c44cc-ce45-40e8-8bff-d51ab9424814 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:59:17.212093 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bf51a0-4adb-4550-9b18-d0d20001d35b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d4e9c3da83402dbe7938aaf2dcbb8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:59:17.213148 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bf51a0-4adb-4550-9b18-d0d20001d35b service glance] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:59:17.213605 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bf51a0-4adb-4550-9b18-d0d20001d35b service glance] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:59:17.214062 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bf51a0-4adb-4550-9b18-d0d20001d35b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:59:17.233259 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bf51a0-4adb-4550-9b18-d0d20001d35b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:59:17.235442 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bf51a0-4adb-4550-9b18-d0d20001d35b service glance] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:59:17.253985 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1166/2312] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:59:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:59:17.397654 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df331edc-d17c-4537-8ee1-95951155fe54 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:59:17.398151 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df331edc-d17c-4537-8ee1-95951155fe54 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:59:17.398624 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df331edc-d17c-4537-8ee1-95951155fe54 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:59:17.401752 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1147/2313] 10.222.0.26 () {54 vars in 921 bytes} [Mon Sep 19 14:59:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:59:17.410253 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f892152-a96d-462b-b8fe-a78e69f1a08d None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:59:17.410695 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f892152-a96d-462b-b8fe-a78e69f1a08d None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:59:17.411088 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f892152-a96d-462b-b8fe-a78e69f1a08d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:59:17.436893 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-6f892152-a96d-462b-b8fe-a78e69f1a08d None None] MFA Rules not processed for user `d20a0d24e7034b6db447ba842ac986dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:59:17.438294 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-6f892152-a96d-462b-b8fe-a78e69f1a08d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:59:17.520924 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1167/2314] 10.222.0.26 () {58 vars in 1018 bytes} [Mon Sep 19 14:59:17 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 14:59:17.536523 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df331edc-d17c-4537-8ee1-95951155fe54 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:59:17.539658 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-df331edc-d17c-4537-8ee1-95951155fe54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:59:17.562763 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df331edc-d17c-4537-8ee1-95951155fe54 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:59:17.569331 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb8ce06-c8f2-4371-997f-05d412840b6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:59:17.570258 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb8ce06-c8f2-4371-997f-05d412840b6b service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:59:17.570671 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb8ce06-c8f2-4371-997f-05d412840b6b service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:59:17.571107 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb8ce06-c8f2-4371-997f-05d412840b6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:59:17.583584 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb8ce06-c8f2-4371-997f-05d412840b6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:59:17.586309 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb8ce06-c8f2-4371-997f-05d412840b6b service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:59:17.601869 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1148/2315] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:59:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:59:17.714512 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc6c7a-3b34-4ace-a284-147d8cce5498 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:59:17.714879 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc6c7a-3b34-4ace-a284-147d8cce5498 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:59:17.715261 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc6c7a-3b34-4ace-a284-147d8cce5498 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:59:17.717096 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1168/2316] 10.222.0.26 () {54 vars in 921 bytes} [Mon Sep 19 14:59:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 14:59:17.724804 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef64752-729b-4827-8f74-795912309783 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:59:17.725438 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef64752-729b-4827-8f74-795912309783 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:59:17.727131 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef64752-729b-4827-8f74-795912309783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:59:17.737653 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:59:17.756538 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-5ef64752-729b-4827-8f74-795912309783 None None] MFA Rules not processed for user `3017e5d92bef4cc2aeae4f28c78ba233`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:59:17.757864 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-5ef64752-729b-4827-8f74-795912309783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:59:17.767801 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1149/2317] 10.222.0.26 () {58 vars in 1018 bytes} [Mon Sep 19 14:59:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:59:17.780842 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcc6c7a-3b34-4ace-a284-147d8cce5498 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:59:17.794065 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcc6c7a-3b34-4ace-a284-147d8cce5498 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:59:17.802582 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46958057-fbbf-4294-a7ea-4bdf2a5cfce1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:59:17.803358 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46958057-fbbf-4294-a7ea-4bdf2a5cfce1 service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:59:17.803777 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46958057-fbbf-4294-a7ea-4bdf2a5cfce1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:59:17.804086 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46958057-fbbf-4294-a7ea-4bdf2a5cfce1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:59:17.822964 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46958057-fbbf-4294-a7ea-4bdf2a5cfce1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:59:17.825722 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46958057-fbbf-4294-a7ea-4bdf2a5cfce1 service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:59:17.846503 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1169/2318] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 14:59:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 14:59:20.741997 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21b9d14-9482-4155-828b-0b8106a4bc32 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:59:20.742880 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21b9d14-9482-4155-828b-0b8106a4bc32 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:59:20.743135 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21b9d14-9482-4155-828b-0b8106a4bc32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:59:20.775920 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-f21b9d14-9482-4155-828b-0b8106a4bc32 None None] MFA Rules not processed for user `2c2b1ac1a17c43d28da8f7e9a199dea4`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:59:20.777418 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f21b9d14-9482-4155-828b-0b8106a4bc32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:59:20.873574 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1150/2319] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Sep 19 14:59:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 14:59:20.887665 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46958057-fbbf-4294-a7ea-4bdf2a5cfce1 service neutron] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:59:20.889401 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-46958057-fbbf-4294-a7ea-4bdf2a5cfce1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:59:20.981625 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46958057-fbbf-4294-a7ea-4bdf2a5cfce1 service neutron] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:59:20.986975 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049ebcd1-7542-4e40-af6e-0dbd2df5e897 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cb60a5e90343e69a38db4356cb3a90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:59:20.987966 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049ebcd1-7542-4e40-af6e-0dbd2df5e897 service swift] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:59:20.988400 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049ebcd1-7542-4e40-af6e-0dbd2df5e897 service swift] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:59:20.988674 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049ebcd1-7542-4e40-af6e-0dbd2df5e897 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:59:21.001663 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049ebcd1-7542-4e40-af6e-0dbd2df5e897 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:59:21.003468 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049ebcd1-7542-4e40-af6e-0dbd2df5e897 service swift] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:59:21.017357 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1170/2320] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Sep 19 14:59:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 14:59:30.863276 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=27 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:59:31.009229 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=77 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:59:47.027883 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae6d12a-74fd-4073-a775-570816b287ac None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:59:47.028535 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae6d12a-74fd-4073-a775-570816b287ac None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:59:47.028535 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae6d12a-74fd-4073-a775-570816b287ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:59:47.049662 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-dae6d12a-74fd-4073-a775-570816b287ac None None] MFA Rules not processed for user `2c2b1ac1a17c43d28da8f7e9a199dea4`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 14:59:47.050965 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-dae6d12a-74fd-4073-a775-570816b287ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 14:59:47.058914 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1151/2321] 10.222.0.26 () {58 vars in 967 bytes} [Mon Sep 19 14:59:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 14:59:47.073870 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049ebcd1-7542-4e40-af6e-0dbd2df5e897 service swift] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 14:59:47.091342 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049ebcd1-7542-4e40-af6e-0dbd2df5e897 service swift] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 14:59:47.098274 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a565ef-d724-472d-94df-be23002bedd1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cb60a5e90343e69a38db4356cb3a90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 14:59:47.099067 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a565ef-d724-472d-94df-be23002bedd1 service swift] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 14:59:47.099437 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a565ef-d724-472d-94df-be23002bedd1 service swift] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 14:59:47.099800 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a565ef-d724-472d-94df-be23002bedd1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 14:59:47.109391 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a565ef-d724-472d-94df-be23002bedd1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 14:59:47.111386 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a565ef-d724-472d-94df-be23002bedd1 service swift] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 14:59:47.120726 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1171/2322] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Sep 19 14:59:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 14:59:57.043646 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:59:57.117017 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=6 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:00:07.677169 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c3ca5c-ff96-448d-be40-b6c1c0bfc2b1 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:00:07.677978 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c3ca5c-ff96-448d-be40-b6c1c0bfc2b1 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:00:07.677978 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c3ca5c-ff96-448d-be40-b6c1c0bfc2b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:00:07.698987 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-f4c3ca5c-ff96-448d-be40-b6c1c0bfc2b1 None None] MFA Rules not processed for user `f063128266bb4a34bb0f0639dfa63334`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:00:07.700248 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f4c3ca5c-ff96-448d-be40-b6c1c0bfc2b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:00:07.772087 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1152/2323] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:00:07 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:00:17.764757 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=25 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:00:26.621551 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a565ef-d724-472d-94df-be23002bedd1 service swift] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:00:26.623124 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-12a565ef-d724-472d-94df-be23002bedd1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:00:26.641413 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a565ef-d724-472d-94df-be23002bedd1 service swift] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:00:26.645787 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34ba8c5-352f-46a3-974f-31b305bc15af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:00:26.646900 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34ba8c5-352f-46a3-974f-31b305bc15af service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:00:26.647397 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34ba8c5-352f-46a3-974f-31b305bc15af service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:00:26.647828 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34ba8c5-352f-46a3-974f-31b305bc15af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:00:26.650162 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-e34ba8c5-352f-46a3-974f-31b305bc15af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:00:26.672840 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34ba8c5-352f-46a3-974f-31b305bc15af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:00:26.674629 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34ba8c5-352f-46a3-974f-31b305bc15af service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:00:26.697670 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1172/2324] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:00:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:00:36.681895 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=6 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:00:39.530771 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c3ca5c-ff96-448d-be40-b6c1c0bfc2b1 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:00:39.543429 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c3ca5c-ff96-448d-be40-b6c1c0bfc2b1 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:00:39.547488 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab8b1ba-2301-431d-89cb-0abf5736e2d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:00:39.548120 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab8b1ba-2301-431d-89cb-0abf5736e2d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:00:39.548399 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab8b1ba-2301-431d-89cb-0abf5736e2d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:00:39.548672 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab8b1ba-2301-431d-89cb-0abf5736e2d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:00:39.550689 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-1ab8b1ba-2301-431d-89cb-0abf5736e2d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:00:39.565477 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab8b1ba-2301-431d-89cb-0abf5736e2d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:00:39.566936 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab8b1ba-2301-431d-89cb-0abf5736e2d3 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:00:39.579281 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1153/2325] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:00:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:00:44.024465 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34ba8c5-352f-46a3-974f-31b305bc15af service neutron] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:00:44.026133 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-e34ba8c5-352f-46a3-974f-31b305bc15af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:00:44.095092 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34ba8c5-352f-46a3-974f-31b305bc15af service neutron] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:00:44.098864 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aef08f-b761-489b-952d-1a5c3ffbdd0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df648c909ddb41418128b43f925f5ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:00:44.099474 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aef08f-b761-489b-952d-1a5c3ffbdd0c service cinder] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:00:44.099750 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aef08f-b761-489b-952d-1a5c3ffbdd0c service cinder] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:00:44.100016 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aef08f-b761-489b-952d-1a5c3ffbdd0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:00:44.101868 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-55aef08f-b761-489b-952d-1a5c3ffbdd0c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:00:44.171057 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aef08f-b761-489b-952d-1a5c3ffbdd0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:00:44.172822 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aef08f-b761-489b-952d-1a5c3ffbdd0c service cinder] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:00:44.183051 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1173/2326] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:00:44 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:00:47.961252 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab8b1ba-2301-431d-89cb-0abf5736e2d3 service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:00:47.963946 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-1ab8b1ba-2301-431d-89cb-0abf5736e2d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:00:47.991446 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab8b1ba-2301-431d-89cb-0abf5736e2d3 service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:00:48.010407 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64bc30e-d11f-44a4-a618-18e0cee55fae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3017e5d92bef4cc2aeae4f28c78ba233', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:00:48.011077 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64bc30e-d11f-44a4-a618-18e0cee55fae service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:00:48.011373 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64bc30e-d11f-44a4-a618-18e0cee55fae service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:00:48.011651 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64bc30e-d11f-44a4-a618-18e0cee55fae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:00:48.013745 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a64bc30e-d11f-44a4-a618-18e0cee55fae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:00:48.127757 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64bc30e-d11f-44a4-a618-18e0cee55fae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:00:48.130943 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64bc30e-d11f-44a4-a618-18e0cee55fae service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:00:48.149937 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1154/2327] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:00:47 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:00:52.341453 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca7cf3-cd15-4010-a58f-515419e612f0 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:00:52.342372 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca7cf3-cd15-4010-a58f-515419e612f0 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:00:52.342372 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca7cf3-cd15-4010-a58f-515419e612f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:00:52.367522 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-53ca7cf3-cd15-4010-a58f-515419e612f0 None None] MFA Rules not processed for user `53fe9d2b2e8b4d22acb170b18f697515`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:00:52.368932 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-53ca7cf3-cd15-4010-a58f-515419e612f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:00:52.378340 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1174/2328] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:00:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:00:53.239846 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6335681c-dbfd-4826-bb92-2a025552d739 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:00:53.240708 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6335681c-dbfd-4826-bb92-2a025552d739 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:00:53.240708 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6335681c-dbfd-4826-bb92-2a025552d739 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:00:53.242095 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1155/2329] 10.222.0.26 () {54 vars in 961 bytes} [Mon Sep 19 15:00:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 15:00:53.248175 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb937143-fa28-4662-90dc-ecb00387655f None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:00:53.248530 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb937143-fa28-4662-90dc-ecb00387655f None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:00:53.249140 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb937143-fa28-4662-90dc-ecb00387655f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:00:53.274509 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-eb937143-fa28-4662-90dc-ecb00387655f None None] MFA Rules not processed for user `da0a58c526f34afda909e4ede2b1e1c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:00:53.277094 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-eb937143-fa28-4662-90dc-ecb00387655f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:00:53.394941 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1175/2330] 10.222.0.26 () {58 vars in 1058 bytes} [Mon Sep 19 15:00:53 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:00:53.407833 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6335681c-dbfd-4826-bb92-2a025552d739 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:00:53.427432 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6335681c-dbfd-4826-bb92-2a025552d739 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:00:53.432939 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ea66ee-b159-46d0-a7e7-d56fa59632a7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da0a58c526f34afda909e4ede2b1e1c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:00:53.433878 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea66ee-b159-46d0-a7e7-d56fa59632a7 service placement] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:00:53.434172 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea66ee-b159-46d0-a7e7-d56fa59632a7 service placement] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:00:53.434441 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea66ee-b159-46d0-a7e7-d56fa59632a7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:00:53.436414 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-95ea66ee-b159-46d0-a7e7-d56fa59632a7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:00:53.449832 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ea66ee-b159-46d0-a7e7-d56fa59632a7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:00:53.451960 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ea66ee-b159-46d0-a7e7-d56fa59632a7 service placement] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:00:53.464395 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1156/2331] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:00:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:00:56.378263 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb937143-fa28-4662-90dc-ecb00387655f None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:00:56.395657 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb937143-fa28-4662-90dc-ecb00387655f None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:00:56.402032 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4ea8d5-898a-4cc9-a702-a01c37e98e92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:00:56.403209 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4ea8d5-898a-4cc9-a702-a01c37e98e92 service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:00:56.403909 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4ea8d5-898a-4cc9-a702-a01c37e98e92 service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:00:56.404517 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4ea8d5-898a-4cc9-a702-a01c37e98e92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:00:56.407317 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-fb4ea8d5-898a-4cc9-a702-a01c37e98e92 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:00:56.423800 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4ea8d5-898a-4cc9-a702-a01c37e98e92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:00:56.426668 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4ea8d5-898a-4cc9-a702-a01c37e98e92 service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:00:56.441269 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1176/2332] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:00:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:00:59.398351 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d6c6e-9536-48af-af21-5936259aeafd None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:00:59.399191 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d6c6e-9536-48af-af21-5936259aeafd None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:00:59.399191 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d6c6e-9536-48af-af21-5936259aeafd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:00:59.422831 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-ba3d6c6e-9536-48af-af21-5936259aeafd None None] MFA Rules not processed for user `ab3ebacb745f4074bb708d9a40c9161d`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:00:59.424073 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ba3d6c6e-9536-48af-af21-5936259aeafd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:00:59.431686 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1157/2333] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:00:59 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:00:59.856536 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4ea8d5-898a-4cc9-a702-a01c37e98e92 service neutron] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:00:59.868094 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4ea8d5-898a-4cc9-a702-a01c37e98e92 service neutron] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:00:59.873075 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9890a8a9-5df1-4663-9914-b82c99ef0468 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:00:59.874187 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890a8a9-5df1-4663-9914-b82c99ef0468 service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:00:59.874535 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890a8a9-5df1-4663-9914-b82c99ef0468 service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:00:59.874876 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890a8a9-5df1-4663-9914-b82c99ef0468 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:00:59.877515 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-9890a8a9-5df1-4663-9914-b82c99ef0468 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:00:59.892440 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9890a8a9-5df1-4663-9914-b82c99ef0468 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:00:59.893951 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9890a8a9-5df1-4663-9914-b82c99ef0468 service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:00:59.904330 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1177/2334] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:00:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:01:09.417101 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=43 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:01:09.899197 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=92 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:01:10.483159 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3d6c6e-9536-48af-af21-5936259aeafd None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:01:10.485141 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ba3d6c6e-9536-48af-af21-5936259aeafd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:01:10.502878 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3d6c6e-9536-48af-af21-5936259aeafd None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:01:10.509275 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9df99b-acca-476d-ac6f-dfe9ac199121 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3017e5d92bef4cc2aeae4f28c78ba233', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:01:10.509924 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9df99b-acca-476d-ac6f-dfe9ac199121 service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:10.510355 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9df99b-acca-476d-ac6f-dfe9ac199121 service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:10.510638 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9df99b-acca-476d-ac6f-dfe9ac199121 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:10.512498 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-df9df99b-acca-476d-ac6f-dfe9ac199121 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:01:10.527613 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9df99b-acca-476d-ac6f-dfe9ac199121 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:01:10.529303 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9df99b-acca-476d-ac6f-dfe9ac199121 service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:01:10.541205 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1158/2335] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:01:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:01:17.301500 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9890a8a9-5df1-4663-9914-b82c99ef0468 service neutron] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:01:17.310506 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9890a8a9-5df1-4663-9914-b82c99ef0468 service neutron] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:01:17.314458 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5346f64f-8345-4156-a9de-47240de55256 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:01:17.315062 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5346f64f-8345-4156-a9de-47240de55256 service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:17.315342 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5346f64f-8345-4156-a9de-47240de55256 service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:17.315612 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5346f64f-8345-4156-a9de-47240de55256 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:17.317525 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-5346f64f-8345-4156-a9de-47240de55256 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:01:17.328075 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5346f64f-8345-4156-a9de-47240de55256 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:01:17.329950 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5346f64f-8345-4156-a9de-47240de55256 service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:01:17.338624 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1178/2336] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:01:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:01:17.473085 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2366ccfd-e406-427e-8377-e1c6cf93011a None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:17.474091 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2366ccfd-e406-427e-8377-e1c6cf93011a None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:17.474436 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2366ccfd-e406-427e-8377-e1c6cf93011a None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:17.475879 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1159/2337] 10.222.0.26 () {54 vars in 921 bytes} [Mon Sep 19 15:01:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 15:01:17.482003 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc8030-6288-42bd-8b7a-ac07881258f2 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:17.482363 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc8030-6288-42bd-8b7a-ac07881258f2 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:17.482687 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc8030-6288-42bd-8b7a-ac07881258f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:17.504189 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-2ffc8030-6288-42bd-8b7a-ac07881258f2 None None] MFA Rules not processed for user `d20a0d24e7034b6db447ba842ac986dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:01:17.505439 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-2ffc8030-6288-42bd-8b7a-ac07881258f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:01:17.512458 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1179/2338] 10.222.0.26 () {58 vars in 1018 bytes} [Mon Sep 19 15:01:17 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:01:17.526345 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2366ccfd-e406-427e-8377-e1c6cf93011a None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:01:17.533098 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffc8030-6288-42bd-8b7a-ac07881258f2 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:01:17.539502 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2366ccfd-e406-427e-8377-e1c6cf93011a None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:01:17.543445 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46f1b72-e164-41c8-a7a7-04bf8af2337c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:01:17.544150 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46f1b72-e164-41c8-a7a7-04bf8af2337c service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:17.544493 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46f1b72-e164-41c8-a7a7-04bf8af2337c service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:17.544879 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46f1b72-e164-41c8-a7a7-04bf8af2337c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:17.546209 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffc8030-6288-42bd-8b7a-ac07881258f2 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:01:17.549974 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded89816-ce81-4f1c-afc9-9581fe28dfc3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df648c909ddb41418128b43f925f5ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:01:17.550642 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded89816-ce81-4f1c-afc9-9581fe28dfc3 service cinder] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:17.550923 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded89816-ce81-4f1c-afc9-9581fe28dfc3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:17.551275 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded89816-ce81-4f1c-afc9-9581fe28dfc3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:17.553045 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-ded89816-ce81-4f1c-afc9-9581fe28dfc3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:01:17.555450 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46f1b72-e164-41c8-a7a7-04bf8af2337c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:01:17.556919 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46f1b72-e164-41c8-a7a7-04bf8af2337c service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:01:17.565720 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded89816-ce81-4f1c-afc9-9581fe28dfc3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:01:17.567236 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded89816-ce81-4f1c-afc9-9581fe28dfc3 service cinder] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:01:17.569157 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1160/2339] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:01:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:01:17.593140 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1180/2340] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:01:17 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:01:17.670865 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d269d07-df2b-46a0-9301-c40f46309029 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:17.670865 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d269d07-df2b-46a0-9301-c40f46309029 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:17.671118 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d269d07-df2b-46a0-9301-c40f46309029 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:17.672535 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1161/2341] 10.222.0.26 () {54 vars in 921 bytes} [Mon Sep 19 15:01:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:01:17.678832 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef812a-a8c9-45e0-91e5-9e1bee32ec35 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:17.679106 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef812a-a8c9-45e0-91e5-9e1bee32ec35 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:17.679377 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef812a-a8c9-45e0-91e5-9e1bee32ec35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:17.702334 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-68ef812a-a8c9-45e0-91e5-9e1bee32ec35 None None] MFA Rules not processed for user `3017e5d92bef4cc2aeae4f28c78ba233`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:01:17.704302 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-68ef812a-a8c9-45e0-91e5-9e1bee32ec35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:01:17.715241 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1181/2342] 10.222.0.26 () {58 vars in 1018 bytes} [Mon Sep 19 15:01:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:01:17.727053 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d269d07-df2b-46a0-9301-c40f46309029 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:01:17.739678 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d269d07-df2b-46a0-9301-c40f46309029 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:01:17.743706 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ff73c7-4182-4245-91e4-cdceafd85d72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:01:17.744315 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff73c7-4182-4245-91e4-cdceafd85d72 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:17.744618 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff73c7-4182-4245-91e4-cdceafd85d72 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:17.744849 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff73c7-4182-4245-91e4-cdceafd85d72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:17.755868 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ff73c7-4182-4245-91e4-cdceafd85d72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:01:17.757426 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ff73c7-4182-4245-91e4-cdceafd85d72 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:01:17.769986 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1162/2343] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:01:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:01:20.109100 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ef812a-a8c9-45e0-91e5-9e1bee32ec35 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:01:20.120460 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ef812a-a8c9-45e0-91e5-9e1bee32ec35 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:01:20.127007 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8854e2-e044-4c4c-8170-1e076aef5f7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3017e5d92bef4cc2aeae4f28c78ba233', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:01:20.127560 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8854e2-e044-4c4c-8170-1e076aef5f7e service nova] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:20.127838 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8854e2-e044-4c4c-8170-1e076aef5f7e service nova] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:20.128110 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8854e2-e044-4c4c-8170-1e076aef5f7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:20.130051 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-9c8854e2-e044-4c4c-8170-1e076aef5f7e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:01:20.143521 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8854e2-e044-4c4c-8170-1e076aef5f7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:01:20.145237 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8854e2-e044-4c4c-8170-1e076aef5f7e service nova] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:01:20.157169 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1182/2344] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:01:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:01:25.340059 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ff73c7-4182-4245-91e4-cdceafd85d72 service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:01:25.365370 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ff73c7-4182-4245-91e4-cdceafd85d72 service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:01:25.374119 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b06246-23b2-4c57-acdc-6def946f217c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3017e5d92bef4cc2aeae4f28c78ba233', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:01:25.374945 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b06246-23b2-4c57-acdc-6def946f217c service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:25.375322 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b06246-23b2-4c57-acdc-6def946f217c service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:25.375806 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b06246-23b2-4c57-acdc-6def946f217c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:25.378071 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-35b06246-23b2-4c57-acdc-6def946f217c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:01:25.391542 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b06246-23b2-4c57-acdc-6def946f217c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:01:25.393348 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b06246-23b2-4c57-acdc-6def946f217c service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:01:25.406007 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1163/2345] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:01:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:01:30.151918 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=24 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:01:33.853439 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8854e2-e044-4c4c-8170-1e076aef5f7e service nova] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:01:33.855255 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-9c8854e2-e044-4c4c-8170-1e076aef5f7e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:01:33.868561 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8854e2-e044-4c4c-8170-1e076aef5f7e service nova] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:01:33.873295 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d3ada5-44b2-4a4f-8133-11ced11d505d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df648c909ddb41418128b43f925f5ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:01:33.874517 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3ada5-44b2-4a4f-8133-11ced11d505d service cinder] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:33.874984 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3ada5-44b2-4a4f-8133-11ced11d505d service cinder] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:33.875449 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3ada5-44b2-4a4f-8133-11ced11d505d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:33.878973 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-58d3ada5-44b2-4a4f-8133-11ced11d505d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:01:33.966651 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d3ada5-44b2-4a4f-8133-11ced11d505d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:01:33.968139 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d3ada5-44b2-4a4f-8133-11ced11d505d service cinder] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:01:33.979134 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1183/2346] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:01:33 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 15:01:35.400886 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=24 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:01:42.639275 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b06246-23b2-4c57-acdc-6def946f217c service nova] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:01:42.652212 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b06246-23b2-4c57-acdc-6def946f217c service nova] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:01:42.660460 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3217caef-9f5f-4f39-a0f9-9fb17aa3bb69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:01:42.661295 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3217caef-9f5f-4f39-a0f9-9fb17aa3bb69 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:42.661700 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3217caef-9f5f-4f39-a0f9-9fb17aa3bb69 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:42.662185 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3217caef-9f5f-4f39-a0f9-9fb17aa3bb69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:42.664764 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-3217caef-9f5f-4f39-a0f9-9fb17aa3bb69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:01:42.746413 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3217caef-9f5f-4f39-a0f9-9fb17aa3bb69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:01:42.748439 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3217caef-9f5f-4f39-a0f9-9fb17aa3bb69 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:01:42.759546 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1164/2347] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:01:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:01:43.268017 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c389c78e-69b3-4f18-b6d8-fa1fdbae8e8e None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:43.268967 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c389c78e-69b3-4f18-b6d8-fa1fdbae8e8e None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:43.268967 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c389c78e-69b3-4f18-b6d8-fa1fdbae8e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:43.303134 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-c389c78e-69b3-4f18-b6d8-fa1fdbae8e8e None None] MFA Rules not processed for user `f1c836a721f54178a02d864ce57c776e`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:01:43.304859 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-c389c78e-69b3-4f18-b6d8-fa1fdbae8e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:01:43.316405 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1184/2348] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:01:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:01:48.427192 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3217caef-9f5f-4f39-a0f9-9fb17aa3bb69 service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:01:48.429500 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-3217caef-9f5f-4f39-a0f9-9fb17aa3bb69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:01:48.444915 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3217caef-9f5f-4f39-a0f9-9fb17aa3bb69 service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:01:48.451730 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d69aad-4b29-4648-9592-16d1cf470140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:01:48.452822 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d69aad-4b29-4648-9592-16d1cf470140 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:48.453617 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d69aad-4b29-4648-9592-16d1cf470140 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:48.454298 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d69aad-4b29-4648-9592-16d1cf470140 admin admin] PATH_INFO: `/v3/users/f063128266bb4a34bb0f0639dfa63334` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:48.456581 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d69aad-4b29-4648-9592-16d1cf470140 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f063128266bb4a34bb0f0639dfa63334)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:01:48.460531 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d69aad-4b29-4648-9592-16d1cf470140 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:01:48.551109 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-85d69aad-4b29-4648-9592-16d1cf470140 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f063128266bb4a34bb0f0639dfa63334'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:01:48.568618 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-85d69aad-4b29-4648-9592-16d1cf470140 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f063128266bb4a34bb0f0639dfa63334'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:01:48.569736 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-85d69aad-4b29-4648-9592-16d1cf470140 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f063128266bb4a34bb0f0639dfa63334'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:01:48.570477 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-85d69aad-4b29-4648-9592-16d1cf470140 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f063128266bb4a34bb0f0639dfa63334'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:01:48.585790 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-85d69aad-4b29-4648-9592-16d1cf470140 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f063128266bb4a34bb0f0639dfa63334'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:01:48.612148 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1165/2349] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 15:01:48 2022] DELETE /identity/v3/users/f063128266bb4a34bb0f0639dfa63334 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:01:48.888376 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c389c78e-69b3-4f18-b6d8-fa1fdbae8e8e None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:01:48.907203 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c389c78e-69b3-4f18-b6d8-fa1fdbae8e8e None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:01:49.005599 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd95d58d-9742-4686-ad98-f8d50920e4f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:01:49.006685 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd95d58d-9742-4686-ad98-f8d50920e4f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:49.007170 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd95d58d-9742-4686-ad98-f8d50920e4f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:49.007632 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd95d58d-9742-4686-ad98-f8d50920e4f8 admin admin] PATH_INFO: `/v3/projects/6bcf4aea08994c31acd194d2c035af0e` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:49.015793 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd95d58d-9742-4686-ad98-f8d50920e4f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bcf4aea08994c31acd194d2c035af0e)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:01:49.019763 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd95d58d-9742-4686-ad98-f8d50920e4f8 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:01:49.092793 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-fd95d58d-9742-4686-ad98-f8d50920e4f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bcf4aea08994c31acd194d2c035af0e', 'request_id': 'req-fd95d58d-9742-4686-ad98-f8d50920e4f8'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:01:49.100496 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-fd95d58d-9742-4686-ad98-f8d50920e4f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bcf4aea08994c31acd194d2c035af0e', 'request_id': 'req-fd95d58d-9742-4686-ad98-f8d50920e4f8'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:01:49.116791 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-fd95d58d-9742-4686-ad98-f8d50920e4f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bcf4aea08994c31acd194d2c035af0e', 'request_id': 'req-fd95d58d-9742-4686-ad98-f8d50920e4f8'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:01:49.142204 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-fd95d58d-9742-4686-ad98-f8d50920e4f8 admin admin] The token cache is being invalidate because project 6bcf4aea08994c31acd194d2c035af0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:01:49.142707 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-fd95d58d-9742-4686-ad98-f8d50920e4f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:01:49.143870 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-fd95d58d-9742-4686-ad98-f8d50920e4f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:01:49.146532 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1185/2350] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 15:01:48 2022] DELETE /identity/v3/projects/6bcf4aea08994c31acd194d2c035af0e => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:01:49.154221 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66064824-8ca2-4c1b-b25c-d2069e515bfe None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:49.154865 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66064824-8ca2-4c1b-b25c-d2069e515bfe None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:49.155407 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66064824-8ca2-4c1b-b25c-d2069e515bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:49.183876 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-66064824-8ca2-4c1b-b25c-d2069e515bfe None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:01:49.186183 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-66064824-8ca2-4c1b-b25c-d2069e515bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:01:49.288863 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1166/2351] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:01:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:01:49.301144 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911dc4cd-2d03-48e7-832b-3325ee60bb8a None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:49.301990 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911dc4cd-2d03-48e7-832b-3325ee60bb8a None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:49.302436 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911dc4cd-2d03-48e7-832b-3325ee60bb8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:49.328369 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-911dc4cd-2d03-48e7-832b-3325ee60bb8a None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:01:49.330417 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-911dc4cd-2d03-48e7-832b-3325ee60bb8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:01:49.347557 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1186/2352] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:01:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:01:49.350123 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66064824-8ca2-4c1b-b25c-d2069e515bfe None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:01:49.371772 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66064824-8ca2-4c1b-b25c-d2069e515bfe None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:01:49.381161 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16ca811-6b24-4ffe-842d-811b84c4d65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:01:49.381161 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ca811-6b24-4ffe-842d-811b84c4d65f admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:49.381161 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ca811-6b24-4ffe-842d-811b84c4d65f admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:49.381998 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ca811-6b24-4ffe-842d-811b84c4d65f admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:49.382434 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16ca811-6b24-4ffe-842d-811b84c4d65f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:01:49.383087 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16ca811-6b24-4ffe-842d-811b84c4d65f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:01:49.386027 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16ca811-6b24-4ffe-842d-811b84c4d65f admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:01:49.389792 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:01:49.415409 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1167/2353] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 19 15:01:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:01:49.416810 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911dc4cd-2d03-48e7-832b-3325ee60bb8a None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:01:49.430926 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911dc4cd-2d03-48e7-832b-3325ee60bb8a None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:01:49.438925 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021e5a19-d62c-42fa-ae09-16f47c9f1523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:01:49.439945 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e5a19-d62c-42fa-ae09-16f47c9f1523 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:49.440442 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e5a19-d62c-42fa-ae09-16f47c9f1523 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:49.440833 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e5a19-d62c-42fa-ae09-16f47c9f1523 admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:49.442011 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021e5a19-d62c-42fa-ae09-16f47c9f1523 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:01:49.445546 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021e5a19-d62c-42fa-ae09-16f47c9f1523 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:01:49.466655 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:01:49.482835 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1187/2354] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 15:01:49 2022] POST /identity/v3/projects => generated 367 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:01:49.488418 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16ca811-6b24-4ffe-842d-811b84c4d65f admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:01:49.502287 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16ca811-6b24-4ffe-842d-811b84c4d65f admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:01:49.587901 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2832f9f5-d224-4bd5-a68b-0387a612c69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:01:49.588738 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2832f9f5-d224-4bd5-a68b-0387a612c69a admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:49.589226 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2832f9f5-d224-4bd5-a68b-0387a612c69a admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:49.589645 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2832f9f5-d224-4bd5-a68b-0387a612c69a admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:49.590671 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2832f9f5-d224-4bd5-a68b-0387a612c69a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:01:49.593563 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2832f9f5-d224-4bd5-a68b-0387a612c69a admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:01:49.625860 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1168/2355] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 15:01:49 2022] POST /identity/v3/users => generated 284 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:01:49.631006 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021e5a19-d62c-42fa-ae09-16f47c9f1523 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:01:49.647324 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021e5a19-d62c-42fa-ae09-16f47c9f1523 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:01:49.652419 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663aa98e-e38b-4040-bb5f-de59ab407506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:01:49.653155 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663aa98e-e38b-4040-bb5f-de59ab407506 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:49.653442 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663aa98e-e38b-4040-bb5f-de59ab407506 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:49.654254 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663aa98e-e38b-4040-bb5f-de59ab407506 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:49.655293 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663aa98e-e38b-4040-bb5f-de59ab407506 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:01:49.657498 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663aa98e-e38b-4040-bb5f-de59ab407506 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:01:49.670158 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1188/2356] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 15:01:49 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:01:49.674376 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2832f9f5-d224-4bd5-a68b-0387a612c69a admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:01:49.686832 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2832f9f5-d224-4bd5-a68b-0387a612c69a admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:01:49.691838 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3738c9-26b9-480a-878b-1da91b85c79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:01:49.692502 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3738c9-26b9-480a-878b-1da91b85c79b admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:49.692785 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3738c9-26b9-480a-878b-1da91b85c79b admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:49.693329 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3738c9-26b9-480a-878b-1da91b85c79b admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:49.694337 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3738c9-26b9-480a-878b-1da91b85c79b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:01:49.696950 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3738c9-26b9-480a-878b-1da91b85c79b admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:01:49.715974 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1169/2357] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 15:01:49 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:01:49.721835 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663aa98e-e38b-4040-bb5f-de59ab407506 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:01:49.738031 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663aa98e-e38b-4040-bb5f-de59ab407506 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:01:49.743903 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dccda7f-811c-4892-b23b-469f6520a6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:01:49.744548 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dccda7f-811c-4892-b23b-469f6520a6b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:49.744824 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dccda7f-811c-4892-b23b-469f6520a6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:49.745132 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dccda7f-811c-4892-b23b-469f6520a6b1 admin admin] PATH_INFO: `/v3/projects/0ad834bc44a94d92bc6417109617be8c/users/73197ba53c344288af1304c5fab4bd6f/roles/74de6794e3b3422b93d26f993d260c35` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:49.763286 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dccda7f-811c-4892-b23b-469f6520a6b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ad834bc44a94d92bc6417109617be8c, user_id=73197ba53c344288af1304c5fab4bd6f, role_id=74de6794e3b3422b93d26f993d260c35)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:01:49.766348 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dccda7f-811c-4892-b23b-469f6520a6b1 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:01:49.786306 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1189/2358] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 15:01:49 2022] PUT /identity/v3/projects/0ad834bc44a94d92bc6417109617be8c/users/73197ba53c344288af1304c5fab4bd6f/roles/74de6794e3b3422b93d26f993d260c35 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:01:49.804181 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f5766f-220d-4d5e-a259-3865157614c9 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:49.804520 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f5766f-220d-4d5e-a259-3865157614c9 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:49.804912 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f5766f-220d-4d5e-a259-3865157614c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:49.852718 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-51f5766f-220d-4d5e-a259-3865157614c9 None None] MFA Rules not processed for user `73197ba53c344288af1304c5fab4bd6f`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:01:49.854075 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-51f5766f-220d-4d5e-a259-3865157614c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:01:49.938002 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1170/2359] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:01:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:01:49.943802 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dccda7f-811c-4892-b23b-469f6520a6b1 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:01:50.039260 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dccda7f-811c-4892-b23b-469f6520a6b1 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:01:50.046886 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7591c6f2-62cd-4351-9b04-b385bfc1cd03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:01:50.047863 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7591c6f2-62cd-4351-9b04-b385bfc1cd03 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:50.048145 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7591c6f2-62cd-4351-9b04-b385bfc1cd03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:50.048439 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7591c6f2-62cd-4351-9b04-b385bfc1cd03 admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:50.049574 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7591c6f2-62cd-4351-9b04-b385bfc1cd03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:01:50.052855 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7591c6f2-62cd-4351-9b04-b385bfc1cd03 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:01:50.096764 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1190/2360] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 15:01:49 2022] POST /identity/v3/projects => generated 369 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 15:01:50.101434 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f5766f-220d-4d5e-a259-3865157614c9 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:01:50.115022 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f5766f-220d-4d5e-a259-3865157614c9 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:01:50.185366 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdde4b1-99f4-4d43-981b-191efa84b3bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:01:50.185981 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdde4b1-99f4-4d43-981b-191efa84b3bd admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:50.186254 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdde4b1-99f4-4d43-981b-191efa84b3bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:50.186516 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdde4b1-99f4-4d43-981b-191efa84b3bd admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:50.187148 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdde4b1-99f4-4d43-981b-191efa84b3bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:01:50.189152 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdde4b1-99f4-4d43-981b-191efa84b3bd admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:01:50.199442 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:01:50.215251 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1171/2361] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 15:01:50 2022] POST /identity/v3/users => generated 291 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 15:01:50.221381 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7591c6f2-62cd-4351-9b04-b385bfc1cd03 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:01:50.237498 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7591c6f2-62cd-4351-9b04-b385bfc1cd03 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:01:50.243962 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af298c5-21c6-47d9-8918-71048a2aaf69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:01:50.244626 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af298c5-21c6-47d9-8918-71048a2aaf69 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:50.244929 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af298c5-21c6-47d9-8918-71048a2aaf69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:50.245205 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af298c5-21c6-47d9-8918-71048a2aaf69 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:50.245874 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af298c5-21c6-47d9-8918-71048a2aaf69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:01:50.248285 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af298c5-21c6-47d9-8918-71048a2aaf69 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:01:50.260424 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1191/2362] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 15:01:50 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:01:50.267117 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdde4b1-99f4-4d43-981b-191efa84b3bd admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:01:50.279123 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdde4b1-99f4-4d43-981b-191efa84b3bd admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:01:50.285178 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb002eb3-d0d5-4ec6-a6eb-4c11bac39faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:01:50.285868 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb002eb3-d0d5-4ec6-a6eb-4c11bac39faa admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:50.286147 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb002eb3-d0d5-4ec6-a6eb-4c11bac39faa admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:50.286417 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb002eb3-d0d5-4ec6-a6eb-4c11bac39faa admin admin] PATH_INFO: `/v3/projects/b07e4e136c2249f08dacf3b24ee2cf36/users/373b27dee65943e6ba4db1a570807ba4/roles/019bde1756cb40de8ce06cef6b261f79` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:50.306896 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb002eb3-d0d5-4ec6-a6eb-4c11bac39faa admin admin] RBAC: Authorizing `identity:create_grant(project_id=b07e4e136c2249f08dacf3b24ee2cf36, user_id=373b27dee65943e6ba4db1a570807ba4, role_id=019bde1756cb40de8ce06cef6b261f79)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:01:50.309728 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb002eb3-d0d5-4ec6-a6eb-4c11bac39faa admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:01:50.325698 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1172/2363] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 15:01:50 2022] PUT /identity/v3/projects/b07e4e136c2249f08dacf3b24ee2cf36/users/373b27dee65943e6ba4db1a570807ba4/roles/019bde1756cb40de8ce06cef6b261f79 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:01:50.332575 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af298c5-21c6-47d9-8918-71048a2aaf69 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:01:50.344640 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af298c5-21c6-47d9-8918-71048a2aaf69 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:01:50.421609 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad933815-c289-4d67-b97d-b2880b9b2d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:01:50.422537 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad933815-c289-4d67-b97d-b2880b9b2d17 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:50.423150 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad933815-c289-4d67-b97d-b2880b9b2d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:50.423395 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad933815-c289-4d67-b97d-b2880b9b2d17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:50.424459 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad933815-c289-4d67-b97d-b2880b9b2d17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:01:50.427471 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad933815-c289-4d67-b97d-b2880b9b2d17 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:01:50.448526 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1192/2364] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 15:01:50 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:01:50.454728 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb002eb3-d0d5-4ec6-a6eb-4c11bac39faa admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:01:50.470750 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb002eb3-d0d5-4ec6-a6eb-4c11bac39faa admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:01:50.476889 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a00337-7cf7-42ad-8d66-fd3036a2179b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:01:50.478014 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a00337-7cf7-42ad-8d66-fd3036a2179b admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:50.478481 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a00337-7cf7-42ad-8d66-fd3036a2179b admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:50.478953 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a00337-7cf7-42ad-8d66-fd3036a2179b admin admin] PATH_INFO: `/v3/projects/b07e4e136c2249f08dacf3b24ee2cf36/users/373b27dee65943e6ba4db1a570807ba4/roles/019bde1756cb40de8ce06cef6b261f79` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:50.482353 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a00337-7cf7-42ad-8d66-fd3036a2179b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b07e4e136c2249f08dacf3b24ee2cf36, user_id=373b27dee65943e6ba4db1a570807ba4, role_id=019bde1756cb40de8ce06cef6b261f79)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:01:50.485488 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a00337-7cf7-42ad-8d66-fd3036a2179b admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:01:50.511947 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1173/2365] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 15:01:50 2022] PUT /identity/v3/projects/b07e4e136c2249f08dacf3b24ee2cf36/users/373b27dee65943e6ba4db1a570807ba4/roles/019bde1756cb40de8ce06cef6b261f79 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:01:50.533405 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d9ae0-3f46-4633-8fd9-03fe6331b8a6 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:50.533728 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d9ae0-3f46-4633-8fd9-03fe6331b8a6 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:50.533973 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d9ae0-3f46-4633-8fd9-03fe6331b8a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:50.582759 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-c07d9ae0-3f46-4633-8fd9-03fe6331b8a6 None None] MFA Rules not processed for user `373b27dee65943e6ba4db1a570807ba4`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:01:50.584751 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-c07d9ae0-3f46-4633-8fd9-03fe6331b8a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:01:50.617871 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:01:50.706237 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1193/2366] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:01:50 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:01:50.717988 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a00337-7cf7-42ad-8d66-fd3036a2179b admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:01:50.719776 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-43a00337-7cf7-42ad-8d66-fd3036a2179b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:01:50.792080 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a00337-7cf7-42ad-8d66-fd3036a2179b admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:01:50.798450 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d246fc1c-75f2-4616-b3d8-3cd37dbe1f57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df648c909ddb41418128b43f925f5ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:01:50.799399 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d246fc1c-75f2-4616-b3d8-3cd37dbe1f57 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:50.799857 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d246fc1c-75f2-4616-b3d8-3cd37dbe1f57 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:50.800285 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d246fc1c-75f2-4616-b3d8-3cd37dbe1f57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:50.814149 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d246fc1c-75f2-4616-b3d8-3cd37dbe1f57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:01:50.815616 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d246fc1c-75f2-4616-b3d8-3cd37dbe1f57 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:01:50.826249 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1174/2367] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:01:50 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:01:52.844415 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07d9ae0-3f46-4633-8fd9-03fe6331b8a6 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:01:52.965766 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07d9ae0-3f46-4633-8fd9-03fe6331b8a6 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:01:52.974632 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c78fe5c-80e1-44c8-91bc-9663ebbb41ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:01:52.975770 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c78fe5c-80e1-44c8-91bc-9663ebbb41ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:52.976238 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c78fe5c-80e1-44c8-91bc-9663ebbb41ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:52.976667 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c78fe5c-80e1-44c8-91bc-9663ebbb41ee admin admin] PATH_INFO: `/v3/users/73197ba53c344288af1304c5fab4bd6f` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:52.978772 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c78fe5c-80e1-44c8-91bc-9663ebbb41ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=73197ba53c344288af1304c5fab4bd6f)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:01:52.981268 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c78fe5c-80e1-44c8-91bc-9663ebbb41ee admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:01:53.064177 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-0c78fe5c-80e1-44c8-91bc-9663ebbb41ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73197ba53c344288af1304c5fab4bd6f'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:01:53.077550 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-0c78fe5c-80e1-44c8-91bc-9663ebbb41ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73197ba53c344288af1304c5fab4bd6f'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:01:53.078986 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-0c78fe5c-80e1-44c8-91bc-9663ebbb41ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73197ba53c344288af1304c5fab4bd6f'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:01:53.080033 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-0c78fe5c-80e1-44c8-91bc-9663ebbb41ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73197ba53c344288af1304c5fab4bd6f'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:01:53.103137 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-0c78fe5c-80e1-44c8-91bc-9663ebbb41ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73197ba53c344288af1304c5fab4bd6f'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:01:53.125029 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1194/2368] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 15:01:52 2022] DELETE /identity/v3/users/73197ba53c344288af1304c5fab4bd6f => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:01:53.129790 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e9c87-592c-4437-bb39-a02bdffc3251 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:53.130601 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e9c87-592c-4437-bb39-a02bdffc3251 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:53.130749 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e9c87-592c-4437-bb39-a02bdffc3251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:53.155997 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-e51e9c87-592c-4437-bb39-a02bdffc3251 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:01:53.157649 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e51e9c87-592c-4437-bb39-a02bdffc3251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:01:53.240922 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1175/2369] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:01:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:01:53.251918 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c78fe5c-80e1-44c8-91bc-9663ebbb41ee admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:01:53.253447 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-0c78fe5c-80e1-44c8-91bc-9663ebbb41ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:01:53.297373 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:01:53.327726 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c78fe5c-80e1-44c8-91bc-9663ebbb41ee admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:01:53.332234 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f578229d-8b00-4148-a126-b799a3e6a922 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:01:53.332869 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f578229d-8b00-4148-a126-b799a3e6a922 service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:53.333182 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f578229d-8b00-4148-a126-b799a3e6a922 service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:53.333451 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f578229d-8b00-4148-a126-b799a3e6a922 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:53.345073 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f578229d-8b00-4148-a126-b799a3e6a922 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:01:53.346524 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f578229d-8b00-4148-a126-b799a3e6a922 service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:01:53.357168 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1195/2370] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:01:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 15:01:53.713893 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51e9c87-592c-4437-bb39-a02bdffc3251 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:01:53.716500 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e51e9c87-592c-4437-bb39-a02bdffc3251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:01:53.738936 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51e9c87-592c-4437-bb39-a02bdffc3251 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:01:53.747747 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d4da6b-a5fd-44e2-a5d8-f5c0ec92e80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:01:53.748555 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d4da6b-a5fd-44e2-a5d8-f5c0ec92e80b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:53.748858 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d4da6b-a5fd-44e2-a5d8-f5c0ec92e80b admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:53.749263 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d4da6b-a5fd-44e2-a5d8-f5c0ec92e80b admin admin] PATH_INFO: `/v3/projects/0ad834bc44a94d92bc6417109617be8c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:53.751042 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d4da6b-a5fd-44e2-a5d8-f5c0ec92e80b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ad834bc44a94d92bc6417109617be8c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:01:53.754703 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d4da6b-a5fd-44e2-a5d8-f5c0ec92e80b admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:01:53.828855 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-89d4da6b-a5fd-44e2-a5d8-f5c0ec92e80b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ad834bc44a94d92bc6417109617be8c', 'request_id': 'req-89d4da6b-a5fd-44e2-a5d8-f5c0ec92e80b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:01:53.830907 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:INSERT=4,keystone:SELECT=92,keystone:DELETE=4 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:01:53.840081 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-89d4da6b-a5fd-44e2-a5d8-f5c0ec92e80b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ad834bc44a94d92bc6417109617be8c', 'request_id': 'req-89d4da6b-a5fd-44e2-a5d8-f5c0ec92e80b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:01:53.856328 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-89d4da6b-a5fd-44e2-a5d8-f5c0ec92e80b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ad834bc44a94d92bc6417109617be8c', 'request_id': 'req-89d4da6b-a5fd-44e2-a5d8-f5c0ec92e80b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:01:53.876742 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-89d4da6b-a5fd-44e2-a5d8-f5c0ec92e80b admin admin] The token cache is being invalidate because project 0ad834bc44a94d92bc6417109617be8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:01:53.877113 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-89d4da6b-a5fd-44e2-a5d8-f5c0ec92e80b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:01:53.878211 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-89d4da6b-a5fd-44e2-a5d8-f5c0ec92e80b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:01:53.880733 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1176/2371] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 15:01:53 2022] DELETE /identity/v3/projects/0ad834bc44a94d92bc6417109617be8c => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:01:53.886270 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f578229d-8b00-4148-a126-b799a3e6a922 service neutron] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:01:53.897375 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f578229d-8b00-4148-a126-b799a3e6a922 service neutron] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:01:53.986429 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1136966d-a929-4e17-b099-1be0872591d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:01:53.987076 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1136966d-a929-4e17-b099-1be0872591d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:53.987356 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1136966d-a929-4e17-b099-1be0872591d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:53.987644 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1136966d-a929-4e17-b099-1be0872591d1 admin admin] PATH_INFO: `/v3/users/373b27dee65943e6ba4db1a570807ba4` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:53.988867 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1136966d-a929-4e17-b099-1be0872591d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=373b27dee65943e6ba4db1a570807ba4)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:01:53.991525 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1136966d-a929-4e17-b099-1be0872591d1 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:01:54.065808 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-1136966d-a929-4e17-b099-1be0872591d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '373b27dee65943e6ba4db1a570807ba4'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:01:54.080160 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-1136966d-a929-4e17-b099-1be0872591d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '373b27dee65943e6ba4db1a570807ba4'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:01:54.081127 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-1136966d-a929-4e17-b099-1be0872591d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '373b27dee65943e6ba4db1a570807ba4'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:01:54.082000 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-1136966d-a929-4e17-b099-1be0872591d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '373b27dee65943e6ba4db1a570807ba4'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:01:54.100117 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-1136966d-a929-4e17-b099-1be0872591d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '373b27dee65943e6ba4db1a570807ba4'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:01:54.116373 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1196/2372] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 15:01:53 2022] DELETE /identity/v3/users/373b27dee65943e6ba4db1a570807ba4 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:01:54.677607 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d4da6b-a5fd-44e2-a5d8-f5c0ec92e80b admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:01:54.680576 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-89d4da6b-a5fd-44e2-a5d8-f5c0ec92e80b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:01:54.706222 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d4da6b-a5fd-44e2-a5d8-f5c0ec92e80b admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:01:54.808024 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ffd697-760f-4358-bc52-92d99a7e10a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:01:54.810074 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ffd697-760f-4358-bc52-92d99a7e10a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:54.810736 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ffd697-760f-4358-bc52-92d99a7e10a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:54.811136 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ffd697-760f-4358-bc52-92d99a7e10a8 admin admin] PATH_INFO: `/v3/projects/b07e4e136c2249f08dacf3b24ee2cf36` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:54.813140 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ffd697-760f-4358-bc52-92d99a7e10a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b07e4e136c2249f08dacf3b24ee2cf36)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:01:54.815755 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ffd697-760f-4358-bc52-92d99a7e10a8 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:01:54.899491 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c7ffd697-760f-4358-bc52-92d99a7e10a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b07e4e136c2249f08dacf3b24ee2cf36', 'request_id': 'req-c7ffd697-760f-4358-bc52-92d99a7e10a8'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:01:54.910435 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c7ffd697-760f-4358-bc52-92d99a7e10a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b07e4e136c2249f08dacf3b24ee2cf36', 'request_id': 'req-c7ffd697-760f-4358-bc52-92d99a7e10a8'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:01:54.925283 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c7ffd697-760f-4358-bc52-92d99a7e10a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b07e4e136c2249f08dacf3b24ee2cf36', 'request_id': 'req-c7ffd697-760f-4358-bc52-92d99a7e10a8'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:01:54.943913 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c7ffd697-760f-4358-bc52-92d99a7e10a8 admin admin] The token cache is being invalidate because project b07e4e136c2249f08dacf3b24ee2cf36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:01:54.944387 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c7ffd697-760f-4358-bc52-92d99a7e10a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:01:54.945508 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c7ffd697-760f-4358-bc52-92d99a7e10a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:01:54.949920 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1177/2373] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 15:01:54 2022] DELETE /identity/v3/projects/b07e4e136c2249f08dacf3b24ee2cf36 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:01:54.957189 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60bd4aa-a9c3-4fdb-b97f-4d2cdb3cda45 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:54.958136 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60bd4aa-a9c3-4fdb-b97f-4d2cdb3cda45 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:54.958336 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60bd4aa-a9c3-4fdb-b97f-4d2cdb3cda45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:54.984511 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-f60bd4aa-a9c3-4fdb-b97f-4d2cdb3cda45 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:01:54.986727 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-f60bd4aa-a9c3-4fdb-b97f-4d2cdb3cda45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:01:55.049473 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:01:55.066013 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1197/2374] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:01:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:01:55.080875 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db5d03-95d7-409b-be98-e914e09e501f None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:55.081327 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db5d03-95d7-409b-be98-e914e09e501f None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:55.081720 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db5d03-95d7-409b-be98-e914e09e501f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:55.110165 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-e0db5d03-95d7-409b-be98-e914e09e501f None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:01:55.111457 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e0db5d03-95d7-409b-be98-e914e09e501f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:01:55.122666 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1178/2375] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:01:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:01:55.128200 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60bd4aa-a9c3-4fdb-b97f-4d2cdb3cda45 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:01:55.140259 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60bd4aa-a9c3-4fdb-b97f-4d2cdb3cda45 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:01:55.146603 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24512643-7cf8-4769-aa0a-559a9c2ea2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:01:55.147775 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24512643-7cf8-4769-aa0a-559a9c2ea2b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:55.148231 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24512643-7cf8-4769-aa0a-559a9c2ea2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:55.148693 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24512643-7cf8-4769-aa0a-559a9c2ea2b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:55.149866 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24512643-7cf8-4769-aa0a-559a9c2ea2b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:01:55.150418 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24512643-7cf8-4769-aa0a-559a9c2ea2b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:01:55.153476 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24512643-7cf8-4769-aa0a-559a9c2ea2b6 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:01:55.173870 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1198/2376] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 19 15:01:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:01:55.180492 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0db5d03-95d7-409b-be98-e914e09e501f None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:01:55.196850 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0db5d03-95d7-409b-be98-e914e09e501f None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:01:55.205753 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f04059-c5bc-4b4b-bbb8-d2931ba7669f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:01:55.206671 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f04059-c5bc-4b4b-bbb8-d2931ba7669f admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:55.207152 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f04059-c5bc-4b4b-bbb8-d2931ba7669f admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:55.207468 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f04059-c5bc-4b4b-bbb8-d2931ba7669f admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:55.208307 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f04059-c5bc-4b4b-bbb8-d2931ba7669f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:01:55.211666 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f04059-c5bc-4b4b-bbb8-d2931ba7669f admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:01:55.263413 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1179/2377] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 15:01:55 2022] POST /identity/v3/projects => generated 379 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:01:55.267232 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24512643-7cf8-4769-aa0a-559a9c2ea2b6 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:01:55.285462 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24512643-7cf8-4769-aa0a-559a9c2ea2b6 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:01:55.377272 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15996552-82f3-45cb-9276-87b70120b32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:01:55.378019 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15996552-82f3-45cb-9276-87b70120b32e admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:55.378466 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15996552-82f3-45cb-9276-87b70120b32e admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:55.378899 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15996552-82f3-45cb-9276-87b70120b32e admin admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:55.379664 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15996552-82f3-45cb-9276-87b70120b32e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:01:55.381842 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15996552-82f3-45cb-9276-87b70120b32e admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:01:55.408569 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1199/2378] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 15:01:55 2022] POST /identity/v3/users => generated 290 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:01:55.413901 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f04059-c5bc-4b4b-bbb8-d2931ba7669f admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:01:55.430456 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f04059-c5bc-4b4b-bbb8-d2931ba7669f admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:01:55.436443 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a27075-6c0d-4b84-99f1-4a5fe307467d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:01:55.437095 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a27075-6c0d-4b84-99f1-4a5fe307467d admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:55.437367 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a27075-6c0d-4b84-99f1-4a5fe307467d admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:55.437632 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a27075-6c0d-4b84-99f1-4a5fe307467d admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:55.438284 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a27075-6c0d-4b84-99f1-4a5fe307467d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:01:55.439902 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a27075-6c0d-4b84-99f1-4a5fe307467d admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:01:55.451491 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1180/2379] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 15:01:55 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:01:55.456611 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15996552-82f3-45cb-9276-87b70120b32e admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:01:55.469146 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15996552-82f3-45cb-9276-87b70120b32e admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:01:55.477129 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca01d29-e784-4846-b975-941543fb25a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:01:55.478064 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca01d29-e784-4846-b975-941543fb25a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:55.478409 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca01d29-e784-4846-b975-941543fb25a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:55.478698 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca01d29-e784-4846-b975-941543fb25a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:55.479624 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca01d29-e784-4846-b975-941543fb25a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:01:55.482730 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca01d29-e784-4846-b975-941543fb25a7 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:01:55.498329 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1200/2380] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 15:01:55 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:01:55.504060 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a27075-6c0d-4b84-99f1-4a5fe307467d admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:01:55.520138 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a27075-6c0d-4b84-99f1-4a5fe307467d admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:01:55.526097 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a78891-1dad-471f-b224-49ef7c762494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:01:55.526943 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a78891-1dad-471f-b224-49ef7c762494 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:55.527314 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a78891-1dad-471f-b224-49ef7c762494 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:55.528002 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a78891-1dad-471f-b224-49ef7c762494 admin admin] PATH_INFO: `/v3/projects/dda535930f6c4e95b6f8adc47d66f844/users/85ac864720cb40808ff1aaee2519d015/roles/74de6794e3b3422b93d26f993d260c35` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:55.547898 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a78891-1dad-471f-b224-49ef7c762494 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dda535930f6c4e95b6f8adc47d66f844, user_id=85ac864720cb40808ff1aaee2519d015, role_id=74de6794e3b3422b93d26f993d260c35)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:01:55.550779 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a78891-1dad-471f-b224-49ef7c762494 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:01:55.572146 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1181/2381] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 15:01:55 2022] PUT /identity/v3/projects/dda535930f6c4e95b6f8adc47d66f844/users/85ac864720cb40808ff1aaee2519d015/roles/74de6794e3b3422b93d26f993d260c35 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:01:55.588781 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02545b9f-7201-4be3-839d-bcd594e45862 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:55.590714 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02545b9f-7201-4be3-839d-bcd594e45862 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:55.590714 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02545b9f-7201-4be3-839d-bcd594e45862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:55.643949 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-02545b9f-7201-4be3-839d-bcd594e45862 None None] MFA Rules not processed for user `85ac864720cb40808ff1aaee2519d015`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:01:55.646035 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-02545b9f-7201-4be3-839d-bcd594e45862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:01:55.754793 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1201/2382] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:01:55 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:01:55.761814 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a78891-1dad-471f-b224-49ef7c762494 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:01:55.778754 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:01:55.856911 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a78891-1dad-471f-b224-49ef7c762494 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:01:55.862474 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8f048c-d865-401f-aa90-c373731fc528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:01:55.863245 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f048c-d865-401f-aa90-c373731fc528 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:55.863624 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f048c-d865-401f-aa90-c373731fc528 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:55.863996 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f048c-d865-401f-aa90-c373731fc528 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:55.864780 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8f048c-d865-401f-aa90-c373731fc528 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:01:55.867078 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8f048c-d865-401f-aa90-c373731fc528 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:01:55.904036 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1182/2383] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 15:01:55 2022] POST /identity/v3/projects => generated 379 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:01:55.910636 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02545b9f-7201-4be3-839d-bcd594e45862 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:01:55.924383 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02545b9f-7201-4be3-839d-bcd594e45862 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:01:55.995337 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:01:56.012283 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a71574-44e5-4b8e-9626-23c6891f61e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:01:56.013066 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a71574-44e5-4b8e-9626-23c6891f61e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:56.013356 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a71574-44e5-4b8e-9626-23c6891f61e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:56.013626 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a71574-44e5-4b8e-9626-23c6891f61e2 admin admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:56.014304 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a71574-44e5-4b8e-9626-23c6891f61e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:01:56.016329 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a71574-44e5-4b8e-9626-23c6891f61e2 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:01:56.046067 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1202/2384] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 15:01:55 2022] POST /identity/v3/users => generated 296 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:01:56.047546 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8f048c-d865-401f-aa90-c373731fc528 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:01:56.060123 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8f048c-d865-401f-aa90-c373731fc528 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:01:56.065684 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4edd0e3-33a4-4b4c-8991-56efc619b7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:01:56.066340 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4edd0e3-33a4-4b4c-8991-56efc619b7ab admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:56.066642 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4edd0e3-33a4-4b4c-8991-56efc619b7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:56.067018 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4edd0e3-33a4-4b4c-8991-56efc619b7ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:56.067689 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4edd0e3-33a4-4b4c-8991-56efc619b7ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:01:56.069535 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4edd0e3-33a4-4b4c-8991-56efc619b7ab admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:01:56.082419 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1183/2385] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 15:01:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:01:56.087814 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a71574-44e5-4b8e-9626-23c6891f61e2 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:01:56.101033 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a71574-44e5-4b8e-9626-23c6891f61e2 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:01:56.106205 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596188b1-0d97-4f90-ba5e-dd38fd5b71bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:01:56.106918 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596188b1-0d97-4f90-ba5e-dd38fd5b71bb admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:56.107199 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596188b1-0d97-4f90-ba5e-dd38fd5b71bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:56.107469 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596188b1-0d97-4f90-ba5e-dd38fd5b71bb admin admin] PATH_INFO: `/v3/projects/eb1c23d5b44f4679a5207a7be6e9f262/users/48002b45e06047fbb05431930292cad7/roles/019bde1756cb40de8ce06cef6b261f79` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:56.125302 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596188b1-0d97-4f90-ba5e-dd38fd5b71bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb1c23d5b44f4679a5207a7be6e9f262, user_id=48002b45e06047fbb05431930292cad7, role_id=019bde1756cb40de8ce06cef6b261f79)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:01:56.128798 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596188b1-0d97-4f90-ba5e-dd38fd5b71bb admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:01:56.152240 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1203/2386] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 15:01:56 2022] PUT /identity/v3/projects/eb1c23d5b44f4679a5207a7be6e9f262/users/48002b45e06047fbb05431930292cad7/roles/019bde1756cb40de8ce06cef6b261f79 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:01:56.159225 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4edd0e3-33a4-4b4c-8991-56efc619b7ab admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:01:56.176875 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4edd0e3-33a4-4b4c-8991-56efc619b7ab admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:01:56.262745 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f3eddb-6f5a-4167-a2f8-d59be97972da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:01:56.263614 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f3eddb-6f5a-4167-a2f8-d59be97972da admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:56.263990 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f3eddb-6f5a-4167-a2f8-d59be97972da admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:56.264356 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f3eddb-6f5a-4167-a2f8-d59be97972da admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:56.265192 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f3eddb-6f5a-4167-a2f8-d59be97972da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:01:56.267077 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f3eddb-6f5a-4167-a2f8-d59be97972da admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:01:56.279055 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1184/2387] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 15:01:56 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 15:01:56.283623 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596188b1-0d97-4f90-ba5e-dd38fd5b71bb admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:01:56.298701 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596188b1-0d97-4f90-ba5e-dd38fd5b71bb admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:01:56.306611 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e8c7b1-c7b2-4e53-9559-8468b6886019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:01:56.307747 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e8c7b1-c7b2-4e53-9559-8468b6886019 admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:56.308223 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e8c7b1-c7b2-4e53-9559-8468b6886019 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:56.308760 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e8c7b1-c7b2-4e53-9559-8468b6886019 admin admin] PATH_INFO: `/v3/projects/eb1c23d5b44f4679a5207a7be6e9f262/users/48002b45e06047fbb05431930292cad7/roles/019bde1756cb40de8ce06cef6b261f79` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:56.312586 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e8c7b1-c7b2-4e53-9559-8468b6886019 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb1c23d5b44f4679a5207a7be6e9f262, user_id=48002b45e06047fbb05431930292cad7, role_id=019bde1756cb40de8ce06cef6b261f79)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:01:56.317944 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e8c7b1-c7b2-4e53-9559-8468b6886019 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:01:56.333616 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1204/2388] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 15:01:56 2022] PUT /identity/v3/projects/eb1c23d5b44f4679a5207a7be6e9f262/users/48002b45e06047fbb05431930292cad7/roles/019bde1756cb40de8ce06cef6b261f79 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:01:56.345489 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ece32bf-36ea-433e-92b2-27949fc02fca None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:56.345857 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ece32bf-36ea-433e-92b2-27949fc02fca None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:56.346030 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ece32bf-36ea-433e-92b2-27949fc02fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:56.378911 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-4ece32bf-36ea-433e-92b2-27949fc02fca None None] MFA Rules not processed for user `48002b45e06047fbb05431930292cad7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:01:56.380236 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-4ece32bf-36ea-433e-92b2-27949fc02fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:01:56.453749 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1185/2389] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:01:56 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:01:56.466173 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e8c7b1-c7b2-4e53-9559-8468b6886019 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:01:56.468067 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-73e8c7b1-c7b2-4e53-9559-8468b6886019 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:01:56.545293 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e8c7b1-c7b2-4e53-9559-8468b6886019 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:01:56.550177 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ebfeac-13bc-445a-a68a-d8302f0553a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df648c909ddb41418128b43f925f5ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:01:56.550824 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ebfeac-13bc-445a-a68a-d8302f0553a8 service cinder] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:56.551100 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ebfeac-13bc-445a-a68a-d8302f0553a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:56.551875 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ebfeac-13bc-445a-a68a-d8302f0553a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:56.638885 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ebfeac-13bc-445a-a68a-d8302f0553a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:01:56.640772 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ebfeac-13bc-445a-a68a-d8302f0553a8 service cinder] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:01:56.658564 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1205/2390] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:01:56 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 15:01:58.218148 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ece32bf-36ea-433e-92b2-27949fc02fca None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:01:58.220350 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-4ece32bf-36ea-433e-92b2-27949fc02fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:01:58.231399 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:01:58.241203 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ece32bf-36ea-433e-92b2-27949fc02fca None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:01:58.247333 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bcc6d1-c82d-4165-968e-405e46f93c64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df648c909ddb41418128b43f925f5ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:01:58.248375 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bcc6d1-c82d-4165-968e-405e46f93c64 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:01:58.248810 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bcc6d1-c82d-4165-968e-405e46f93c64 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:01:58.249303 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bcc6d1-c82d-4165-968e-405e46f93c64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:01:58.265059 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bcc6d1-c82d-4165-968e-405e46f93c64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:01:58.267323 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bcc6d1-c82d-4165-968e-405e46f93c64 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:01:58.285811 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1186/2391] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:01:58 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:02:02.420828 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ebfeac-13bc-445a-a68a-d8302f0553a8 service cinder] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:02.511432 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:02.517695 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ebfeac-13bc-445a-a68a-d8302f0553a8 service cinder] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:02.524508 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6833d58d-b92b-43a9-8ff0-e66e4d10bd18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:02.525652 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6833d58d-b92b-43a9-8ff0-e66e4d10bd18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:02.526139 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6833d58d-b92b-43a9-8ff0-e66e4d10bd18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:02.526619 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6833d58d-b92b-43a9-8ff0-e66e4d10bd18 admin admin] PATH_INFO: `/v3/users/85ac864720cb40808ff1aaee2519d015` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:02.528895 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6833d58d-b92b-43a9-8ff0-e66e4d10bd18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85ac864720cb40808ff1aaee2519d015)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:02.531703 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6833d58d-b92b-43a9-8ff0-e66e4d10bd18 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:02.602926 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-6833d58d-b92b-43a9-8ff0-e66e4d10bd18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85ac864720cb40808ff1aaee2519d015'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:02.615005 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-6833d58d-b92b-43a9-8ff0-e66e4d10bd18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85ac864720cb40808ff1aaee2519d015'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:02.616104 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-6833d58d-b92b-43a9-8ff0-e66e4d10bd18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85ac864720cb40808ff1aaee2519d015'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:02.617255 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-6833d58d-b92b-43a9-8ff0-e66e4d10bd18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85ac864720cb40808ff1aaee2519d015'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:02.637775 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-6833d58d-b92b-43a9-8ff0-e66e4d10bd18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85ac864720cb40808ff1aaee2519d015'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:02.660048 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1206/2392] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 15:02:02 2022] DELETE /identity/v3/users/85ac864720cb40808ff1aaee2519d015 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:02:02.666811 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ea9e0-cf03-4c01-995e-bd87d5f5adc3 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:02.667584 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ea9e0-cf03-4c01-995e-bd87d5f5adc3 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:02.667584 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ea9e0-cf03-4c01-995e-bd87d5f5adc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:02.694947 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-8c1ea9e0-cf03-4c01-995e-bd87d5f5adc3 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:02:02.696946 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-8c1ea9e0-cf03-4c01-995e-bd87d5f5adc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:02.797132 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1187/2393] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:02:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:02:02.810216 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6833d58d-b92b-43a9-8ff0-e66e4d10bd18 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:02.812298 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-6833d58d-b92b-43a9-8ff0-e66e4d10bd18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:02.891324 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6833d58d-b92b-43a9-8ff0-e66e4d10bd18 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:02.896074 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80411516-b0b7-417f-b153-bd1f3a438e42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:02.896684 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80411516-b0b7-417f-b153-bd1f3a438e42 service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:02.896959 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80411516-b0b7-417f-b153-bd1f3a438e42 service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:02.897265 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80411516-b0b7-417f-b153-bd1f3a438e42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:02.907372 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80411516-b0b7-417f-b153-bd1f3a438e42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:02.910504 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80411516-b0b7-417f-b153-bd1f3a438e42 service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:02.925346 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1207/2394] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:02:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:02:03.273917 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1ea9e0-cf03-4c01-995e-bd87d5f5adc3 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:03.276508 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-8c1ea9e0-cf03-4c01-995e-bd87d5f5adc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:03.291479 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1ea9e0-cf03-4c01-995e-bd87d5f5adc3 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:03.299040 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f030b27d-5993-46ec-b516-8a4edfc48990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:03.300039 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f030b27d-5993-46ec-b516-8a4edfc48990 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:03.300474 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f030b27d-5993-46ec-b516-8a4edfc48990 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:03.300903 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f030b27d-5993-46ec-b516-8a4edfc48990 admin admin] PATH_INFO: `/v3/projects/dda535930f6c4e95b6f8adc47d66f844` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:03.302669 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f030b27d-5993-46ec-b516-8a4edfc48990 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dda535930f6c4e95b6f8adc47d66f844)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:03.305395 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f030b27d-5993-46ec-b516-8a4edfc48990 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:03.369490 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f030b27d-5993-46ec-b516-8a4edfc48990 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dda535930f6c4e95b6f8adc47d66f844', 'request_id': 'req-f030b27d-5993-46ec-b516-8a4edfc48990'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:03.376377 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f030b27d-5993-46ec-b516-8a4edfc48990 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dda535930f6c4e95b6f8adc47d66f844', 'request_id': 'req-f030b27d-5993-46ec-b516-8a4edfc48990'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:03.386537 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f030b27d-5993-46ec-b516-8a4edfc48990 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dda535930f6c4e95b6f8adc47d66f844', 'request_id': 'req-f030b27d-5993-46ec-b516-8a4edfc48990'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:03.399140 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f030b27d-5993-46ec-b516-8a4edfc48990 admin admin] The token cache is being invalidate because project dda535930f6c4e95b6f8adc47d66f844 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:02:03.399427 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f030b27d-5993-46ec-b516-8a4edfc48990 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:03.400182 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f030b27d-5993-46ec-b516-8a4edfc48990 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:03.401865 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1188/2395] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 15:02:03 2022] DELETE /identity/v3/projects/dda535930f6c4e95b6f8adc47d66f844 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:02:03.406629 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80411516-b0b7-417f-b153-bd1f3a438e42 service neutron] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:03.417159 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80411516-b0b7-417f-b153-bd1f3a438e42 service neutron] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:03.496131 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bce39c-b7d7-4949-85f2-c41ed4c35bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:03.497204 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bce39c-b7d7-4949-85f2-c41ed4c35bac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:03.497643 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bce39c-b7d7-4949-85f2-c41ed4c35bac admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:03.498144 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bce39c-b7d7-4949-85f2-c41ed4c35bac admin admin] PATH_INFO: `/v3/users/48002b45e06047fbb05431930292cad7` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:03.500033 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bce39c-b7d7-4949-85f2-c41ed4c35bac admin admin] RBAC: Authorizing `identity:delete_user(user_id=48002b45e06047fbb05431930292cad7)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:03.503067 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bce39c-b7d7-4949-85f2-c41ed4c35bac admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:03.538463 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:03.580033 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-a2bce39c-b7d7-4949-85f2-c41ed4c35bac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48002b45e06047fbb05431930292cad7'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:03.597748 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-a2bce39c-b7d7-4949-85f2-c41ed4c35bac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48002b45e06047fbb05431930292cad7'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:03.598491 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-a2bce39c-b7d7-4949-85f2-c41ed4c35bac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48002b45e06047fbb05431930292cad7'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:03.599227 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-a2bce39c-b7d7-4949-85f2-c41ed4c35bac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48002b45e06047fbb05431930292cad7'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:03.616503 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-a2bce39c-b7d7-4949-85f2-c41ed4c35bac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48002b45e06047fbb05431930292cad7'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:03.635092 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1208/2396] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 15:02:03 2022] DELETE /identity/v3/users/48002b45e06047fbb05431930292cad7 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:02:03.998909 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f030b27d-5993-46ec-b516-8a4edfc48990 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:04.001421 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f030b27d-5993-46ec-b516-8a4edfc48990 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:04.021796 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f030b27d-5993-46ec-b516-8a4edfc48990 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:04.114131 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5f9a0b-c808-4d2d-9ecd-374c9a21824e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:04.114821 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f9a0b-c808-4d2d-9ecd-374c9a21824e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:04.115079 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f9a0b-c808-4d2d-9ecd-374c9a21824e admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:04.115353 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f9a0b-c808-4d2d-9ecd-374c9a21824e admin admin] PATH_INFO: `/v3/projects/eb1c23d5b44f4679a5207a7be6e9f262` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:04.116510 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5f9a0b-c808-4d2d-9ecd-374c9a21824e admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb1c23d5b44f4679a5207a7be6e9f262)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:04.118465 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5f9a0b-c808-4d2d-9ecd-374c9a21824e admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:04.142304 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:04.188880 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-7a5f9a0b-c808-4d2d-9ecd-374c9a21824e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb1c23d5b44f4679a5207a7be6e9f262', 'request_id': 'req-7a5f9a0b-c808-4d2d-9ecd-374c9a21824e'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:04.196052 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-7a5f9a0b-c808-4d2d-9ecd-374c9a21824e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb1c23d5b44f4679a5207a7be6e9f262', 'request_id': 'req-7a5f9a0b-c808-4d2d-9ecd-374c9a21824e'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:04.207999 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-7a5f9a0b-c808-4d2d-9ecd-374c9a21824e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb1c23d5b44f4679a5207a7be6e9f262', 'request_id': 'req-7a5f9a0b-c808-4d2d-9ecd-374c9a21824e'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:04.220180 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-7a5f9a0b-c808-4d2d-9ecd-374c9a21824e admin admin] The token cache is being invalidate because project eb1c23d5b44f4679a5207a7be6e9f262 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:02:04.220473 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-7a5f9a0b-c808-4d2d-9ecd-374c9a21824e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:04.221163 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-7a5f9a0b-c808-4d2d-9ecd-374c9a21824e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:04.222704 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1189/2397] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 15:02:03 2022] DELETE /identity/v3/projects/eb1c23d5b44f4679a5207a7be6e9f262 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:02:04.227795 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea2b65-a86e-4fb0-95ba-28b36c52dfee None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:04.228112 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea2b65-a86e-4fb0-95ba-28b36c52dfee None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:04.228456 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea2b65-a86e-4fb0-95ba-28b36c52dfee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:04.251927 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-57ea2b65-a86e-4fb0-95ba-28b36c52dfee None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:02:04.253185 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-57ea2b65-a86e-4fb0-95ba-28b36c52dfee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:04.333862 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1209/2398] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:02:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:02:04.342064 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51706f-bce6-414e-bb72-bef182ac75d3 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:04.342405 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51706f-bce6-414e-bb72-bef182ac75d3 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:04.342605 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51706f-bce6-414e-bb72-bef182ac75d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:04.369012 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-ac51706f-bce6-414e-bb72-bef182ac75d3 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:02:04.370245 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ac51706f-bce6-414e-bb72-bef182ac75d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:04.378640 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1190/2399] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:02:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:02:04.383354 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ea2b65-a86e-4fb0-95ba-28b36c52dfee None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:04.395482 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ea2b65-a86e-4fb0-95ba-28b36c52dfee None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:04.400285 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22c3071-03b9-49fc-818e-4b3f1c358ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:04.400919 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c3071-03b9-49fc-818e-4b3f1c358ad7 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:04.401222 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c3071-03b9-49fc-818e-4b3f1c358ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:04.401494 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c3071-03b9-49fc-818e-4b3f1c358ad7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:04.402144 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22c3071-03b9-49fc-818e-4b3f1c358ad7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:02:04.402468 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22c3071-03b9-49fc-818e-4b3f1c358ad7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:04.404173 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22c3071-03b9-49fc-818e-4b3f1c358ad7 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:04.419975 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1210/2400] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 19 15:02:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 15:02:04.424624 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac51706f-bce6-414e-bb72-bef182ac75d3 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:04.434492 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac51706f-bce6-414e-bb72-bef182ac75d3 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:04.439261 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89edb307-976f-4eff-9403-7b53dac4f141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:04.439900 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89edb307-976f-4eff-9403-7b53dac4f141 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:04.440180 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89edb307-976f-4eff-9403-7b53dac4f141 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:04.440438 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89edb307-976f-4eff-9403-7b53dac4f141 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:04.441173 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89edb307-976f-4eff-9403-7b53dac4f141 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:04.443147 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89edb307-976f-4eff-9403-7b53dac4f141 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:04.473714 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1191/2401] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 15:02:04 2022] POST /identity/v3/projects => generated 387 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 15:02:04.478090 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22c3071-03b9-49fc-818e-4b3f1c358ad7 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:04.488281 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22c3071-03b9-49fc-818e-4b3f1c358ad7 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:04.566790 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5dda0f-6090-4111-95b9-36e928566006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:04.567698 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5dda0f-6090-4111-95b9-36e928566006 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:04.567852 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5dda0f-6090-4111-95b9-36e928566006 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:04.568047 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5dda0f-6090-4111-95b9-36e928566006 admin admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:04.568731 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5dda0f-6090-4111-95b9-36e928566006 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:04.570859 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5dda0f-6090-4111-95b9-36e928566006 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:04.604393 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1211/2402] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 15:02:04 2022] POST /identity/v3/users => generated 294 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:02:04.606431 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89edb307-976f-4eff-9403-7b53dac4f141 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:04.617944 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89edb307-976f-4eff-9403-7b53dac4f141 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:04.624630 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3533fcd1-3bca-49af-ad64-9374ec9ca3bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:04.625388 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3533fcd1-3bca-49af-ad64-9374ec9ca3bd admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:04.625797 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3533fcd1-3bca-49af-ad64-9374ec9ca3bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:04.626186 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3533fcd1-3bca-49af-ad64-9374ec9ca3bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:04.626896 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3533fcd1-3bca-49af-ad64-9374ec9ca3bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:04.628891 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3533fcd1-3bca-49af-ad64-9374ec9ca3bd admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:04.649665 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1192/2403] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 15:02:04 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:02:04.656240 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5dda0f-6090-4111-95b9-36e928566006 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:04.673157 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5dda0f-6090-4111-95b9-36e928566006 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:04.681759 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5a0682-62a1-40a5-bf82-8e4ce5ee296b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:04.682808 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a0682-62a1-40a5-bf82-8e4ce5ee296b admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:04.683377 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a0682-62a1-40a5-bf82-8e4ce5ee296b admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:04.683854 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a0682-62a1-40a5-bf82-8e4ce5ee296b admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:04.685041 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5a0682-62a1-40a5-bf82-8e4ce5ee296b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:04.688166 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5a0682-62a1-40a5-bf82-8e4ce5ee296b admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:04.708634 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1212/2404] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 15:02:04 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:02:04.714095 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3533fcd1-3bca-49af-ad64-9374ec9ca3bd admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:04.728666 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3533fcd1-3bca-49af-ad64-9374ec9ca3bd admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:04.734491 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db652e05-3df6-443e-88f2-198e933155a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:04.735169 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db652e05-3df6-443e-88f2-198e933155a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:04.735453 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db652e05-3df6-443e-88f2-198e933155a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:04.735730 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db652e05-3df6-443e-88f2-198e933155a2 admin admin] PATH_INFO: `/v3/projects/377f1edd544c47429634119489a6a677/users/97027edaf7f5417f9acf7ee153e04494/roles/74de6794e3b3422b93d26f993d260c35` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:04.752222 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db652e05-3df6-443e-88f2-198e933155a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=377f1edd544c47429634119489a6a677, user_id=97027edaf7f5417f9acf7ee153e04494, role_id=74de6794e3b3422b93d26f993d260c35)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:04.754949 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db652e05-3df6-443e-88f2-198e933155a2 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:04.772767 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1193/2405] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 15:02:04 2022] PUT /identity/v3/projects/377f1edd544c47429634119489a6a677/users/97027edaf7f5417f9acf7ee153e04494/roles/74de6794e3b3422b93d26f993d260c35 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:02:04.791015 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825cef38-fdc4-4569-af1f-56f1822d21b4 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:04.791374 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825cef38-fdc4-4569-af1f-56f1822d21b4 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:04.791681 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825cef38-fdc4-4569-af1f-56f1822d21b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:04.800903 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:04.826122 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-825cef38-fdc4-4569-af1f-56f1822d21b4 None None] MFA Rules not processed for user `97027edaf7f5417f9acf7ee153e04494`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:02:04.827366 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-825cef38-fdc4-4569-af1f-56f1822d21b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:04.910168 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1213/2406] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:02:04 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:02:04.915790 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db652e05-3df6-443e-88f2-198e933155a2 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:05.035140 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db652e05-3df6-443e-88f2-198e933155a2 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:05.042942 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4669b93-67ba-4c8d-8732-5e071d895717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:05.044982 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4669b93-67ba-4c8d-8732-5e071d895717 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:05.045470 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4669b93-67ba-4c8d-8732-5e071d895717 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:05.045871 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4669b93-67ba-4c8d-8732-5e071d895717 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:05.046937 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4669b93-67ba-4c8d-8732-5e071d895717 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:05.050449 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4669b93-67ba-4c8d-8732-5e071d895717 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:05.097830 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1194/2407] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 15:02:04 2022] POST /identity/v3/projects => generated 385 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:02:05.103224 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825cef38-fdc4-4569-af1f-56f1822d21b4 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:05.118879 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825cef38-fdc4-4569-af1f-56f1822d21b4 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:05.204358 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1fa1c1-4565-412e-ae29-84dd98a1574f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:05.204807 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1fa1c1-4565-412e-ae29-84dd98a1574f admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:05.204952 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1fa1c1-4565-412e-ae29-84dd98a1574f admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:05.205281 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1fa1c1-4565-412e-ae29-84dd98a1574f admin admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:05.205856 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1fa1c1-4565-412e-ae29-84dd98a1574f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:05.208006 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1fa1c1-4565-412e-ae29-84dd98a1574f admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:05.233982 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1214/2408] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 15:02:05 2022] POST /identity/v3/users => generated 299 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 15:02:05.240245 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4669b93-67ba-4c8d-8732-5e071d895717 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:05.259480 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4669b93-67ba-4c8d-8732-5e071d895717 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:05.270127 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd658e9-40c6-4a44-9829-a9886e7a0ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:05.270994 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd658e9-40c6-4a44-9829-a9886e7a0ba6 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:05.271357 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd658e9-40c6-4a44-9829-a9886e7a0ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:05.271739 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd658e9-40c6-4a44-9829-a9886e7a0ba6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:05.272802 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd658e9-40c6-4a44-9829-a9886e7a0ba6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:05.275816 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd658e9-40c6-4a44-9829-a9886e7a0ba6 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:05.296587 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1195/2409] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 15:02:05 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:02:05.302746 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1fa1c1-4565-412e-ae29-84dd98a1574f admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:05.320075 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1fa1c1-4565-412e-ae29-84dd98a1574f admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:05.325639 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66ec91b-1b8f-45fc-8e77-78eefcb15400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:05.326326 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ec91b-1b8f-45fc-8e77-78eefcb15400 admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:05.326615 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ec91b-1b8f-45fc-8e77-78eefcb15400 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:05.326887 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ec91b-1b8f-45fc-8e77-78eefcb15400 admin admin] PATH_INFO: `/v3/projects/00c5260720624ffaa2b3f2d1ef304a85/users/536136260e0e4d70a8cff47630a89db3/roles/019bde1756cb40de8ce06cef6b261f79` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:05.344670 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66ec91b-1b8f-45fc-8e77-78eefcb15400 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00c5260720624ffaa2b3f2d1ef304a85, user_id=536136260e0e4d70a8cff47630a89db3, role_id=019bde1756cb40de8ce06cef6b261f79)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:05.347635 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66ec91b-1b8f-45fc-8e77-78eefcb15400 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:05.363926 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1215/2410] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 15:02:05 2022] PUT /identity/v3/projects/00c5260720624ffaa2b3f2d1ef304a85/users/536136260e0e4d70a8cff47630a89db3/roles/019bde1756cb40de8ce06cef6b261f79 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:02:05.368600 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd658e9-40c6-4a44-9829-a9886e7a0ba6 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:05.380617 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd658e9-40c6-4a44-9829-a9886e7a0ba6 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:05.391735 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:05.457584 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83ed6f2-60b0-4f8e-af00-c8c148919188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:05.458123 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83ed6f2-60b0-4f8e-af00-c8c148919188 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:05.458432 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83ed6f2-60b0-4f8e-af00-c8c148919188 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:05.458739 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83ed6f2-60b0-4f8e-af00-c8c148919188 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:05.459799 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83ed6f2-60b0-4f8e-af00-c8c148919188 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:05.461509 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83ed6f2-60b0-4f8e-af00-c8c148919188 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:05.473207 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1196/2411] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 15:02:05 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 15:02:05.477829 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66ec91b-1b8f-45fc-8e77-78eefcb15400 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:05.489699 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66ec91b-1b8f-45fc-8e77-78eefcb15400 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:05.495041 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6d85d1-0c3c-4844-a469-e9502edc2ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:05.495779 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d85d1-0c3c-4844-a469-e9502edc2ff9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:05.496734 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d85d1-0c3c-4844-a469-e9502edc2ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:05.497159 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d85d1-0c3c-4844-a469-e9502edc2ff9 admin admin] PATH_INFO: `/v3/projects/00c5260720624ffaa2b3f2d1ef304a85/users/536136260e0e4d70a8cff47630a89db3/roles/019bde1756cb40de8ce06cef6b261f79` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:05.499237 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6d85d1-0c3c-4844-a469-e9502edc2ff9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00c5260720624ffaa2b3f2d1ef304a85, user_id=536136260e0e4d70a8cff47630a89db3, role_id=019bde1756cb40de8ce06cef6b261f79)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:05.501931 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6d85d1-0c3c-4844-a469-e9502edc2ff9 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:05.515010 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1216/2412] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 15:02:05 2022] PUT /identity/v3/projects/00c5260720624ffaa2b3f2d1ef304a85/users/536136260e0e4d70a8cff47630a89db3/roles/019bde1756cb40de8ce06cef6b261f79 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:02:05.526463 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb34b7-713e-4afc-82dd-e49f147e93ce None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:05.526934 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb34b7-713e-4afc-82dd-e49f147e93ce None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:05.527456 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb34b7-713e-4afc-82dd-e49f147e93ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:05.564029 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-44fb34b7-713e-4afc-82dd-e49f147e93ce None None] MFA Rules not processed for user `536136260e0e4d70a8cff47630a89db3`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:02:05.565681 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-44fb34b7-713e-4afc-82dd-e49f147e93ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:05.651834 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1197/2413] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:02:05 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:02:05.664240 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6d85d1-0c3c-4844-a469-e9502edc2ff9 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:05.666510 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-da6d85d1-0c3c-4844-a469-e9502edc2ff9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:05.732558 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:05.745024 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6d85d1-0c3c-4844-a469-e9502edc2ff9 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:05.751195 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b956d40-ee11-4464-b90e-385134a4594d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df648c909ddb41418128b43f925f5ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:05.752200 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b956d40-ee11-4464-b90e-385134a4594d service cinder] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:05.752651 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b956d40-ee11-4464-b90e-385134a4594d service cinder] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:05.753172 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b956d40-ee11-4464-b90e-385134a4594d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:05.766858 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b956d40-ee11-4464-b90e-385134a4594d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:05.769115 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b956d40-ee11-4464-b90e-385134a4594d service cinder] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:05.784406 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1217/2414] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:02:05 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:02:05.867251 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fb34b7-713e-4afc-82dd-e49f147e93ce None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:05.942957 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fb34b7-713e-4afc-82dd-e49f147e93ce None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:05.947903 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2017f19e-80ad-425e-be5a-b3b63c75d6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:05.948551 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2017f19e-80ad-425e-be5a-b3b63c75d6aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:05.948950 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2017f19e-80ad-425e-be5a-b3b63c75d6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:05.949420 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2017f19e-80ad-425e-be5a-b3b63c75d6aa admin admin] PATH_INFO: `/v3/users/97027edaf7f5417f9acf7ee153e04494` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:05.950641 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2017f19e-80ad-425e-be5a-b3b63c75d6aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=97027edaf7f5417f9acf7ee153e04494)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:05.953064 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2017f19e-80ad-425e-be5a-b3b63c75d6aa admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:06.023160 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:06.039961 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2017f19e-80ad-425e-be5a-b3b63c75d6aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97027edaf7f5417f9acf7ee153e04494'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:06.052762 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2017f19e-80ad-425e-be5a-b3b63c75d6aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97027edaf7f5417f9acf7ee153e04494'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:06.053602 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2017f19e-80ad-425e-be5a-b3b63c75d6aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97027edaf7f5417f9acf7ee153e04494'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:06.054444 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2017f19e-80ad-425e-be5a-b3b63c75d6aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97027edaf7f5417f9acf7ee153e04494'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:06.064846 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2017f19e-80ad-425e-be5a-b3b63c75d6aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97027edaf7f5417f9acf7ee153e04494'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:06.093952 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1198/2415] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 15:02:05 2022] DELETE /identity/v3/users/97027edaf7f5417f9acf7ee153e04494 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:02:06.100418 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8feeb75-29c7-44df-96d1-30a832d11dc9 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:06.100720 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8feeb75-29c7-44df-96d1-30a832d11dc9 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:06.100966 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8feeb75-29c7-44df-96d1-30a832d11dc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:06.129302 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-e8feeb75-29c7-44df-96d1-30a832d11dc9 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:02:06.130870 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-e8feeb75-29c7-44df-96d1-30a832d11dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:06.213295 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1218/2416] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:02:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:02:06.227241 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2017f19e-80ad-425e-be5a-b3b63c75d6aa admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:06.228928 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2017f19e-80ad-425e-be5a-b3b63c75d6aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:06.305377 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2017f19e-80ad-425e-be5a-b3b63c75d6aa admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:06.311278 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297d8cc9-0e68-4619-938b-12856d8e97d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:06.312203 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d8cc9-0e68-4619-938b-12856d8e97d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:06.312810 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d8cc9-0e68-4619-938b-12856d8e97d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:06.313325 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d8cc9-0e68-4619-938b-12856d8e97d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:06.327981 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297d8cc9-0e68-4619-938b-12856d8e97d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:06.329492 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297d8cc9-0e68-4619-938b-12856d8e97d5 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:06.340316 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1199/2417] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:02:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:02:06.713724 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8feeb75-29c7-44df-96d1-30a832d11dc9 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:06.717293 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-e8feeb75-29c7-44df-96d1-30a832d11dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:06.741321 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8feeb75-29c7-44df-96d1-30a832d11dc9 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:06.747557 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6469688-ddbe-4485-8af6-17819dc0b4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:06.748807 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6469688-ddbe-4485-8af6-17819dc0b4c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:06.749311 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6469688-ddbe-4485-8af6-17819dc0b4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:06.749779 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6469688-ddbe-4485-8af6-17819dc0b4c1 admin admin] PATH_INFO: `/v3/projects/377f1edd544c47429634119489a6a677` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:06.751491 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6469688-ddbe-4485-8af6-17819dc0b4c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=377f1edd544c47429634119489a6a677)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:06.753723 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6469688-ddbe-4485-8af6-17819dc0b4c1 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:06.821972 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-f6469688-ddbe-4485-8af6-17819dc0b4c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '377f1edd544c47429634119489a6a677', 'request_id': 'req-f6469688-ddbe-4485-8af6-17819dc0b4c1'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:06.834074 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-f6469688-ddbe-4485-8af6-17819dc0b4c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '377f1edd544c47429634119489a6a677', 'request_id': 'req-f6469688-ddbe-4485-8af6-17819dc0b4c1'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:06.852530 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-f6469688-ddbe-4485-8af6-17819dc0b4c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '377f1edd544c47429634119489a6a677', 'request_id': 'req-f6469688-ddbe-4485-8af6-17819dc0b4c1'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:06.870352 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-f6469688-ddbe-4485-8af6-17819dc0b4c1 admin admin] The token cache is being invalidate because project 377f1edd544c47429634119489a6a677 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:02:06.870629 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-f6469688-ddbe-4485-8af6-17819dc0b4c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:06.871546 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-f6469688-ddbe-4485-8af6-17819dc0b4c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:06.873165 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1219/2418] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 15:02:06 2022] DELETE /identity/v3/projects/377f1edd544c47429634119489a6a677 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:02:06.878031 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297d8cc9-0e68-4619-938b-12856d8e97d5 service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:06.893751 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297d8cc9-0e68-4619-938b-12856d8e97d5 service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:06.971816 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19130a0-6c05-4d4e-b43b-93fdaf5f0807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:06.972488 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19130a0-6c05-4d4e-b43b-93fdaf5f0807 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:06.972764 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19130a0-6c05-4d4e-b43b-93fdaf5f0807 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:06.973139 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19130a0-6c05-4d4e-b43b-93fdaf5f0807 admin admin] PATH_INFO: `/v3/users/536136260e0e4d70a8cff47630a89db3` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:06.974783 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19130a0-6c05-4d4e-b43b-93fdaf5f0807 admin admin] RBAC: Authorizing `identity:delete_user(user_id=536136260e0e4d70a8cff47630a89db3)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:06.976958 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19130a0-6c05-4d4e-b43b-93fdaf5f0807 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:07.050811 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c19130a0-6c05-4d4e-b43b-93fdaf5f0807 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '536136260e0e4d70a8cff47630a89db3'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:07.061641 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c19130a0-6c05-4d4e-b43b-93fdaf5f0807 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '536136260e0e4d70a8cff47630a89db3'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:07.062563 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c19130a0-6c05-4d4e-b43b-93fdaf5f0807 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '536136260e0e4d70a8cff47630a89db3'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:07.063581 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c19130a0-6c05-4d4e-b43b-93fdaf5f0807 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '536136260e0e4d70a8cff47630a89db3'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:07.072728 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:07.075537 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c19130a0-6c05-4d4e-b43b-93fdaf5f0807 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '536136260e0e4d70a8cff47630a89db3'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:07.102204 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1200/2419] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 15:02:06 2022] DELETE /identity/v3/users/536136260e0e4d70a8cff47630a89db3 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:02:07.421387 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6469688-ddbe-4485-8af6-17819dc0b4c1 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:07.424049 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-f6469688-ddbe-4485-8af6-17819dc0b4c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:07.442721 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6469688-ddbe-4485-8af6-17819dc0b4c1 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:07.533840 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79acaea-34ea-488e-8a1b-9ad835639f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:07.534897 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79acaea-34ea-488e-8a1b-9ad835639f25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:07.535365 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79acaea-34ea-488e-8a1b-9ad835639f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:07.535830 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79acaea-34ea-488e-8a1b-9ad835639f25 admin admin] PATH_INFO: `/v3/projects/00c5260720624ffaa2b3f2d1ef304a85` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:07.537801 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79acaea-34ea-488e-8a1b-9ad835639f25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00c5260720624ffaa2b3f2d1ef304a85)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:07.541460 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79acaea-34ea-488e-8a1b-9ad835639f25 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:07.567400 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:07.605253 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-a79acaea-34ea-488e-8a1b-9ad835639f25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00c5260720624ffaa2b3f2d1ef304a85', 'request_id': 'req-a79acaea-34ea-488e-8a1b-9ad835639f25'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:07.612409 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-a79acaea-34ea-488e-8a1b-9ad835639f25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00c5260720624ffaa2b3f2d1ef304a85', 'request_id': 'req-a79acaea-34ea-488e-8a1b-9ad835639f25'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:07.622482 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-a79acaea-34ea-488e-8a1b-9ad835639f25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00c5260720624ffaa2b3f2d1ef304a85', 'request_id': 'req-a79acaea-34ea-488e-8a1b-9ad835639f25'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:07.640015 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-a79acaea-34ea-488e-8a1b-9ad835639f25 admin admin] The token cache is being invalidate because project 00c5260720624ffaa2b3f2d1ef304a85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:02:07.640475 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-a79acaea-34ea-488e-8a1b-9ad835639f25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:07.641632 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-a79acaea-34ea-488e-8a1b-9ad835639f25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:07.644190 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1220/2420] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 15:02:07 2022] DELETE /identity/v3/projects/00c5260720624ffaa2b3f2d1ef304a85 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:02:07.651567 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43773856-9a20-4fb6-a09f-f82f3652a901 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:07.651974 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43773856-9a20-4fb6-a09f-f82f3652a901 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:07.652345 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43773856-9a20-4fb6-a09f-f82f3652a901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:07.685210 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-43773856-9a20-4fb6-a09f-f82f3652a901 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:02:07.686723 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-43773856-9a20-4fb6-a09f-f82f3652a901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:07.756211 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1201/2421] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:02:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:02:07.764268 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec0673-260a-4f3e-a7bd-c49ad56469e6 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:07.764887 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec0673-260a-4f3e-a7bd-c49ad56469e6 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:07.764887 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec0673-260a-4f3e-a7bd-c49ad56469e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:07.786807 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-39ec0673-260a-4f3e-a7bd-c49ad56469e6 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:02:07.788049 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-39ec0673-260a-4f3e-a7bd-c49ad56469e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:07.800252 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1221/2422] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:02:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:02:07.807440 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43773856-9a20-4fb6-a09f-f82f3652a901 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:07.825034 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43773856-9a20-4fb6-a09f-f82f3652a901 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:07.833404 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10948e1-c5e3-4277-a724-7f4f2c9fe22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:07.834112 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10948e1-c5e3-4277-a724-7f4f2c9fe22e admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:07.834427 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10948e1-c5e3-4277-a724-7f4f2c9fe22e admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:07.834805 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10948e1-c5e3-4277-a724-7f4f2c9fe22e admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:07.835529 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10948e1-c5e3-4277-a724-7f4f2c9fe22e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:02:07.835861 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10948e1-c5e3-4277-a724-7f4f2c9fe22e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:07.837659 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10948e1-c5e3-4277-a724-7f4f2c9fe22e admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:07.852043 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1202/2423] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 19 15:02:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:02:07.857416 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ec0673-260a-4f3e-a7bd-c49ad56469e6 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:07.871172 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ec0673-260a-4f3e-a7bd-c49ad56469e6 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:07.876375 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5af71f-842e-4c71-95f5-eb1ff71d6c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:07.877023 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5af71f-842e-4c71-95f5-eb1ff71d6c15 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:07.877302 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5af71f-842e-4c71-95f5-eb1ff71d6c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:07.877568 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5af71f-842e-4c71-95f5-eb1ff71d6c15 admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:07.878204 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5af71f-842e-4c71-95f5-eb1ff71d6c15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:07.880119 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5af71f-842e-4c71-95f5-eb1ff71d6c15 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:07.915524 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1222/2424] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 15:02:07 2022] POST /identity/v3/projects => generated 367 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:02:07.920548 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10948e1-c5e3-4277-a724-7f4f2c9fe22e admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:07.933143 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10948e1-c5e3-4277-a724-7f4f2c9fe22e admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:08.017141 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6819f8b2-bc84-48ed-8b3a-7d02947d0f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:08.017756 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6819f8b2-bc84-48ed-8b3a-7d02947d0f27 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:08.018026 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6819f8b2-bc84-48ed-8b3a-7d02947d0f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:08.018289 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6819f8b2-bc84-48ed-8b3a-7d02947d0f27 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:08.018920 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6819f8b2-bc84-48ed-8b3a-7d02947d0f27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:08.020901 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6819f8b2-bc84-48ed-8b3a-7d02947d0f27 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:08.045683 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1203/2425] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 15:02:07 2022] POST /identity/v3/users => generated 284 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:02:08.051051 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5af71f-842e-4c71-95f5-eb1ff71d6c15 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:08.064852 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5af71f-842e-4c71-95f5-eb1ff71d6c15 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:08.072047 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0511c524-56a7-400e-a0c7-eca9f4e406d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:08.073054 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0511c524-56a7-400e-a0c7-eca9f4e406d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:08.073548 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0511c524-56a7-400e-a0c7-eca9f4e406d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:08.074084 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0511c524-56a7-400e-a0c7-eca9f4e406d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:08.075270 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0511c524-56a7-400e-a0c7-eca9f4e406d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:08.077054 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0511c524-56a7-400e-a0c7-eca9f4e406d3 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:08.088505 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1223/2426] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 15:02:08 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:02:08.094240 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6819f8b2-bc84-48ed-8b3a-7d02947d0f27 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:08.113133 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6819f8b2-bc84-48ed-8b3a-7d02947d0f27 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:08.118796 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039817d4-4c4c-49df-8e6d-8b78a3aa9b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:08.119438 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039817d4-4c4c-49df-8e6d-8b78a3aa9b82 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:08.119715 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039817d4-4c4c-49df-8e6d-8b78a3aa9b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:08.119991 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039817d4-4c4c-49df-8e6d-8b78a3aa9b82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:08.121072 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039817d4-4c4c-49df-8e6d-8b78a3aa9b82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:08.122451 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039817d4-4c4c-49df-8e6d-8b78a3aa9b82 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:08.134123 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1204/2427] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 15:02:08 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:02:08.139918 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0511c524-56a7-400e-a0c7-eca9f4e406d3 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:08.158227 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0511c524-56a7-400e-a0c7-eca9f4e406d3 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:08.167199 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f7e3e2-cd4d-45e7-bc02-f0ccb12d7bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:08.168732 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7e3e2-cd4d-45e7-bc02-f0ccb12d7bf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:08.169252 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7e3e2-cd4d-45e7-bc02-f0ccb12d7bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:08.169719 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7e3e2-cd4d-45e7-bc02-f0ccb12d7bf2 admin admin] PATH_INFO: `/v3/projects/12e371816e344747a6a4862357270e0c/users/145df2828cb04aedb77b46f6cb1de467/roles/74de6794e3b3422b93d26f993d260c35` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:08.196013 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f7e3e2-cd4d-45e7-bc02-f0ccb12d7bf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12e371816e344747a6a4862357270e0c, user_id=145df2828cb04aedb77b46f6cb1de467, role_id=74de6794e3b3422b93d26f993d260c35)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:08.201167 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f7e3e2-cd4d-45e7-bc02-f0ccb12d7bf2 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:08.218625 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1224/2428] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 15:02:08 2022] PUT /identity/v3/projects/12e371816e344747a6a4862357270e0c/users/145df2828cb04aedb77b46f6cb1de467/roles/74de6794e3b3422b93d26f993d260c35 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:02:08.231925 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dfdf23-a7e5-4840-ae3f-b80f599dbe7c None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:08.232211 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dfdf23-a7e5-4840-ae3f-b80f599dbe7c None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:08.232486 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dfdf23-a7e5-4840-ae3f-b80f599dbe7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:08.271630 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-d4dfdf23-a7e5-4840-ae3f-b80f599dbe7c None None] MFA Rules not processed for user `145df2828cb04aedb77b46f6cb1de467`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:02:08.273418 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d4dfdf23-a7e5-4840-ae3f-b80f599dbe7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:08.335079 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:08.382687 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1205/2429] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:02:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:02:08.388170 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f7e3e2-cd4d-45e7-bc02-f0ccb12d7bf2 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:08.468253 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f7e3e2-cd4d-45e7-bc02-f0ccb12d7bf2 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:08.473310 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d5db89-7475-4d79-8135-f52fcad52d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:08.473915 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d5db89-7475-4d79-8135-f52fcad52d48 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:08.474187 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d5db89-7475-4d79-8135-f52fcad52d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:08.474453 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d5db89-7475-4d79-8135-f52fcad52d48 admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:08.475259 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d5db89-7475-4d79-8135-f52fcad52d48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:08.477241 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d5db89-7475-4d79-8135-f52fcad52d48 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:08.519112 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1225/2430] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 15:02:08 2022] POST /identity/v3/projects => generated 367 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:02:08.524281 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dfdf23-a7e5-4840-ae3f-b80f599dbe7c None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:08.539989 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dfdf23-a7e5-4840-ae3f-b80f599dbe7c None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:08.623273 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d28e324-f1e2-4b4b-8d3a-797121f52cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:08.624388 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d28e324-f1e2-4b4b-8d3a-797121f52cf8 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:08.624865 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d28e324-f1e2-4b4b-8d3a-797121f52cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:08.625384 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d28e324-f1e2-4b4b-8d3a-797121f52cf8 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:08.626552 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d28e324-f1e2-4b4b-8d3a-797121f52cf8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:08.630292 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d28e324-f1e2-4b4b-8d3a-797121f52cf8 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:08.675529 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1206/2431] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 15:02:08 2022] POST /identity/v3/users => generated 290 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:02:08.677488 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d5db89-7475-4d79-8135-f52fcad52d48 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:08.689290 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d5db89-7475-4d79-8135-f52fcad52d48 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:08.694169 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3b890f-e45a-4361-9eda-42880c76df93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:08.694774 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b890f-e45a-4361-9eda-42880c76df93 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:08.695056 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b890f-e45a-4361-9eda-42880c76df93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:08.695316 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b890f-e45a-4361-9eda-42880c76df93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:08.695960 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3b890f-e45a-4361-9eda-42880c76df93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:08.697586 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3b890f-e45a-4361-9eda-42880c76df93 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:08.709877 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1226/2432] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 15:02:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 15:02:08.716077 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d28e324-f1e2-4b4b-8d3a-797121f52cf8 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:08.726381 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d28e324-f1e2-4b4b-8d3a-797121f52cf8 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:08.731285 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1d6273-d471-4273-9feb-6b0a6c9607a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:08.732096 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1d6273-d471-4273-9feb-6b0a6c9607a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:08.732473 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1d6273-d471-4273-9feb-6b0a6c9607a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:08.732785 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1d6273-d471-4273-9feb-6b0a6c9607a1 admin admin] PATH_INFO: `/v3/projects/91248cbe49fc49488803543385c1ad28/users/2ccc196e07b14155b2955ad773017f66/roles/019bde1756cb40de8ce06cef6b261f79` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:08.752167 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1d6273-d471-4273-9feb-6b0a6c9607a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91248cbe49fc49488803543385c1ad28, user_id=2ccc196e07b14155b2955ad773017f66, role_id=019bde1756cb40de8ce06cef6b261f79)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:08.756100 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1d6273-d471-4273-9feb-6b0a6c9607a1 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:08.771899 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1207/2433] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 15:02:08 2022] PUT /identity/v3/projects/91248cbe49fc49488803543385c1ad28/users/2ccc196e07b14155b2955ad773017f66/roles/019bde1756cb40de8ce06cef6b261f79 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:02:08.778672 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3b890f-e45a-4361-9eda-42880c76df93 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:08.795208 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3b890f-e45a-4361-9eda-42880c76df93 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:08.811927 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:08.875131 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f952fb17-fb0f-4570-b4c1-5f6eb05c123f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:08.875870 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f952fb17-fb0f-4570-b4c1-5f6eb05c123f admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:08.876166 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f952fb17-fb0f-4570-b4c1-5f6eb05c123f admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:08.876467 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f952fb17-fb0f-4570-b4c1-5f6eb05c123f admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:08.877171 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f952fb17-fb0f-4570-b4c1-5f6eb05c123f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:08.878805 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f952fb17-fb0f-4570-b4c1-5f6eb05c123f admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:08.890488 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1227/2434] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 15:02:08 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:02:08.895270 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1d6273-d471-4273-9feb-6b0a6c9607a1 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:08.906249 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1d6273-d471-4273-9feb-6b0a6c9607a1 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:08.911428 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f66970-8f4b-41f6-8e91-00cd0b97262a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:08.912094 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f66970-8f4b-41f6-8e91-00cd0b97262a admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:08.912391 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f66970-8f4b-41f6-8e91-00cd0b97262a admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:08.912629 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f66970-8f4b-41f6-8e91-00cd0b97262a admin admin] PATH_INFO: `/v3/projects/91248cbe49fc49488803543385c1ad28/users/2ccc196e07b14155b2955ad773017f66/roles/019bde1756cb40de8ce06cef6b261f79` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:08.914606 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f66970-8f4b-41f6-8e91-00cd0b97262a admin admin] RBAC: Authorizing `identity:create_grant(project_id=91248cbe49fc49488803543385c1ad28, user_id=2ccc196e07b14155b2955ad773017f66, role_id=019bde1756cb40de8ce06cef6b261f79)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:08.917462 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f66970-8f4b-41f6-8e91-00cd0b97262a admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:08.929567 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1208/2435] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 15:02:08 2022] PUT /identity/v3/projects/91248cbe49fc49488803543385c1ad28/users/2ccc196e07b14155b2955ad773017f66/roles/019bde1756cb40de8ce06cef6b261f79 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:02:08.940340 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c294b96-d300-4c02-ac4b-e470d28e391c None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:08.940626 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c294b96-d300-4c02-ac4b-e470d28e391c None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:08.940906 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c294b96-d300-4c02-ac4b-e470d28e391c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:08.980588 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-8c294b96-d300-4c02-ac4b-e470d28e391c None None] MFA Rules not processed for user `2ccc196e07b14155b2955ad773017f66`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:02:08.982507 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-8c294b96-d300-4c02-ac4b-e470d28e391c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:09.074744 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1228/2436] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:02:08 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:02:09.091879 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f66970-8f4b-41f6-8e91-00cd0b97262a admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:09.093792 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b3f66970-8f4b-41f6-8e91-00cd0b97262a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:09.178679 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f66970-8f4b-41f6-8e91-00cd0b97262a admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:09.183246 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6cb02a-aca3-4615-9fe5-5ee1ca1d2c00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df648c909ddb41418128b43f925f5ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:09.184167 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6cb02a-aca3-4615-9fe5-5ee1ca1d2c00 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:09.184479 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6cb02a-aca3-4615-9fe5-5ee1ca1d2c00 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:09.184823 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6cb02a-aca3-4615-9fe5-5ee1ca1d2c00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:09.195615 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6cb02a-aca3-4615-9fe5-5ee1ca1d2c00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:09.197717 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6cb02a-aca3-4615-9fe5-5ee1ca1d2c00 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:09.216950 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1209/2437] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:02:09 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:02:09.347841 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c294b96-d300-4c02-ac4b-e470d28e391c None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:09.363920 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c294b96-d300-4c02-ac4b-e470d28e391c None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:09.370064 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512f79c9-7ec0-475f-aee7-f495b7c5e596 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df648c909ddb41418128b43f925f5ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:09.370762 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512f79c9-7ec0-475f-aee7-f495b7c5e596 service cinder] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:09.371197 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512f79c9-7ec0-475f-aee7-f495b7c5e596 service cinder] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:09.371383 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512f79c9-7ec0-475f-aee7-f495b7c5e596 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:09.451340 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512f79c9-7ec0-475f-aee7-f495b7c5e596 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:09.453027 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512f79c9-7ec0-475f-aee7-f495b7c5e596 service cinder] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:09.463544 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1229/2438] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:02:09 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:02:14.691613 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6cb02a-aca3-4615-9fe5-5ee1ca1d2c00 service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:14.726310 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:14.764333 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6cb02a-aca3-4615-9fe5-5ee1ca1d2c00 service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:14.769143 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b21d19e-30bc-4a28-9ad0-de8948d3316b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:14.769774 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b21d19e-30bc-4a28-9ad0-de8948d3316b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:14.770046 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b21d19e-30bc-4a28-9ad0-de8948d3316b admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:14.770309 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b21d19e-30bc-4a28-9ad0-de8948d3316b admin admin] PATH_INFO: `/v3/users/145df2828cb04aedb77b46f6cb1de467` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:14.771592 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b21d19e-30bc-4a28-9ad0-de8948d3316b admin admin] RBAC: Authorizing `identity:delete_user(user_id=145df2828cb04aedb77b46f6cb1de467)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:14.773813 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b21d19e-30bc-4a28-9ad0-de8948d3316b admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:14.830643 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-6b21d19e-30bc-4a28-9ad0-de8948d3316b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '145df2828cb04aedb77b46f6cb1de467'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:14.842691 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-6b21d19e-30bc-4a28-9ad0-de8948d3316b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '145df2828cb04aedb77b46f6cb1de467'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:14.843545 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-6b21d19e-30bc-4a28-9ad0-de8948d3316b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '145df2828cb04aedb77b46f6cb1de467'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:14.844355 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-6b21d19e-30bc-4a28-9ad0-de8948d3316b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '145df2828cb04aedb77b46f6cb1de467'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:14.857970 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-6b21d19e-30bc-4a28-9ad0-de8948d3316b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '145df2828cb04aedb77b46f6cb1de467'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:14.880388 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1210/2439] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 15:02:14 2022] DELETE /identity/v3/users/145df2828cb04aedb77b46f6cb1de467 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:02:14.887128 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf8d7e1-67d6-4f5c-8076-ada647bd0189 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:14.888150 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf8d7e1-67d6-4f5c-8076-ada647bd0189 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:14.888150 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf8d7e1-67d6-4f5c-8076-ada647bd0189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:14.909453 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-5bf8d7e1-67d6-4f5c-8076-ada647bd0189 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:02:14.910702 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-5bf8d7e1-67d6-4f5c-8076-ada647bd0189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:14.950279 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:14.989898 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1230/2440] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:02:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:02:15.001509 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b21d19e-30bc-4a28-9ad0-de8948d3316b admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:15.003256 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-6b21d19e-30bc-4a28-9ad0-de8948d3316b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:15.075556 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b21d19e-30bc-4a28-9ad0-de8948d3316b admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:15.079754 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73711fb0-e866-4be2-9446-620bdf450821 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:15.080421 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73711fb0-e866-4be2-9446-620bdf450821 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:15.080743 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73711fb0-e866-4be2-9446-620bdf450821 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:15.081168 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73711fb0-e866-4be2-9446-620bdf450821 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:15.092065 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73711fb0-e866-4be2-9446-620bdf450821 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:15.093575 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73711fb0-e866-4be2-9446-620bdf450821 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:15.104348 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1211/2441] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:02:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:02:15.441536 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf8d7e1-67d6-4f5c-8076-ada647bd0189 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:15.443208 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-5bf8d7e1-67d6-4f5c-8076-ada647bd0189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:15.462879 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf8d7e1-67d6-4f5c-8076-ada647bd0189 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:15.471887 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ca5e05-b795-4e7a-95f9-aa7369d69edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:15.472928 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca5e05-b795-4e7a-95f9-aa7369d69edf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:15.473456 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca5e05-b795-4e7a-95f9-aa7369d69edf admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:15.473919 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca5e05-b795-4e7a-95f9-aa7369d69edf admin admin] PATH_INFO: `/v3/projects/12e371816e344747a6a4862357270e0c` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:15.475849 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ca5e05-b795-4e7a-95f9-aa7369d69edf admin admin] RBAC: Authorizing `identity:delete_project(project_id=12e371816e344747a6a4862357270e0c)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:15.479524 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ca5e05-b795-4e7a-95f9-aa7369d69edf admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:15.533703 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-e2ca5e05-b795-4e7a-95f9-aa7369d69edf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12e371816e344747a6a4862357270e0c', 'request_id': 'req-e2ca5e05-b795-4e7a-95f9-aa7369d69edf'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:15.540445 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-e2ca5e05-b795-4e7a-95f9-aa7369d69edf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12e371816e344747a6a4862357270e0c', 'request_id': 'req-e2ca5e05-b795-4e7a-95f9-aa7369d69edf'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:15.549958 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-e2ca5e05-b795-4e7a-95f9-aa7369d69edf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12e371816e344747a6a4862357270e0c', 'request_id': 'req-e2ca5e05-b795-4e7a-95f9-aa7369d69edf'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:15.563058 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-e2ca5e05-b795-4e7a-95f9-aa7369d69edf admin admin] The token cache is being invalidate because project 12e371816e344747a6a4862357270e0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:02:15.563505 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-e2ca5e05-b795-4e7a-95f9-aa7369d69edf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:15.564320 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-e2ca5e05-b795-4e7a-95f9-aa7369d69edf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:15.566212 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1231/2442] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 15:02:15 2022] DELETE /identity/v3/projects/12e371816e344747a6a4862357270e0c => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:02:15.570625 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73711fb0-e866-4be2-9446-620bdf450821 service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:15.582366 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73711fb0-e866-4be2-9446-620bdf450821 service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:15.634058 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:15.648082 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd1d552-2da6-423f-ae5b-25d4e4276f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:15.648723 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd1d552-2da6-423f-ae5b-25d4e4276f6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:15.649017 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd1d552-2da6-423f-ae5b-25d4e4276f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:15.649301 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd1d552-2da6-423f-ae5b-25d4e4276f6e admin admin] PATH_INFO: `/v3/users/2ccc196e07b14155b2955ad773017f66` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:15.650439 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd1d552-2da6-423f-ae5b-25d4e4276f6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ccc196e07b14155b2955ad773017f66)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:15.652732 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd1d552-2da6-423f-ae5b-25d4e4276f6e admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:15.708113 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-dfd1d552-2da6-423f-ae5b-25d4e4276f6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ccc196e07b14155b2955ad773017f66'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:15.716516 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-dfd1d552-2da6-423f-ae5b-25d4e4276f6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ccc196e07b14155b2955ad773017f66'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:15.717202 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-dfd1d552-2da6-423f-ae5b-25d4e4276f6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ccc196e07b14155b2955ad773017f66'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:15.717810 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-dfd1d552-2da6-423f-ae5b-25d4e4276f6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ccc196e07b14155b2955ad773017f66'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:15.725552 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-dfd1d552-2da6-423f-ae5b-25d4e4276f6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ccc196e07b14155b2955ad773017f66'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:15.746635 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1212/2443] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 15:02:15 2022] DELETE /identity/v3/users/2ccc196e07b14155b2955ad773017f66 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:02:16.153739 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ca5e05-b795-4e7a-95f9-aa7369d69edf admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:16.155467 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-e2ca5e05-b795-4e7a-95f9-aa7369d69edf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:16.174832 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ca5e05-b795-4e7a-95f9-aa7369d69edf admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:16.271976 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8268a9-a79c-4dbe-8093-8350705bd9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:16.273099 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8268a9-a79c-4dbe-8093-8350705bd9d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:16.273570 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8268a9-a79c-4dbe-8093-8350705bd9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:16.274059 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8268a9-a79c-4dbe-8093-8350705bd9d0 admin admin] PATH_INFO: `/v3/projects/91248cbe49fc49488803543385c1ad28` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:16.275936 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8268a9-a79c-4dbe-8093-8350705bd9d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91248cbe49fc49488803543385c1ad28)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:16.278194 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8268a9-a79c-4dbe-8093-8350705bd9d0 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:16.336549 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-8f8268a9-a79c-4dbe-8093-8350705bd9d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91248cbe49fc49488803543385c1ad28', 'request_id': 'req-8f8268a9-a79c-4dbe-8093-8350705bd9d0'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:16.343581 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-8f8268a9-a79c-4dbe-8093-8350705bd9d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91248cbe49fc49488803543385c1ad28', 'request_id': 'req-8f8268a9-a79c-4dbe-8093-8350705bd9d0'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:16.347790 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:16.354548 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-8f8268a9-a79c-4dbe-8093-8350705bd9d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91248cbe49fc49488803543385c1ad28', 'request_id': 'req-8f8268a9-a79c-4dbe-8093-8350705bd9d0'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:16.367788 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-8f8268a9-a79c-4dbe-8093-8350705bd9d0 admin admin] The token cache is being invalidate because project 91248cbe49fc49488803543385c1ad28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:02:16.368069 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-8f8268a9-a79c-4dbe-8093-8350705bd9d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:16.368788 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-8f8268a9-a79c-4dbe-8093-8350705bd9d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:16.370391 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1232/2444] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 15:02:16 2022] DELETE /identity/v3/projects/91248cbe49fc49488803543385c1ad28 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:02:16.375814 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8899d2e-510d-4375-a9dd-0901c922365f None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:16.376115 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8899d2e-510d-4375-a9dd-0901c922365f None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:16.376351 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8899d2e-510d-4375-a9dd-0901c922365f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:16.400926 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-b8899d2e-510d-4375-a9dd-0901c922365f None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:02:16.402795 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b8899d2e-510d-4375-a9dd-0901c922365f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:16.471664 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1213/2445] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:02:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:02:16.481369 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e183351-63e3-4a1f-89b7-8ddec89227cb None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:16.481619 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e183351-63e3-4a1f-89b7-8ddec89227cb None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:16.481911 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e183351-63e3-4a1f-89b7-8ddec89227cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:16.504066 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-5e183351-63e3-4a1f-89b7-8ddec89227cb None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:02:16.505348 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-5e183351-63e3-4a1f-89b7-8ddec89227cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:16.514682 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1233/2446] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:02:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:02:16.519147 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8899d2e-510d-4375-a9dd-0901c922365f None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:16.529544 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8899d2e-510d-4375-a9dd-0901c922365f None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:16.535188 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c644a999-bb90-4401-928c-5d3c3850c9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:16.535823 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c644a999-bb90-4401-928c-5d3c3850c9b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:16.536098 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c644a999-bb90-4401-928c-5d3c3850c9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:16.536368 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c644a999-bb90-4401-928c-5d3c3850c9b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:16.537072 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c644a999-bb90-4401-928c-5d3c3850c9b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:02:16.537380 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c644a999-bb90-4401-928c-5d3c3850c9b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:16.539000 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c644a999-bb90-4401-928c-5d3c3850c9b4 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:16.552328 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1214/2447] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 19 15:02:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:02:16.557671 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e183351-63e3-4a1f-89b7-8ddec89227cb None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:16.567157 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e183351-63e3-4a1f-89b7-8ddec89227cb None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:16.571941 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb1074f-c685-4025-9f02-d3ddbbd0650b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:16.572556 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb1074f-c685-4025-9f02-d3ddbbd0650b admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:16.572845 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb1074f-c685-4025-9f02-d3ddbbd0650b admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:16.573155 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb1074f-c685-4025-9f02-d3ddbbd0650b admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:16.573853 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb1074f-c685-4025-9f02-d3ddbbd0650b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:16.575758 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb1074f-c685-4025-9f02-d3ddbbd0650b admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:16.616764 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1234/2448] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 15:02:16 2022] POST /identity/v3/projects => generated 381 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:02:16.621777 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c644a999-bb90-4401-928c-5d3c3850c9b4 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:16.632933 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c644a999-bb90-4401-928c-5d3c3850c9b4 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:16.704745 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:16.714460 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c845aa1-a709-4d19-a984-7c6cf5e8ab5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:16.715867 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c845aa1-a709-4d19-a984-7c6cf5e8ab5a admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:16.716283 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c845aa1-a709-4d19-a984-7c6cf5e8ab5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:16.716566 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c845aa1-a709-4d19-a984-7c6cf5e8ab5a admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:16.719407 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c845aa1-a709-4d19-a984-7c6cf5e8ab5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:16.719853 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c845aa1-a709-4d19-a984-7c6cf5e8ab5a admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:16.744715 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1215/2449] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 15:02:16 2022] POST /identity/v3/users => generated 291 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 15:02:16.750630 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb1074f-c685-4025-9f02-d3ddbbd0650b admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:16.762842 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb1074f-c685-4025-9f02-d3ddbbd0650b admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:16.769780 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca6bfc6-38d3-4a95-aab0-9019e5674e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:16.770436 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca6bfc6-38d3-4a95-aab0-9019e5674e63 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:16.770753 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca6bfc6-38d3-4a95-aab0-9019e5674e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:16.771057 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca6bfc6-38d3-4a95-aab0-9019e5674e63 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:16.771747 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca6bfc6-38d3-4a95-aab0-9019e5674e63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:16.773498 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca6bfc6-38d3-4a95-aab0-9019e5674e63 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:16.785699 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1235/2450] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 15:02:16 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 15:02:16.790514 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c845aa1-a709-4d19-a984-7c6cf5e8ab5a admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:16.805721 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c845aa1-a709-4d19-a984-7c6cf5e8ab5a admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:16.811735 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56d5a7d-0a19-4959-9eff-326c9ae098aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:16.812388 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56d5a7d-0a19-4959-9eff-326c9ae098aa admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:16.812661 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56d5a7d-0a19-4959-9eff-326c9ae098aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:16.812926 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56d5a7d-0a19-4959-9eff-326c9ae098aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:16.813870 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56d5a7d-0a19-4959-9eff-326c9ae098aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:16.815704 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56d5a7d-0a19-4959-9eff-326c9ae098aa admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:16.828593 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1216/2451] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 15:02:16 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:02:16.834280 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca6bfc6-38d3-4a95-aab0-9019e5674e63 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:16.845681 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca6bfc6-38d3-4a95-aab0-9019e5674e63 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:16.851606 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f180fb-b4d3-4441-bbc2-7059ce7300e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:16.852365 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f180fb-b4d3-4441-bbc2-7059ce7300e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:16.852638 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f180fb-b4d3-4441-bbc2-7059ce7300e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:16.852908 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f180fb-b4d3-4441-bbc2-7059ce7300e5 admin admin] PATH_INFO: `/v3/projects/bb96bc2cf7f549b5a6246a8eb11e92a1/users/028b3bf0a3f64372b289c18a99593057/roles/74de6794e3b3422b93d26f993d260c35` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:16.871167 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f180fb-b4d3-4441-bbc2-7059ce7300e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb96bc2cf7f549b5a6246a8eb11e92a1, user_id=028b3bf0a3f64372b289c18a99593057, role_id=74de6794e3b3422b93d26f993d260c35)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:16.873949 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f180fb-b4d3-4441-bbc2-7059ce7300e5 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:16.897734 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1236/2452] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 15:02:16 2022] PUT /identity/v3/projects/bb96bc2cf7f549b5a6246a8eb11e92a1/users/028b3bf0a3f64372b289c18a99593057/roles/74de6794e3b3422b93d26f993d260c35 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:02:16.909326 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ed07f-666d-4d42-a336-c1647bc94c9f None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:16.909714 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ed07f-666d-4d42-a336-c1647bc94c9f None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:16.910031 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ed07f-666d-4d42-a336-c1647bc94c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:16.943217 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-f55ed07f-666d-4d42-a336-c1647bc94c9f None None] MFA Rules not processed for user `028b3bf0a3f64372b289c18a99593057`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:02:16.944590 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f55ed07f-666d-4d42-a336-c1647bc94c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:17.025957 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1217/2453] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:02:16 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:02:17.031242 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f180fb-b4d3-4441-bbc2-7059ce7300e5 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:17.119839 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f180fb-b4d3-4441-bbc2-7059ce7300e5 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:17.128902 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79edce0b-9c26-4f61-8a74-a5a8799f694f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:17.130286 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79edce0b-9c26-4f61-8a74-a5a8799f694f admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:17.130510 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79edce0b-9c26-4f61-8a74-a5a8799f694f admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:17.130969 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79edce0b-9c26-4f61-8a74-a5a8799f694f admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:17.132197 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79edce0b-9c26-4f61-8a74-a5a8799f694f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:17.135928 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79edce0b-9c26-4f61-8a74-a5a8799f694f admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:17.172148 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1237/2454] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 15:02:17 2022] POST /identity/v3/projects => generated 381 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:02:17.176899 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55ed07f-666d-4d42-a336-c1647bc94c9f None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:17.189400 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55ed07f-666d-4d42-a336-c1647bc94c9f None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:17.266190 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb298c4f-d5ac-4573-922b-7321eba44fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:17.267140 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb298c4f-d5ac-4573-922b-7321eba44fa3 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:17.267517 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb298c4f-d5ac-4573-922b-7321eba44fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:17.267871 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb298c4f-d5ac-4573-922b-7321eba44fa3 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:17.269118 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb298c4f-d5ac-4573-922b-7321eba44fa3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:17.272282 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb298c4f-d5ac-4573-922b-7321eba44fa3 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:17.302364 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1218/2455] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 15:02:17 2022] POST /identity/v3/users => generated 297 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 15:02:17.308054 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79edce0b-9c26-4f61-8a74-a5a8799f694f admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:17.322446 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79edce0b-9c26-4f61-8a74-a5a8799f694f admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:17.330056 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c610502-45e6-4306-8ae9-7c8ddecfe916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:17.330843 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c610502-45e6-4306-8ae9-7c8ddecfe916 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:17.331216 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c610502-45e6-4306-8ae9-7c8ddecfe916 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:17.331620 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c610502-45e6-4306-8ae9-7c8ddecfe916 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:17.332458 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c610502-45e6-4306-8ae9-7c8ddecfe916 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:17.334852 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c610502-45e6-4306-8ae9-7c8ddecfe916 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:17.351456 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1238/2456] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 15:02:17 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:02:17.357192 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb298c4f-d5ac-4573-922b-7321eba44fa3 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:17.368829 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb298c4f-d5ac-4573-922b-7321eba44fa3 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:17.382037 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1c94fe-718f-4edc-ae92-f61ea6e3e565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:17.382783 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c94fe-718f-4edc-ae92-f61ea6e3e565 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:17.383131 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c94fe-718f-4edc-ae92-f61ea6e3e565 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:17.383454 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c94fe-718f-4edc-ae92-f61ea6e3e565 admin admin] PATH_INFO: `/v3/projects/34a56dbdae0f4a4389290a9dad92f6ce/users/58aa3a5fefd7406bb9b21df544062e2b/roles/019bde1756cb40de8ce06cef6b261f79` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:17.404580 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1c94fe-718f-4edc-ae92-f61ea6e3e565 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34a56dbdae0f4a4389290a9dad92f6ce, user_id=58aa3a5fefd7406bb9b21df544062e2b, role_id=019bde1756cb40de8ce06cef6b261f79)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:17.409631 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1c94fe-718f-4edc-ae92-f61ea6e3e565 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:17.432054 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1219/2457] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 15:02:17 2022] PUT /identity/v3/projects/34a56dbdae0f4a4389290a9dad92f6ce/users/58aa3a5fefd7406bb9b21df544062e2b/roles/019bde1756cb40de8ce06cef6b261f79 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:02:17.438311 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c610502-45e6-4306-8ae9-7c8ddecfe916 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:17.455413 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c610502-45e6-4306-8ae9-7c8ddecfe916 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:17.543356 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:17.553275 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692dfcd7-ff95-49f9-bb15-0da5a3700b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:17.554299 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692dfcd7-ff95-49f9-bb15-0da5a3700b8a admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:17.554926 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692dfcd7-ff95-49f9-bb15-0da5a3700b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:17.555620 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692dfcd7-ff95-49f9-bb15-0da5a3700b8a admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:17.556620 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692dfcd7-ff95-49f9-bb15-0da5a3700b8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:17.560853 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692dfcd7-ff95-49f9-bb15-0da5a3700b8a admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:17.579834 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1239/2458] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 15:02:17 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:02:17.586839 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1c94fe-718f-4edc-ae92-f61ea6e3e565 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:17.599346 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1c94fe-718f-4edc-ae92-f61ea6e3e565 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:17.604455 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e853b4-f27d-420f-89ac-9af5bc184956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:17.605977 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e853b4-f27d-420f-89ac-9af5bc184956 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:17.606528 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e853b4-f27d-420f-89ac-9af5bc184956 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:17.606838 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e853b4-f27d-420f-89ac-9af5bc184956 admin admin] PATH_INFO: `/v3/projects/34a56dbdae0f4a4389290a9dad92f6ce/users/58aa3a5fefd7406bb9b21df544062e2b/roles/019bde1756cb40de8ce06cef6b261f79` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:17.609433 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e853b4-f27d-420f-89ac-9af5bc184956 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34a56dbdae0f4a4389290a9dad92f6ce, user_id=58aa3a5fefd7406bb9b21df544062e2b, role_id=019bde1756cb40de8ce06cef6b261f79)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:17.612364 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e853b4-f27d-420f-89ac-9af5bc184956 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:17.625288 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1220/2459] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 15:02:17 2022] PUT /identity/v3/projects/34a56dbdae0f4a4389290a9dad92f6ce/users/58aa3a5fefd7406bb9b21df544062e2b/roles/019bde1756cb40de8ce06cef6b261f79 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:02:17.636857 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b0e2b-b742-4aed-be64-2e21c1d67cbe None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:17.637239 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b0e2b-b742-4aed-be64-2e21c1d67cbe None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:17.637557 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b0e2b-b742-4aed-be64-2e21c1d67cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:17.675888 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-af2b0e2b-b742-4aed-be64-2e21c1d67cbe None None] MFA Rules not processed for user `58aa3a5fefd7406bb9b21df544062e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:02:17.677745 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-af2b0e2b-b742-4aed-be64-2e21c1d67cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:17.789084 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1240/2460] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:02:17 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:02:17.806983 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e853b4-f27d-420f-89ac-9af5bc184956 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:17.810998 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-28e853b4-f27d-420f-89ac-9af5bc184956 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:17.838672 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:17.895737 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e853b4-f27d-420f-89ac-9af5bc184956 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:17.900562 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99666060-d7b3-4722-8f6a-ef7575b28ae1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df648c909ddb41418128b43f925f5ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:17.901438 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99666060-d7b3-4722-8f6a-ef7575b28ae1 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:17.901762 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99666060-d7b3-4722-8f6a-ef7575b28ae1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:17.902182 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99666060-d7b3-4722-8f6a-ef7575b28ae1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:17.915042 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99666060-d7b3-4722-8f6a-ef7575b28ae1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:17.918317 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99666060-d7b3-4722-8f6a-ef7575b28ae1 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:17.935355 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1221/2461] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:02:17 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:02:18.607585 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2b0e2b-b742-4aed-be64-2e21c1d67cbe None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:18.696642 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2b0e2b-b742-4aed-be64-2e21c1d67cbe None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:18.702806 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923164f8-80e1-4b8f-a20d-08bac02e5aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:18.703467 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923164f8-80e1-4b8f-a20d-08bac02e5aa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:18.703752 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923164f8-80e1-4b8f-a20d-08bac02e5aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:18.704041 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923164f8-80e1-4b8f-a20d-08bac02e5aa7 admin admin] PATH_INFO: `/v3/users/028b3bf0a3f64372b289c18a99593057` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:18.705335 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923164f8-80e1-4b8f-a20d-08bac02e5aa7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=028b3bf0a3f64372b289c18a99593057)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:18.707344 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923164f8-80e1-4b8f-a20d-08bac02e5aa7 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:18.767851 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-923164f8-80e1-4b8f-a20d-08bac02e5aa7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '028b3bf0a3f64372b289c18a99593057'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:18.776931 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-923164f8-80e1-4b8f-a20d-08bac02e5aa7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '028b3bf0a3f64372b289c18a99593057'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:18.777612 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-923164f8-80e1-4b8f-a20d-08bac02e5aa7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '028b3bf0a3f64372b289c18a99593057'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:18.778235 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-923164f8-80e1-4b8f-a20d-08bac02e5aa7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '028b3bf0a3f64372b289c18a99593057'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:18.793673 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-923164f8-80e1-4b8f-a20d-08bac02e5aa7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '028b3bf0a3f64372b289c18a99593057'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:18.804630 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:18.810779 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1241/2462] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 15:02:18 2022] DELETE /identity/v3/users/028b3bf0a3f64372b289c18a99593057 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:02:18.816671 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec0409b-2aae-42ea-86f6-2234543e24fb None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:18.817388 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec0409b-2aae-42ea-86f6-2234543e24fb None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:18.817615 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec0409b-2aae-42ea-86f6-2234543e24fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:18.851115 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-8ec0409b-2aae-42ea-86f6-2234543e24fb None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:02:18.852268 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-8ec0409b-2aae-42ea-86f6-2234543e24fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:18.940327 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1222/2463] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:02:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:02:18.954121 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923164f8-80e1-4b8f-a20d-08bac02e5aa7 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:18.956091 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-923164f8-80e1-4b8f-a20d-08bac02e5aa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:19.044072 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923164f8-80e1-4b8f-a20d-08bac02e5aa7 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:19.048696 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2e3618-8748-4bbd-94cc-655b90bdd2be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:19.049522 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e3618-8748-4bbd-94cc-655b90bdd2be service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:19.049890 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e3618-8748-4bbd-94cc-655b90bdd2be service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:19.050219 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e3618-8748-4bbd-94cc-655b90bdd2be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:19.066349 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2e3618-8748-4bbd-94cc-655b90bdd2be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:19.069033 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2e3618-8748-4bbd-94cc-655b90bdd2be service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:19.082760 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1242/2464] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:02:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:02:19.434262 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec0409b-2aae-42ea-86f6-2234543e24fb None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:19.435940 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-8ec0409b-2aae-42ea-86f6-2234543e24fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:19.455695 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec0409b-2aae-42ea-86f6-2234543e24fb None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:19.462849 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabbd7a8-2d85-41b0-9c25-312866e92351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:19.463804 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabbd7a8-2d85-41b0-9c25-312866e92351 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:19.464409 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabbd7a8-2d85-41b0-9c25-312866e92351 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:19.464844 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabbd7a8-2d85-41b0-9c25-312866e92351 admin admin] PATH_INFO: `/v3/projects/bb96bc2cf7f549b5a6246a8eb11e92a1` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:19.466691 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabbd7a8-2d85-41b0-9c25-312866e92351 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb96bc2cf7f549b5a6246a8eb11e92a1)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:19.470941 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabbd7a8-2d85-41b0-9c25-312866e92351 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:19.545612 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-cabbd7a8-2d85-41b0-9c25-312866e92351 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb96bc2cf7f549b5a6246a8eb11e92a1', 'request_id': 'req-cabbd7a8-2d85-41b0-9c25-312866e92351'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:19.553176 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-cabbd7a8-2d85-41b0-9c25-312866e92351 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb96bc2cf7f549b5a6246a8eb11e92a1', 'request_id': 'req-cabbd7a8-2d85-41b0-9c25-312866e92351'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:19.563991 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-cabbd7a8-2d85-41b0-9c25-312866e92351 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb96bc2cf7f549b5a6246a8eb11e92a1', 'request_id': 'req-cabbd7a8-2d85-41b0-9c25-312866e92351'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:19.579983 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-cabbd7a8-2d85-41b0-9c25-312866e92351 admin admin] The token cache is being invalidate because project bb96bc2cf7f549b5a6246a8eb11e92a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:02:19.580300 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-cabbd7a8-2d85-41b0-9c25-312866e92351 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:19.580971 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-cabbd7a8-2d85-41b0-9c25-312866e92351 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:19.582603 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1223/2465] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 15:02:19 2022] DELETE /identity/v3/projects/bb96bc2cf7f549b5a6246a8eb11e92a1 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:02:19.587202 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2e3618-8748-4bbd-94cc-655b90bdd2be service neutron] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:19.598381 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2e3618-8748-4bbd-94cc-655b90bdd2be service neutron] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:19.679064 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921d0621-b936-452a-9f14-d3658d3b4005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:19.680168 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d0621-b936-452a-9f14-d3658d3b4005 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:19.680168 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d0621-b936-452a-9f14-d3658d3b4005 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:19.680489 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d0621-b936-452a-9f14-d3658d3b4005 admin admin] PATH_INFO: `/v3/users/58aa3a5fefd7406bb9b21df544062e2b` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:19.681669 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921d0621-b936-452a-9f14-d3658d3b4005 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58aa3a5fefd7406bb9b21df544062e2b)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:19.684639 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921d0621-b936-452a-9f14-d3658d3b4005 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:19.742793 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-921d0621-b936-452a-9f14-d3658d3b4005 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58aa3a5fefd7406bb9b21df544062e2b'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:19.751458 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-921d0621-b936-452a-9f14-d3658d3b4005 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58aa3a5fefd7406bb9b21df544062e2b'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:19.752226 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-921d0621-b936-452a-9f14-d3658d3b4005 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58aa3a5fefd7406bb9b21df544062e2b'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:19.752925 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-921d0621-b936-452a-9f14-d3658d3b4005 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58aa3a5fefd7406bb9b21df544062e2b'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:19.770014 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-921d0621-b936-452a-9f14-d3658d3b4005 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58aa3a5fefd7406bb9b21df544062e2b'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:19.784512 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1243/2466] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 15:02:19 2022] DELETE /identity/v3/users/58aa3a5fefd7406bb9b21df544062e2b => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:02:20.152073 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabbd7a8-2d85-41b0-9c25-312866e92351 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:20.153914 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-cabbd7a8-2d85-41b0-9c25-312866e92351 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:20.173043 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabbd7a8-2d85-41b0-9c25-312866e92351 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:20.235560 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:20.258028 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11806b0d-0d4c-422c-82f2-51ba48e93161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:20.258578 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11806b0d-0d4c-422c-82f2-51ba48e93161 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:20.258854 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11806b0d-0d4c-422c-82f2-51ba48e93161 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:20.259123 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11806b0d-0d4c-422c-82f2-51ba48e93161 admin admin] PATH_INFO: `/v3/projects/34a56dbdae0f4a4389290a9dad92f6ce` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:20.260295 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11806b0d-0d4c-422c-82f2-51ba48e93161 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34a56dbdae0f4a4389290a9dad92f6ce)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:20.263076 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11806b0d-0d4c-422c-82f2-51ba48e93161 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:20.338599 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-11806b0d-0d4c-422c-82f2-51ba48e93161 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34a56dbdae0f4a4389290a9dad92f6ce', 'request_id': 'req-11806b0d-0d4c-422c-82f2-51ba48e93161'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:20.350572 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-11806b0d-0d4c-422c-82f2-51ba48e93161 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34a56dbdae0f4a4389290a9dad92f6ce', 'request_id': 'req-11806b0d-0d4c-422c-82f2-51ba48e93161'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:20.360567 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-11806b0d-0d4c-422c-82f2-51ba48e93161 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34a56dbdae0f4a4389290a9dad92f6ce', 'request_id': 'req-11806b0d-0d4c-422c-82f2-51ba48e93161'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:20.375226 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-11806b0d-0d4c-422c-82f2-51ba48e93161 admin admin] The token cache is being invalidate because project 34a56dbdae0f4a4389290a9dad92f6ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:02:20.375584 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-11806b0d-0d4c-422c-82f2-51ba48e93161 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:20.376183 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-11806b0d-0d4c-422c-82f2-51ba48e93161 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:02:20.377776 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1224/2467] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 15:02:20 2022] DELETE /identity/v3/projects/34a56dbdae0f4a4389290a9dad92f6ce => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:02:20.383433 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ff3821-2e13-44ff-9452-f7147801b3ed None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:20.383774 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ff3821-2e13-44ff-9452-f7147801b3ed None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:20.384126 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ff3821-2e13-44ff-9452-f7147801b3ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:20.405831 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-b0ff3821-2e13-44ff-9452-f7147801b3ed None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:02:20.407092 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-b0ff3821-2e13-44ff-9452-f7147801b3ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:20.426651 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:20.494893 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1244/2468] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:02:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:02:20.504963 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed35a77-1901-4e06-921a-5b40fbc171ea None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:20.505262 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed35a77-1901-4e06-921a-5b40fbc171ea None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:20.505532 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed35a77-1901-4e06-921a-5b40fbc171ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:20.529530 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-0ed35a77-1901-4e06-921a-5b40fbc171ea None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:02:20.530664 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-0ed35a77-1901-4e06-921a-5b40fbc171ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:20.539339 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1225/2469] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:02:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:02:20.545631 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ff3821-2e13-44ff-9452-f7147801b3ed None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:20.561011 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ff3821-2e13-44ff-9452-f7147801b3ed None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:20.567318 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc03bf35-4189-464e-a3a5-3915a0992bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:20.567939 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc03bf35-4189-464e-a3a5-3915a0992bd7 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:20.568220 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc03bf35-4189-464e-a3a5-3915a0992bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:20.568498 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc03bf35-4189-464e-a3a5-3915a0992bd7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:20.569198 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc03bf35-4189-464e-a3a5-3915a0992bd7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:02:20.569509 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc03bf35-4189-464e-a3a5-3915a0992bd7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:20.571172 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc03bf35-4189-464e-a3a5-3915a0992bd7 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:20.585818 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1245/2470] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 19 15:02:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:02:20.592641 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed35a77-1901-4e06-921a-5b40fbc171ea None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:20.608177 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed35a77-1901-4e06-921a-5b40fbc171ea None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:20.614252 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c6dd74-88f3-44a9-80e0-eece517d60ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:20.614971 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c6dd74-88f3-44a9-80e0-eece517d60ec admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:20.615295 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c6dd74-88f3-44a9-80e0-eece517d60ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:20.615662 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c6dd74-88f3-44a9-80e0-eece517d60ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:20.616490 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c6dd74-88f3-44a9-80e0-eece517d60ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:20.618817 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c6dd74-88f3-44a9-80e0-eece517d60ec admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:20.651867 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1226/2471] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 15:02:20 2022] POST /identity/v3/projects => generated 369 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:02:20.656705 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc03bf35-4189-464e-a3a5-3915a0992bd7 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:20.669416 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc03bf35-4189-464e-a3a5-3915a0992bd7 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:20.749383 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fa5422-ed2f-420e-a36e-3e30189cc1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:20.750235 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa5422-ed2f-420e-a36e-3e30189cc1ed admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:20.750235 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa5422-ed2f-420e-a36e-3e30189cc1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:20.750662 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa5422-ed2f-420e-a36e-3e30189cc1ed admin admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:20.751299 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fa5422-ed2f-420e-a36e-3e30189cc1ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:20.753430 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fa5422-ed2f-420e-a36e-3e30189cc1ed admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:20.782428 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1246/2472] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 15:02:20 2022] POST /identity/v3/users => generated 285 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 15:02:20.787870 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c6dd74-88f3-44a9-80e0-eece517d60ec admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:20.800268 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c6dd74-88f3-44a9-80e0-eece517d60ec admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:20.806093 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62e72af-051e-4d39-a29e-2cb75bc1da9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:20.806738 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e72af-051e-4d39-a29e-2cb75bc1da9f admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:20.807017 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e72af-051e-4d39-a29e-2cb75bc1da9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:20.807285 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e72af-051e-4d39-a29e-2cb75bc1da9f admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:20.808181 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62e72af-051e-4d39-a29e-2cb75bc1da9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:20.810033 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62e72af-051e-4d39-a29e-2cb75bc1da9f admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:20.822271 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1227/2473] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 15:02:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 15:02:20.826836 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fa5422-ed2f-420e-a36e-3e30189cc1ed admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:20.838350 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fa5422-ed2f-420e-a36e-3e30189cc1ed admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:20.843829 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aca27d-96cb-41bc-b99f-b2120aec8225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:20.844488 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aca27d-96cb-41bc-b99f-b2120aec8225 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:20.844800 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aca27d-96cb-41bc-b99f-b2120aec8225 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:20.845130 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aca27d-96cb-41bc-b99f-b2120aec8225 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:20.845804 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aca27d-96cb-41bc-b99f-b2120aec8225 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:20.847433 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aca27d-96cb-41bc-b99f-b2120aec8225 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:20.860580 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1247/2474] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 15:02:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 15:02:20.865063 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62e72af-051e-4d39-a29e-2cb75bc1da9f admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:20.876641 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62e72af-051e-4d39-a29e-2cb75bc1da9f admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:20.882840 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1823d3a8-f02a-477d-806a-c2c010bcb09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:20.883513 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1823d3a8-f02a-477d-806a-c2c010bcb09c admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:20.883914 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1823d3a8-f02a-477d-806a-c2c010bcb09c admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:20.884173 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1823d3a8-f02a-477d-806a-c2c010bcb09c admin admin] PATH_INFO: `/v3/projects/bbae7cdfb9034b6a85a4d4a2ecbc6d90/users/df2163704eab41ef83085faeb4934a4b/roles/74de6794e3b3422b93d26f993d260c35` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:20.902586 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1823d3a8-f02a-477d-806a-c2c010bcb09c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbae7cdfb9034b6a85a4d4a2ecbc6d90, user_id=df2163704eab41ef83085faeb4934a4b, role_id=74de6794e3b3422b93d26f993d260c35)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:20.905652 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1823d3a8-f02a-477d-806a-c2c010bcb09c admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:20.923732 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1228/2475] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 15:02:20 2022] PUT /identity/v3/projects/bbae7cdfb9034b6a85a4d4a2ecbc6d90/users/df2163704eab41ef83085faeb4934a4b/roles/74de6794e3b3422b93d26f993d260c35 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:02:20.931397 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba4fabc-9da7-4999-9840-f0a3009390bb None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:20.931825 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba4fabc-9da7-4999-9840-f0a3009390bb None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:20.932269 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba4fabc-9da7-4999-9840-f0a3009390bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:20.960921 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-5ba4fabc-9da7-4999-9840-f0a3009390bb None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:02:20.962296 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-5ba4fabc-9da7-4999-9840-f0a3009390bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:21.035507 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1248/2476] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:02:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:02:21.045840 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1823d3a8-f02a-477d-806a-c2c010bcb09c admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:21.047780 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-1823d3a8-f02a-477d-806a-c2c010bcb09c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:21.114646 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1823d3a8-f02a-477d-806a-c2c010bcb09c admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:21.118420 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4edf941-7c73-4586-8b71-e0bc653f78d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:21.119042 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4edf941-7c73-4586-8b71-e0bc653f78d7 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:21.119377 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4edf941-7c73-4586-8b71-e0bc653f78d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:21.119645 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4edf941-7c73-4586-8b71-e0bc653f78d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:21.130618 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4edf941-7c73-4586-8b71-e0bc653f78d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:21.132291 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4edf941-7c73-4586-8b71-e0bc653f78d7 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:21.145346 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1229/2477] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:02:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:02:22.039113 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b1db3-74fa-4440-9299-ef45f9f1eea6 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:22.040031 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b1db3-74fa-4440-9299-ef45f9f1eea6 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:22.040212 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b1db3-74fa-4440-9299-ef45f9f1eea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:22.075264 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-b02b1db3-74fa-4440-9299-ef45f9f1eea6 None None] MFA Rules not processed for user `df2163704eab41ef83085faeb4934a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:02:22.076504 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-b02b1db3-74fa-4440-9299-ef45f9f1eea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:22.092854 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:22.193684 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1249/2478] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:02:22 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:02:22.200361 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4edf941-7c73-4586-8b71-e0bc653f78d7 service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:22.218604 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4edf941-7c73-4586-8b71-e0bc653f78d7 service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:22.227114 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3681651e-ce53-4cba-8650-a18a7eb14e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:22.228113 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3681651e-ce53-4cba-8650-a18a7eb14e11 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:22.228569 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3681651e-ce53-4cba-8650-a18a7eb14e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:22.229032 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3681651e-ce53-4cba-8650-a18a7eb14e11 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:22.230273 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3681651e-ce53-4cba-8650-a18a7eb14e11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:22.233873 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3681651e-ce53-4cba-8650-a18a7eb14e11 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:22.251726 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:22.289914 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1230/2479] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 15:02:22 2022] POST /identity/v3/projects => generated 373 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:02:22.296377 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02b1db3-74fa-4440-9299-ef45f9f1eea6 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:22.315757 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02b1db3-74fa-4440-9299-ef45f9f1eea6 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:22.409073 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b2c5f7-37b5-45e6-9b25-da44c9f73bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:22.410099 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b2c5f7-37b5-45e6-9b25-da44c9f73bba admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:22.410564 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b2c5f7-37b5-45e6-9b25-da44c9f73bba admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:22.411010 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b2c5f7-37b5-45e6-9b25-da44c9f73bba admin admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:22.411936 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b2c5f7-37b5-45e6-9b25-da44c9f73bba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:22.414834 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b2c5f7-37b5-45e6-9b25-da44c9f73bba admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:22.451398 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1250/2480] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 15:02:22 2022] POST /identity/v3/users => generated 293 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:02:22.456244 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3681651e-ce53-4cba-8650-a18a7eb14e11 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:22.468334 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3681651e-ce53-4cba-8650-a18a7eb14e11 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:22.474228 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efea6982-e2d9-455b-9253-ce434a1d4613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:22.474940 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea6982-e2d9-455b-9253-ce434a1d4613 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:22.475319 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea6982-e2d9-455b-9253-ce434a1d4613 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:22.475515 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea6982-e2d9-455b-9253-ce434a1d4613 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:22.476232 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efea6982-e2d9-455b-9253-ce434a1d4613 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:22.478058 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efea6982-e2d9-455b-9253-ce434a1d4613 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:22.490086 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1231/2481] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 15:02:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 15:02:22.495313 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b2c5f7-37b5-45e6-9b25-da44c9f73bba admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:22.506561 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b2c5f7-37b5-45e6-9b25-da44c9f73bba admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:22.513411 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bfaf8e-4497-4e95-8bf6-2b96cff1ebcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:22.514143 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bfaf8e-4497-4e95-8bf6-2b96cff1ebcc admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:22.514716 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bfaf8e-4497-4e95-8bf6-2b96cff1ebcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:22.514926 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bfaf8e-4497-4e95-8bf6-2b96cff1ebcc admin admin] PATH_INFO: `/v3/projects/559b39fe970a46bb8f26181f865390c1/users/539b233150814819b848e11803b8e569/roles/019bde1756cb40de8ce06cef6b261f79` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:22.533728 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bfaf8e-4497-4e95-8bf6-2b96cff1ebcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=559b39fe970a46bb8f26181f865390c1, user_id=539b233150814819b848e11803b8e569, role_id=019bde1756cb40de8ce06cef6b261f79)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:22.537269 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bfaf8e-4497-4e95-8bf6-2b96cff1ebcc admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:22.561413 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1251/2482] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 15:02:22 2022] PUT /identity/v3/projects/559b39fe970a46bb8f26181f865390c1/users/539b233150814819b848e11803b8e569/roles/019bde1756cb40de8ce06cef6b261f79 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:02:22.562818 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efea6982-e2d9-455b-9253-ce434a1d4613 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:22.574747 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efea6982-e2d9-455b-9253-ce434a1d4613 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:22.662475 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92893c5-5e9a-411e-83aa-906eb6a54db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:22.663285 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92893c5-5e9a-411e-83aa-906eb6a54db2 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:22.663684 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92893c5-5e9a-411e-83aa-906eb6a54db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:22.664322 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92893c5-5e9a-411e-83aa-906eb6a54db2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:22.665463 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92893c5-5e9a-411e-83aa-906eb6a54db2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:22.669104 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92893c5-5e9a-411e-83aa-906eb6a54db2 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:22.691209 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1232/2483] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 15:02:22 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:02:22.697498 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bfaf8e-4497-4e95-8bf6-2b96cff1ebcc admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:22.717097 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bfaf8e-4497-4e95-8bf6-2b96cff1ebcc admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:22.723811 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e2e77c-eb1c-40a7-9b95-9f07f1b7e1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:22.724566 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e2e77c-eb1c-40a7-9b95-9f07f1b7e1a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:22.724843 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e2e77c-eb1c-40a7-9b95-9f07f1b7e1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:22.725220 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e2e77c-eb1c-40a7-9b95-9f07f1b7e1a7 admin admin] PATH_INFO: `/v3/projects/559b39fe970a46bb8f26181f865390c1/users/539b233150814819b848e11803b8e569/roles/019bde1756cb40de8ce06cef6b261f79` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:22.727698 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e2e77c-eb1c-40a7-9b95-9f07f1b7e1a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=559b39fe970a46bb8f26181f865390c1, user_id=539b233150814819b848e11803b8e569, role_id=019bde1756cb40de8ce06cef6b261f79)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:22.731086 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e2e77c-eb1c-40a7-9b95-9f07f1b7e1a7 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:22.748105 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1252/2484] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 15:02:22 2022] PUT /identity/v3/projects/559b39fe970a46bb8f26181f865390c1/users/539b233150814819b848e11803b8e569/roles/019bde1756cb40de8ce06cef6b261f79 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:02:23.588915 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdba544-bd83-4b60-b611-21d501952484 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:23.590043 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdba544-bd83-4b60-b611-21d501952484 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:23.590295 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdba544-bd83-4b60-b611-21d501952484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:23.630035 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-dfdba544-bd83-4b60-b611-21d501952484 None None] MFA Rules not processed for user `539b233150814819b848e11803b8e569`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:02:23.632378 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-dfdba544-bd83-4b60-b611-21d501952484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:23.742718 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1233/2485] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:02:23 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:02:23.754829 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d6a7b9-1ac4-4d33-a10b-f892947fb335 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:23.755678 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d6a7b9-1ac4-4d33-a10b-f892947fb335 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:23.755678 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d6a7b9-1ac4-4d33-a10b-f892947fb335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:23.785390 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-29d6a7b9-1ac4-4d33-a10b-f892947fb335 None None] MFA Rules not processed for user `df2163704eab41ef83085faeb4934a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:02:23.787469 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-29d6a7b9-1ac4-4d33-a10b-f892947fb335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:23.877404 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1253/2486] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:02:23 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:02:23.902855 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdba544-bd83-4b60-b611-21d501952484 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:23.905934 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-dfdba544-bd83-4b60-b611-21d501952484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:23.994518 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:24.023031 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdba544-bd83-4b60-b611-21d501952484 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:24.029240 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c6a758-c3c8-454f-962a-c850410c190f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3017e5d92bef4cc2aeae4f28c78ba233', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:24.029884 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6a758-c3c8-454f-962a-c850410c190f service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:24.030272 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6a758-c3c8-454f-962a-c850410c190f service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:24.030609 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6a758-c3c8-454f-962a-c850410c190f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:24.040150 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c6a758-c3c8-454f-962a-c850410c190f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:24.041926 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c6a758-c3c8-454f-962a-c850410c190f service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:24.052361 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1234/2487] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:02:23 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:02:33.864385 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=89,keystone:INSERT=5 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:34.047780 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=7 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:42.167016 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d6a7b9-1ac4-4d33-a10b-f892947fb335 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:02:42.172275 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-29d6a7b9-1ac4-4d33-a10b-f892947fb335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:42.259076 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d6a7b9-1ac4-4d33-a10b-f892947fb335 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:02:42.265118 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d754ae0f-6b9e-4bbe-b034-e9f2806498b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df648c909ddb41418128b43f925f5ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:02:42.265962 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d754ae0f-6b9e-4bbe-b034-e9f2806498b8 service cinder] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:42.266244 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d754ae0f-6b9e-4bbe-b034-e9f2806498b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:42.266515 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d754ae0f-6b9e-4bbe-b034-e9f2806498b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:42.282722 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d754ae0f-6b9e-4bbe-b034-e9f2806498b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:02:42.284402 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d754ae0f-6b9e-4bbe-b034-e9f2806498b8 service cinder] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:02:42.296904 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1254/2488] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:02:42 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:02:44.095156 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c243cbcc-49b5-43d5-ada3-0c1ed99a8bb1 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:02:44.095664 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c243cbcc-49b5-43d5-ada3-0c1ed99a8bb1 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:02:44.096073 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c243cbcc-49b5-43d5-ada3-0c1ed99a8bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:02:44.126135 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-c243cbcc-49b5-43d5-ada3-0c1ed99a8bb1 None None] MFA Rules not processed for user `53fe9d2b2e8b4d22acb170b18f697515`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:02:44.127366 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-c243cbcc-49b5-43d5-ada3-0c1ed99a8bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:02:44.204159 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1235/2489] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:02:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:02:52.297922 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=26 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:54.194960 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=25 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:03:03.993068 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb23432b-12a6-4d75-9044-fa2fa858a196 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:03.994370 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb23432b-12a6-4d75-9044-fa2fa858a196 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:03.994370 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb23432b-12a6-4d75-9044-fa2fa858a196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:04.015989 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-cb23432b-12a6-4d75-9044-fa2fa858a196 None None] MFA Rules not processed for user `2c2b1ac1a17c43d28da8f7e9a199dea4`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:03:04.017380 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-cb23432b-12a6-4d75-9044-fa2fa858a196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:04.112671 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1255/2490] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Sep 19 15:03:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:03:04.189288 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c243cbcc-49b5-43d5-ada3-0c1ed99a8bb1 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:04.191709 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-c243cbcc-49b5-43d5-ada3-0c1ed99a8bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:04.303731 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c243cbcc-49b5-43d5-ada3-0c1ed99a8bb1 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:04.310533 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13811196-3aa2-4188-9803-6f2858062608 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cb60a5e90343e69a38db4356cb3a90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:04.311156 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13811196-3aa2-4188-9803-6f2858062608 service swift] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:04.311437 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13811196-3aa2-4188-9803-6f2858062608 service swift] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:04.314179 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13811196-3aa2-4188-9803-6f2858062608 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:04.321508 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13811196-3aa2-4188-9803-6f2858062608 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:04.327011 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13811196-3aa2-4188-9803-6f2858062608 service swift] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:04.340488 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1236/2491] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Sep 19 15:03:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 15:03:05.196327 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb23432b-12a6-4d75-9044-fa2fa858a196 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:05.200647 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-cb23432b-12a6-4d75-9044-fa2fa858a196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:05.459178 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb23432b-12a6-4d75-9044-fa2fa858a196 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:05.471344 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca993d9c-7378-43bb-ac5d-bcf1601358c1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da0a58c526f34afda909e4ede2b1e1c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:05.472737 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca993d9c-7378-43bb-ac5d-bcf1601358c1 service placement] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:05.473326 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca993d9c-7378-43bb-ac5d-bcf1601358c1 service placement] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:05.474585 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca993d9c-7378-43bb-ac5d-bcf1601358c1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:05.478376 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-ca993d9c-7378-43bb-ac5d-bcf1601358c1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:05.504922 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca993d9c-7378-43bb-ac5d-bcf1601358c1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:05.508670 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca993d9c-7378-43bb-ac5d-bcf1601358c1 service placement] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:05.540217 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1256/2492] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:03:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:03:06.561587 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13811196-3aa2-4188-9803-6f2858062608 service swift] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:06.719797 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13811196-3aa2-4188-9803-6f2858062608 service swift] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:06.728894 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606532c4-97f9-4c13-bfc4-165174aec805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:06.730120 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606532c4-97f9-4c13-bfc4-165174aec805 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:06.730594 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606532c4-97f9-4c13-bfc4-165174aec805 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:06.731060 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606532c4-97f9-4c13-bfc4-165174aec805 admin admin] PATH_INFO: `/v3/users/df2163704eab41ef83085faeb4934a4b` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:06.732849 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606532c4-97f9-4c13-bfc4-165174aec805 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df2163704eab41ef83085faeb4934a4b)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:06.735168 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606532c4-97f9-4c13-bfc4-165174aec805 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:06.844840 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-606532c4-97f9-4c13-bfc4-165174aec805 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df2163704eab41ef83085faeb4934a4b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:06.859402 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-606532c4-97f9-4c13-bfc4-165174aec805 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df2163704eab41ef83085faeb4934a4b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:06.861873 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-606532c4-97f9-4c13-bfc4-165174aec805 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df2163704eab41ef83085faeb4934a4b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:06.863780 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-606532c4-97f9-4c13-bfc4-165174aec805 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df2163704eab41ef83085faeb4934a4b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:06.879170 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-606532c4-97f9-4c13-bfc4-165174aec805 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df2163704eab41ef83085faeb4934a4b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:06.916602 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1237/2493] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 15:03:06 2022] DELETE /identity/v3/users/df2163704eab41ef83085faeb4934a4b => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:03:07.253918 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca993d9c-7378-43bb-ac5d-bcf1601358c1 service placement] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:07.288156 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca993d9c-7378-43bb-ac5d-bcf1601358c1 service placement] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:07.468012 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f295ed-64d1-4966-90fb-d524eac4b3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:07.469234 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f295ed-64d1-4966-90fb-d524eac4b3de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:07.469862 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f295ed-64d1-4966-90fb-d524eac4b3de admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:07.471091 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f295ed-64d1-4966-90fb-d524eac4b3de admin admin] PATH_INFO: `/v3/projects/bbae7cdfb9034b6a85a4d4a2ecbc6d90` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:07.473966 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f295ed-64d1-4966-90fb-d524eac4b3de admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbae7cdfb9034b6a85a4d4a2ecbc6d90)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:07.478134 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f295ed-64d1-4966-90fb-d524eac4b3de admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:07.547109 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:03:07.562923 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-e0f295ed-64d1-4966-90fb-d524eac4b3de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbae7cdfb9034b6a85a4d4a2ecbc6d90', 'request_id': 'req-e0f295ed-64d1-4966-90fb-d524eac4b3de'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:07.569471 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-e0f295ed-64d1-4966-90fb-d524eac4b3de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbae7cdfb9034b6a85a4d4a2ecbc6d90', 'request_id': 'req-e0f295ed-64d1-4966-90fb-d524eac4b3de'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:07.589935 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-e0f295ed-64d1-4966-90fb-d524eac4b3de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbae7cdfb9034b6a85a4d4a2ecbc6d90', 'request_id': 'req-e0f295ed-64d1-4966-90fb-d524eac4b3de'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:07.608328 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-e0f295ed-64d1-4966-90fb-d524eac4b3de admin admin] The token cache is being invalidate because project bbae7cdfb9034b6a85a4d4a2ecbc6d90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:03:07.608806 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-e0f295ed-64d1-4966-90fb-d524eac4b3de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:07.612772 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-e0f295ed-64d1-4966-90fb-d524eac4b3de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:07.615629 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1257/2494] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 15:03:07 2022] DELETE /identity/v3/projects/bbae7cdfb9034b6a85a4d4a2ecbc6d90 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:03:07.622003 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606532c4-97f9-4c13-bfc4-165174aec805 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:07.625192 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-606532c4-97f9-4c13-bfc4-165174aec805 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:07.668045 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606532c4-97f9-4c13-bfc4-165174aec805 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:07.677972 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:03:07.779982 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2874dd28-0166-4e55-b7a7-ed5d78af169d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:07.780960 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2874dd28-0166-4e55-b7a7-ed5d78af169d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:07.781461 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2874dd28-0166-4e55-b7a7-ed5d78af169d admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:07.782104 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2874dd28-0166-4e55-b7a7-ed5d78af169d admin admin] PATH_INFO: `/v3/users/539b233150814819b848e11803b8e569` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:07.785867 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2874dd28-0166-4e55-b7a7-ed5d78af169d admin admin] RBAC: Authorizing `identity:delete_user(user_id=539b233150814819b848e11803b8e569)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:07.790218 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2874dd28-0166-4e55-b7a7-ed5d78af169d admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:07.897187 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2874dd28-0166-4e55-b7a7-ed5d78af169d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '539b233150814819b848e11803b8e569'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:07.908120 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2874dd28-0166-4e55-b7a7-ed5d78af169d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '539b233150814819b848e11803b8e569'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:07.909288 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2874dd28-0166-4e55-b7a7-ed5d78af169d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '539b233150814819b848e11803b8e569'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:07.910068 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2874dd28-0166-4e55-b7a7-ed5d78af169d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '539b233150814819b848e11803b8e569'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:07.922587 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2874dd28-0166-4e55-b7a7-ed5d78af169d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '539b233150814819b848e11803b8e569'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:07.950564 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1238/2495] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 15:03:07 2022] DELETE /identity/v3/users/539b233150814819b848e11803b8e569 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:03:08.257414 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f295ed-64d1-4966-90fb-d524eac4b3de admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:08.261256 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-e0f295ed-64d1-4966-90fb-d524eac4b3de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:08.308350 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f295ed-64d1-4966-90fb-d524eac4b3de admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:08.446039 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75bb770-2aaf-403a-9050-8a9a0e7a0b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:08.446938 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75bb770-2aaf-403a-9050-8a9a0e7a0b45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:08.447338 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75bb770-2aaf-403a-9050-8a9a0e7a0b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:08.447988 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75bb770-2aaf-403a-9050-8a9a0e7a0b45 admin admin] PATH_INFO: `/v3/projects/559b39fe970a46bb8f26181f865390c1` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:08.449767 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75bb770-2aaf-403a-9050-8a9a0e7a0b45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=559b39fe970a46bb8f26181f865390c1)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:08.453230 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75bb770-2aaf-403a-9050-8a9a0e7a0b45 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:08.521713 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-d75bb770-2aaf-403a-9050-8a9a0e7a0b45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '559b39fe970a46bb8f26181f865390c1', 'request_id': 'req-d75bb770-2aaf-403a-9050-8a9a0e7a0b45'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:08.540188 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-d75bb770-2aaf-403a-9050-8a9a0e7a0b45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '559b39fe970a46bb8f26181f865390c1', 'request_id': 'req-d75bb770-2aaf-403a-9050-8a9a0e7a0b45'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:08.554981 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-d75bb770-2aaf-403a-9050-8a9a0e7a0b45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '559b39fe970a46bb8f26181f865390c1', 'request_id': 'req-d75bb770-2aaf-403a-9050-8a9a0e7a0b45'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:08.579549 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-d75bb770-2aaf-403a-9050-8a9a0e7a0b45 admin admin] The token cache is being invalidate because project 559b39fe970a46bb8f26181f865390c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:03:08.580064 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-d75bb770-2aaf-403a-9050-8a9a0e7a0b45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:08.580880 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-d75bb770-2aaf-403a-9050-8a9a0e7a0b45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:08.582810 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1258/2496] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 15:03:08 2022] DELETE /identity/v3/projects/559b39fe970a46bb8f26181f865390c1 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:03:08.590807 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56369dc-95b3-46d1-8d3a-39e27ed59c39 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:08.591967 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56369dc-95b3-46d1-8d3a-39e27ed59c39 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:08.591967 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56369dc-95b3-46d1-8d3a-39e27ed59c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:08.620776 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-a56369dc-95b3-46d1-8d3a-39e27ed59c39 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:03:08.622376 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a56369dc-95b3-46d1-8d3a-39e27ed59c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:08.748208 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1239/2497] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:03:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:03:08.761718 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6329994-3020-4a1a-91b3-498c1842147e None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:08.762436 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6329994-3020-4a1a-91b3-498c1842147e None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:08.763025 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6329994-3020-4a1a-91b3-498c1842147e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:08.794719 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-d6329994-3020-4a1a-91b3-498c1842147e None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:03:08.797962 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-d6329994-3020-4a1a-91b3-498c1842147e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:08.815010 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1259/2498] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:03:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:03:08.821468 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56369dc-95b3-46d1-8d3a-39e27ed59c39 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:08.853359 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56369dc-95b3-46d1-8d3a-39e27ed59c39 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:08.861860 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0805d46-4b10-4194-a39e-3b972a4c2cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:08.863165 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0805d46-4b10-4194-a39e-3b972a4c2cad admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:08.863721 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0805d46-4b10-4194-a39e-3b972a4c2cad admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:08.864041 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0805d46-4b10-4194-a39e-3b972a4c2cad admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:08.864734 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0805d46-4b10-4194-a39e-3b972a4c2cad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:03:08.865073 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0805d46-4b10-4194-a39e-3b972a4c2cad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:08.867887 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0805d46-4b10-4194-a39e-3b972a4c2cad admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:08.891706 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1240/2499] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 19 15:03:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:03:08.897597 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6329994-3020-4a1a-91b3-498c1842147e None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:08.912849 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6329994-3020-4a1a-91b3-498c1842147e None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:08.921163 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78a312d-2c20-4b2f-bb27-e2449bb1763d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:08.922121 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a312d-2c20-4b2f-bb27-e2449bb1763d admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:08.922505 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a312d-2c20-4b2f-bb27-e2449bb1763d admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:08.922836 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a312d-2c20-4b2f-bb27-e2449bb1763d admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:08.924437 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78a312d-2c20-4b2f-bb27-e2449bb1763d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:08.926932 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78a312d-2c20-4b2f-bb27-e2449bb1763d admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:08.984842 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1260/2500] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 15:03:08 2022] POST /identity/v3/projects => generated 359 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:03:08.987957 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0805d46-4b10-4194-a39e-3b972a4c2cad admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:09.006209 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0805d46-4b10-4194-a39e-3b972a4c2cad admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:09.036082 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:03:09.119707 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183edaa9-d90f-4445-ace2-cadecfefb1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:09.120568 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183edaa9-d90f-4445-ace2-cadecfefb1bf admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:09.121052 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183edaa9-d90f-4445-ace2-cadecfefb1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:09.121523 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183edaa9-d90f-4445-ace2-cadecfefb1bf admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:09.122502 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183edaa9-d90f-4445-ace2-cadecfefb1bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:09.125794 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183edaa9-d90f-4445-ace2-cadecfefb1bf admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:09.162915 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1241/2501] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 15:03:08 2022] POST /identity/v3/users => generated 280 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 15:03:09.168473 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78a312d-2c20-4b2f-bb27-e2449bb1763d admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:09.184583 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78a312d-2c20-4b2f-bb27-e2449bb1763d admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:09.193105 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97da0e9-9f85-49c2-aa0f-39f6d0bb3135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:09.193105 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97da0e9-9f85-49c2-aa0f-39f6d0bb3135 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:09.193105 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97da0e9-9f85-49c2-aa0f-39f6d0bb3135 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:09.193105 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97da0e9-9f85-49c2-aa0f-39f6d0bb3135 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:09.197835 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97da0e9-9f85-49c2-aa0f-39f6d0bb3135 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:09.197835 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97da0e9-9f85-49c2-aa0f-39f6d0bb3135 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:09.215006 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1261/2502] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 15:03:09 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:03:09.217215 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183edaa9-d90f-4445-ace2-cadecfefb1bf admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:09.236684 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183edaa9-d90f-4445-ace2-cadecfefb1bf admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:09.245628 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297a2357-edbc-462b-b5d8-30057daa939a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:09.246843 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a2357-edbc-462b-b5d8-30057daa939a admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:09.247420 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a2357-edbc-462b-b5d8-30057daa939a admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:09.248111 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a2357-edbc-462b-b5d8-30057daa939a admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:09.249074 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297a2357-edbc-462b-b5d8-30057daa939a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:09.251403 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297a2357-edbc-462b-b5d8-30057daa939a admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:09.264761 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1242/2503] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 15:03:09 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:03:09.271303 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97da0e9-9f85-49c2-aa0f-39f6d0bb3135 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:09.287766 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97da0e9-9f85-49c2-aa0f-39f6d0bb3135 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:09.295083 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752254f6-83fc-419d-acb5-cb53e3574721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:09.296184 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752254f6-83fc-419d-acb5-cb53e3574721 admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:09.296660 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752254f6-83fc-419d-acb5-cb53e3574721 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:09.297150 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752254f6-83fc-419d-acb5-cb53e3574721 admin admin] PATH_INFO: `/v3/projects/c7b91c72f9034f239b2bc7c1b28d2cb0/users/aabbe5073080473181e42be57047d0d8/roles/74de6794e3b3422b93d26f993d260c35` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:09.325116 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:03:09.330940 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752254f6-83fc-419d-acb5-cb53e3574721 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7b91c72f9034f239b2bc7c1b28d2cb0, user_id=aabbe5073080473181e42be57047d0d8, role_id=74de6794e3b3422b93d26f993d260c35)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:09.338217 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752254f6-83fc-419d-acb5-cb53e3574721 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:09.365282 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1262/2504] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 15:03:09 2022] PUT /identity/v3/projects/c7b91c72f9034f239b2bc7c1b28d2cb0/users/aabbe5073080473181e42be57047d0d8/roles/74de6794e3b3422b93d26f993d260c35 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:03:09.381446 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca72caac-d025-49f0-824b-af5eb91d73c7 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:09.381805 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca72caac-d025-49f0-824b-af5eb91d73c7 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:09.382275 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca72caac-d025-49f0-824b-af5eb91d73c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:09.445049 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-ca72caac-d025-49f0-824b-af5eb91d73c7 None None] MFA Rules not processed for user `aabbe5073080473181e42be57047d0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:03:09.447537 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ca72caac-d025-49f0-824b-af5eb91d73c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:09.574238 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1243/2505] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:03:09 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:03:09.634796 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752254f6-83fc-419d-acb5-cb53e3574721 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:09.636461 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-752254f6-83fc-419d-acb5-cb53e3574721 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:09.776084 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752254f6-83fc-419d-acb5-cb53e3574721 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:09.783143 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0f1d2a-3d38-4e52-8136-817c11cb1b30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df648c909ddb41418128b43f925f5ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:09.783993 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0f1d2a-3d38-4e52-8136-817c11cb1b30 service cinder] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:09.784359 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0f1d2a-3d38-4e52-8136-817c11cb1b30 service cinder] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:09.784737 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0f1d2a-3d38-4e52-8136-817c11cb1b30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:09.801203 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0f1d2a-3d38-4e52-8136-817c11cb1b30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:09.804087 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0f1d2a-3d38-4e52-8136-817c11cb1b30 service cinder] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:09.843280 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1263/2506] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:03:09 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 15:03:09.875672 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca72caac-d025-49f0-824b-af5eb91d73c7 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:10.007957 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca72caac-d025-49f0-824b-af5eb91d73c7 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:10.020910 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc7daee-29f6-4e05-a16d-2cf13d3919d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:10.021780 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc7daee-29f6-4e05-a16d-2cf13d3919d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:10.022172 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc7daee-29f6-4e05-a16d-2cf13d3919d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:10.022468 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc7daee-29f6-4e05-a16d-2cf13d3919d7 admin admin] PATH_INFO: `/v3/users/aabbe5073080473181e42be57047d0d8` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:10.026203 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc7daee-29f6-4e05-a16d-2cf13d3919d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aabbe5073080473181e42be57047d0d8)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:10.029325 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc7daee-29f6-4e05-a16d-2cf13d3919d7 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:10.089839 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:03:10.145508 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-6fc7daee-29f6-4e05-a16d-2cf13d3919d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aabbe5073080473181e42be57047d0d8'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:10.163650 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-6fc7daee-29f6-4e05-a16d-2cf13d3919d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aabbe5073080473181e42be57047d0d8'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:10.164706 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-6fc7daee-29f6-4e05-a16d-2cf13d3919d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aabbe5073080473181e42be57047d0d8'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:10.169240 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-6fc7daee-29f6-4e05-a16d-2cf13d3919d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aabbe5073080473181e42be57047d0d8'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:10.195311 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-6fc7daee-29f6-4e05-a16d-2cf13d3919d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aabbe5073080473181e42be57047d0d8'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:10.252978 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1244/2507] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 15:03:09 2022] DELETE /identity/v3/users/aabbe5073080473181e42be57047d0d8 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:03:10.254546 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df41967-ac1a-430c-9818-fd3930042d00 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:10.256885 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df41967-ac1a-430c-9818-fd3930042d00 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:10.256885 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df41967-ac1a-430c-9818-fd3930042d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:10.288827 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-5df41967-ac1a-430c-9818-fd3930042d00 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:03:10.292288 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-5df41967-ac1a-430c-9818-fd3930042d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:10.418076 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1264/2508] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:03:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:03:10.430102 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc7daee-29f6-4e05-a16d-2cf13d3919d7 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:10.432919 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-6fc7daee-29f6-4e05-a16d-2cf13d3919d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:10.578308 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc7daee-29f6-4e05-a16d-2cf13d3919d7 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:10.583443 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f5f173-6ff1-45c0-a39a-443a3949c719 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:10.584311 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f5f173-6ff1-45c0-a39a-443a3949c719 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:10.584846 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f5f173-6ff1-45c0-a39a-443a3949c719 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:10.585451 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f5f173-6ff1-45c0-a39a-443a3949c719 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:10.600556 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f5f173-6ff1-45c0-a39a-443a3949c719 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:10.608220 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f5f173-6ff1-45c0-a39a-443a3949c719 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:10.634714 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1245/2509] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:03:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:03:11.086067 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df41967-ac1a-430c-9818-fd3930042d00 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:11.087854 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-5df41967-ac1a-430c-9818-fd3930042d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:11.126694 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df41967-ac1a-430c-9818-fd3930042d00 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:11.139149 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e46671-b61c-4b00-b35e-ff658a9761f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:11.140275 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e46671-b61c-4b00-b35e-ff658a9761f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:11.140694 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e46671-b61c-4b00-b35e-ff658a9761f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:11.141170 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e46671-b61c-4b00-b35e-ff658a9761f6 admin admin] PATH_INFO: `/v3/projects/c7b91c72f9034f239b2bc7c1b28d2cb0` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:11.142793 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e46671-b61c-4b00-b35e-ff658a9761f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7b91c72f9034f239b2bc7c1b28d2cb0)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:11.146001 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e46671-b61c-4b00-b35e-ff658a9761f6 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:11.257106 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-14e46671-b61c-4b00-b35e-ff658a9761f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7b91c72f9034f239b2bc7c1b28d2cb0', 'request_id': 'req-14e46671-b61c-4b00-b35e-ff658a9761f6'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:11.270069 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-14e46671-b61c-4b00-b35e-ff658a9761f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7b91c72f9034f239b2bc7c1b28d2cb0', 'request_id': 'req-14e46671-b61c-4b00-b35e-ff658a9761f6'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:11.286128 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-14e46671-b61c-4b00-b35e-ff658a9761f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7b91c72f9034f239b2bc7c1b28d2cb0', 'request_id': 'req-14e46671-b61c-4b00-b35e-ff658a9761f6'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:11.320317 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-14e46671-b61c-4b00-b35e-ff658a9761f6 admin admin] The token cache is being invalidate because project c7b91c72f9034f239b2bc7c1b28d2cb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:03:11.321597 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-14e46671-b61c-4b00-b35e-ff658a9761f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:11.321597 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-14e46671-b61c-4b00-b35e-ff658a9761f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:11.329796 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1265/2510] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 15:03:11 2022] DELETE /identity/v3/projects/c7b91c72f9034f239b2bc7c1b28d2cb0 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:03:11.338385 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0068fea-a036-4c86-823c-c611ad25051c None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:11.338974 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0068fea-a036-4c86-823c-c611ad25051c None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:11.339317 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0068fea-a036-4c86-823c-c611ad25051c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:11.375043 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-d0068fea-a036-4c86-823c-c611ad25051c None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:03:11.376835 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d0068fea-a036-4c86-823c-c611ad25051c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:11.520249 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1246/2511] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:03:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:03:11.530682 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b6d871-8844-4e7f-a082-ed69ce40b83d None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:11.531198 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b6d871-8844-4e7f-a082-ed69ce40b83d None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:11.531602 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b6d871-8844-4e7f-a082-ed69ce40b83d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:11.565776 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-a4b6d871-8844-4e7f-a082-ed69ce40b83d None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:03:11.568821 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-a4b6d871-8844-4e7f-a082-ed69ce40b83d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:11.584769 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1266/2512] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:03:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:03:11.592943 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0068fea-a036-4c86-823c-c611ad25051c None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:11.611895 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0068fea-a036-4c86-823c-c611ad25051c None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:11.619371 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a90a6b-fe90-4017-90d9-0df437825d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:11.620460 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a90a6b-fe90-4017-90d9-0df437825d15 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:11.620928 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a90a6b-fe90-4017-90d9-0df437825d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:11.621360 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a90a6b-fe90-4017-90d9-0df437825d15 admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:11.622235 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a90a6b-fe90-4017-90d9-0df437825d15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:03:11.622744 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a90a6b-fe90-4017-90d9-0df437825d15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:11.624513 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a90a6b-fe90-4017-90d9-0df437825d15 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:11.665535 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1247/2513] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 19 15:03:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 15:03:11.670018 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b6d871-8844-4e7f-a082-ed69ce40b83d None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:11.688980 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b6d871-8844-4e7f-a082-ed69ce40b83d None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:11.699042 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c341b37-b8de-4162-83e0-d0bd166d33fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:11.700128 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c341b37-b8de-4162-83e0-d0bd166d33fc admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:11.700672 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c341b37-b8de-4162-83e0-d0bd166d33fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:11.701581 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c341b37-b8de-4162-83e0-d0bd166d33fc admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:11.702796 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c341b37-b8de-4162-83e0-d0bd166d33fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:11.706453 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c341b37-b8de-4162-83e0-d0bd166d33fc admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:11.723650 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:03:11.762651 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1267/2514] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 15:03:11 2022] POST /identity/v3/projects => generated 383 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:03:11.764095 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a90a6b-fe90-4017-90d9-0df437825d15 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:11.777312 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a90a6b-fe90-4017-90d9-0df437825d15 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:11.841259 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:03:11.890476 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa22078-644c-4865-8e31-d75e98859e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:11.891646 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa22078-644c-4865-8e31-d75e98859e4f admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:11.892252 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa22078-644c-4865-8e31-d75e98859e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:11.892845 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa22078-644c-4865-8e31-d75e98859e4f admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:11.894129 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa22078-644c-4865-8e31-d75e98859e4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:11.898002 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa22078-644c-4865-8e31-d75e98859e4f admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:11.943064 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1248/2515] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 15:03:11 2022] POST /identity/v3/users => generated 292 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:03:11.947761 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c341b37-b8de-4162-83e0-d0bd166d33fc admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:11.960891 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c341b37-b8de-4162-83e0-d0bd166d33fc admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:11.972014 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b834383-5d2e-40f2-b64f-6821a9d23851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:11.972649 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b834383-5d2e-40f2-b64f-6821a9d23851 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:11.972927 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b834383-5d2e-40f2-b64f-6821a9d23851 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:11.973229 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b834383-5d2e-40f2-b64f-6821a9d23851 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:11.973919 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b834383-5d2e-40f2-b64f-6821a9d23851 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:11.975641 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b834383-5d2e-40f2-b64f-6821a9d23851 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:12.012300 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1268/2516] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 15:03:11 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 15:03:12.013362 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa22078-644c-4865-8e31-d75e98859e4f admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:12.027442 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa22078-644c-4865-8e31-d75e98859e4f admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:12.033079 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a15ebce-1a6d-4c66-8b36-cddf58e3e136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:12.033714 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a15ebce-1a6d-4c66-8b36-cddf58e3e136 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:12.033987 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a15ebce-1a6d-4c66-8b36-cddf58e3e136 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:12.034298 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a15ebce-1a6d-4c66-8b36-cddf58e3e136 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:12.034928 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a15ebce-1a6d-4c66-8b36-cddf58e3e136 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:12.037970 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a15ebce-1a6d-4c66-8b36-cddf58e3e136 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:12.059464 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1249/2517] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 15:03:12 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 15:03:12.064672 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b834383-5d2e-40f2-b64f-6821a9d23851 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:12.077911 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b834383-5d2e-40f2-b64f-6821a9d23851 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:12.083550 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a991c7-7d2c-4505-a05e-83263fd8ca49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:12.084536 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a991c7-7d2c-4505-a05e-83263fd8ca49 admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:12.084984 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a991c7-7d2c-4505-a05e-83263fd8ca49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:12.085303 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a991c7-7d2c-4505-a05e-83263fd8ca49 admin admin] PATH_INFO: `/v3/projects/613afb1244e2452d9d4e22830fa7ca5a/users/b525dc72432c493ca134b39bd3bc3678/roles/74de6794e3b3422b93d26f993d260c35` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:12.117853 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a991c7-7d2c-4505-a05e-83263fd8ca49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=613afb1244e2452d9d4e22830fa7ca5a, user_id=b525dc72432c493ca134b39bd3bc3678, role_id=74de6794e3b3422b93d26f993d260c35)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:12.131113 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a991c7-7d2c-4505-a05e-83263fd8ca49 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:12.195094 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1269/2518] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 15:03:12 2022] PUT /identity/v3/projects/613afb1244e2452d9d4e22830fa7ca5a/users/b525dc72432c493ca134b39bd3bc3678/roles/74de6794e3b3422b93d26f993d260c35 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:03:12.204366 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef919c07-1eed-4c34-82fb-be097124e50f None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:12.204821 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef919c07-1eed-4c34-82fb-be097124e50f None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:12.205337 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef919c07-1eed-4c34-82fb-be097124e50f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:12.234086 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-ef919c07-1eed-4c34-82fb-be097124e50f None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:03:12.235528 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ef919c07-1eed-4c34-82fb-be097124e50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:12.344784 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1250/2519] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:03:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:03:12.359804 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a991c7-7d2c-4505-a05e-83263fd8ca49 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:12.362537 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-c8a991c7-7d2c-4505-a05e-83263fd8ca49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:12.447038 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a991c7-7d2c-4505-a05e-83263fd8ca49 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:12.454990 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d276828a-78c8-4026-803c-ced8040ce701 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:12.456019 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d276828a-78c8-4026-803c-ced8040ce701 service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:12.456481 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d276828a-78c8-4026-803c-ced8040ce701 service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:12.456958 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d276828a-78c8-4026-803c-ced8040ce701 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:12.474361 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d276828a-78c8-4026-803c-ced8040ce701 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:12.477820 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d276828a-78c8-4026-803c-ced8040ce701 service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:12.499695 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1270/2520] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:03:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:03:19.588749 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef919c07-1eed-4c34-82fb-be097124e50f None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:19.590935 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ef919c07-1eed-4c34-82fb-be097124e50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:19.694067 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef919c07-1eed-4c34-82fb-be097124e50f None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:19.724089 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f40fc8-9f6e-47d2-8527-c1edd7c82e10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:19.726485 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f40fc8-9f6e-47d2-8527-c1edd7c82e10 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:19.727582 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f40fc8-9f6e-47d2-8527-c1edd7c82e10 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:19.730279 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f40fc8-9f6e-47d2-8527-c1edd7c82e10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:19.735809 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-98f40fc8-9f6e-47d2-8527-c1edd7c82e10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:19.887415 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f40fc8-9f6e-47d2-8527-c1edd7c82e10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:19.889592 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f40fc8-9f6e-47d2-8527-c1edd7c82e10 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:19.917810 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1251/2521] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:03:19 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:03:20.472749 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17381877-531e-4ee7-a360-a10939fb3fa1 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:20.474281 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17381877-531e-4ee7-a360-a10939fb3fa1 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:20.474944 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17381877-531e-4ee7-a360-a10939fb3fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:20.575323 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-17381877-531e-4ee7-a360-a10939fb3fa1 None None] MFA Rules not processed for user `b525dc72432c493ca134b39bd3bc3678`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:03:20.578361 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-17381877-531e-4ee7-a360-a10939fb3fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:20.748562 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1271/2522] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:03:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:03:20.754156 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f40fc8-9f6e-47d2-8527-c1edd7c82e10 service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:20.776707 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:03:20.845858 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f40fc8-9f6e-47d2-8527-c1edd7c82e10 service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:20.861444 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fb8c6c-33fa-49d9-8f1f-49808669bb1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:20.862358 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fb8c6c-33fa-49d9-8f1f-49808669bb1b admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:20.862769 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fb8c6c-33fa-49d9-8f1f-49808669bb1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:20.863172 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fb8c6c-33fa-49d9-8f1f-49808669bb1b admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:20.864144 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fb8c6c-33fa-49d9-8f1f-49808669bb1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:20.871697 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fb8c6c-33fa-49d9-8f1f-49808669bb1b admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:20.974891 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1252/2523] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 15:03:20 2022] POST /identity/v3/projects => generated 383 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:03:20.980185 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17381877-531e-4ee7-a360-a10939fb3fa1 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:20.992336 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17381877-531e-4ee7-a360-a10939fb3fa1 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:21.071335 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:03:21.092479 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47508ce-d260-4836-8570-ceb3474fda98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:21.093753 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47508ce-d260-4836-8570-ceb3474fda98 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:21.094184 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47508ce-d260-4836-8570-ceb3474fda98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:21.094782 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47508ce-d260-4836-8570-ceb3474fda98 admin admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:21.095877 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47508ce-d260-4836-8570-ceb3474fda98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:21.099174 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47508ce-d260-4836-8570-ceb3474fda98 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:21.139675 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1272/2524] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 15:03:20 2022] POST /identity/v3/users => generated 298 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:03:21.141233 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fb8c6c-33fa-49d9-8f1f-49808669bb1b admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:21.165451 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fb8c6c-33fa-49d9-8f1f-49808669bb1b admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:21.170893 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcab6fcc-7ec5-4bd7-9329-b7c91539a26f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:21.171545 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcab6fcc-7ec5-4bd7-9329-b7c91539a26f admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:21.171827 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcab6fcc-7ec5-4bd7-9329-b7c91539a26f admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:21.172102 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcab6fcc-7ec5-4bd7-9329-b7c91539a26f admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:21.172759 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcab6fcc-7ec5-4bd7-9329-b7c91539a26f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:21.174464 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcab6fcc-7ec5-4bd7-9329-b7c91539a26f admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:21.190937 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1253/2525] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 15:03:21 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:03:21.197963 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47508ce-d260-4836-8570-ceb3474fda98 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:21.239918 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47508ce-d260-4836-8570-ceb3474fda98 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:21.248115 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef239a3d-e9d6-43c9-8abd-6adea0f4c599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:21.249102 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef239a3d-e9d6-43c9-8abd-6adea0f4c599 admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:21.249516 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef239a3d-e9d6-43c9-8abd-6adea0f4c599 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:21.249946 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef239a3d-e9d6-43c9-8abd-6adea0f4c599 admin admin] PATH_INFO: `/v3/projects/bb5d2facca734c24877a6c27a1b81747/users/4a65f455457a42f980c8ec4efec2d203/roles/019bde1756cb40de8ce06cef6b261f79` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:21.282244 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef239a3d-e9d6-43c9-8abd-6adea0f4c599 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb5d2facca734c24877a6c27a1b81747, user_id=4a65f455457a42f980c8ec4efec2d203, role_id=019bde1756cb40de8ce06cef6b261f79)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:21.288043 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef239a3d-e9d6-43c9-8abd-6adea0f4c599 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:21.315154 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1273/2526] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 15:03:21 2022] PUT /identity/v3/projects/bb5d2facca734c24877a6c27a1b81747/users/4a65f455457a42f980c8ec4efec2d203/roles/019bde1756cb40de8ce06cef6b261f79 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:03:21.319679 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcab6fcc-7ec5-4bd7-9329-b7c91539a26f admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:21.332276 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcab6fcc-7ec5-4bd7-9329-b7c91539a26f admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:21.419701 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e374cf-7589-43be-a2f1-4c74a60be5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:21.420371 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e374cf-7589-43be-a2f1-4c74a60be5f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:21.420712 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e374cf-7589-43be-a2f1-4c74a60be5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:21.421096 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e374cf-7589-43be-a2f1-4c74a60be5f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:21.421855 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e374cf-7589-43be-a2f1-4c74a60be5f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:21.423625 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e374cf-7589-43be-a2f1-4c74a60be5f6 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:21.437406 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1254/2527] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 15:03:21 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:03:21.441305 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef239a3d-e9d6-43c9-8abd-6adea0f4c599 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:21.454706 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef239a3d-e9d6-43c9-8abd-6adea0f4c599 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:21.461263 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f487c0-7d4c-4ba6-af42-dfb7c0020208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:21.461979 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f487c0-7d4c-4ba6-af42-dfb7c0020208 admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:21.462450 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f487c0-7d4c-4ba6-af42-dfb7c0020208 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:21.462789 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f487c0-7d4c-4ba6-af42-dfb7c0020208 admin admin] PATH_INFO: `/v3/projects/bb5d2facca734c24877a6c27a1b81747/users/4a65f455457a42f980c8ec4efec2d203/roles/019bde1756cb40de8ce06cef6b261f79` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:21.464848 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f487c0-7d4c-4ba6-af42-dfb7c0020208 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb5d2facca734c24877a6c27a1b81747, user_id=4a65f455457a42f980c8ec4efec2d203, role_id=019bde1756cb40de8ce06cef6b261f79)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:21.467616 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f487c0-7d4c-4ba6-af42-dfb7c0020208 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:21.489087 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1274/2528] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 15:03:21 2022] PUT /identity/v3/projects/bb5d2facca734c24877a6c27a1b81747/users/4a65f455457a42f980c8ec4efec2d203/roles/019bde1756cb40de8ce06cef6b261f79 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:03:22.439293 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e374cf-7589-43be-a2f1-4c74a60be5f6 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:22.441857 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b3e374cf-7589-43be-a2f1-4c74a60be5f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:22.684559 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e374cf-7589-43be-a2f1-4c74a60be5f6 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:22.726155 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:03:22.831307 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea0dd27-c97f-444f-88df-87e1f011d53e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da0a58c526f34afda909e4ede2b1e1c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:22.833122 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea0dd27-c97f-444f-88df-87e1f011d53e service placement] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:22.834188 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea0dd27-c97f-444f-88df-87e1f011d53e service placement] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:22.834793 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea0dd27-c97f-444f-88df-87e1f011d53e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:22.838542 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-1ea0dd27-c97f-444f-88df-87e1f011d53e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:22.873764 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea0dd27-c97f-444f-88df-87e1f011d53e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:22.879882 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea0dd27-c97f-444f-88df-87e1f011d53e service placement] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:22.927262 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1255/2529] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:03:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 15:03:27.827880 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95be33df-dd57-4d28-b630-c4a4bab70377 None None] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:27.830502 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95be33df-dd57-4d28-b630-c4a4bab70377 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:27.830784 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95be33df-dd57-4d28-b630-c4a4bab70377 None None] PATH_INFO: `/` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:27.837614 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1275/2530] 10.222.0.26 () {54 vars in 921 bytes} [Mon Sep 19 15:03:27 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 15:03:27.857125 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab40b9f-ec09-46fc-afc2-a10fc6c63d4f None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:27.861539 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab40b9f-ec09-46fc-afc2-a10fc6c63d4f None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:27.861823 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab40b9f-ec09-46fc-afc2-a10fc6c63d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:27.986559 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-6ab40b9f-ec09-46fc-afc2-a10fc6c63d4f None None] MFA Rules not processed for user `3017e5d92bef4cc2aeae4f28c78ba233`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:03:27.988961 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-6ab40b9f-ec09-46fc-afc2-a10fc6c63d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:28.175050 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1256/2531] 10.222.0.26 () {58 vars in 1018 bytes} [Mon Sep 19 15:03:27 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:03:28.180665 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95be33df-dd57-4d28-b630-c4a4bab70377 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:28.185094 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-95be33df-dd57-4d28-b630-c4a4bab70377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:28.350215 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95be33df-dd57-4d28-b630-c4a4bab70377 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:28.362514 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb4e05c-2a14-44be-ba02-5e238f45df7b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d4e9c3da83402dbe7938aaf2dcbb8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:28.363503 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb4e05c-2a14-44be-ba02-5e238f45df7b service glance] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:28.363927 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb4e05c-2a14-44be-ba02-5e238f45df7b service glance] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:28.364341 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb4e05c-2a14-44be-ba02-5e238f45df7b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:28.387874 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb4e05c-2a14-44be-ba02-5e238f45df7b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:28.390695 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb4e05c-2a14-44be-ba02-5e238f45df7b service glance] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:28.417261 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1276/2532] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:03:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:03:29.060710 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab40b9f-ec09-46fc-afc2-a10fc6c63d4f None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:29.305563 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab40b9f-ec09-46fc-afc2-a10fc6c63d4f None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:29.327969 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8853fb-c5ce-4bf1-a674-88dbd63f4a7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:29.330722 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8853fb-c5ce-4bf1-a674-88dbd63f4a7f service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:29.331291 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8853fb-c5ce-4bf1-a674-88dbd63f4a7f service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:29.331847 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8853fb-c5ce-4bf1-a674-88dbd63f4a7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:29.342162 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-da8853fb-c5ce-4bf1-a674-88dbd63f4a7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:29.394629 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:03:29.558582 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8853fb-c5ce-4bf1-a674-88dbd63f4a7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:29.564018 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8853fb-c5ce-4bf1-a674-88dbd63f4a7f service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:29.586005 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1257/2533] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:03:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:03:31.918104 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970e9d0-1bb6-424f-a3f1-ab2b98171765 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:31.918104 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970e9d0-1bb6-424f-a3f1-ab2b98171765 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:31.918104 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970e9d0-1bb6-424f-a3f1-ab2b98171765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:31.964002 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-9970e9d0-1bb6-424f-a3f1-ab2b98171765 None None] MFA Rules not processed for user `4a65f455457a42f980c8ec4efec2d203`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:03:31.965498 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-9970e9d0-1bb6-424f-a3f1-ab2b98171765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:32.183849 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1277/2534] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:03:31 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:03:32.201823 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8853fb-c5ce-4bf1-a674-88dbd63f4a7f service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:32.229222 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8853fb-c5ce-4bf1-a674-88dbd63f4a7f service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:32.248547 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e1ae0e-08de-4a56-baa1-a1b2139f9a1a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d4e9c3da83402dbe7938aaf2dcbb8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:32.249726 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e1ae0e-08de-4a56-baa1-a1b2139f9a1a service glance] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:32.250016 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e1ae0e-08de-4a56-baa1-a1b2139f9a1a service glance] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:32.250292 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e1ae0e-08de-4a56-baa1-a1b2139f9a1a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:32.427197 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e1ae0e-08de-4a56-baa1-a1b2139f9a1a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:32.429366 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e1ae0e-08de-4a56-baa1-a1b2139f9a1a service glance] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:32.465686 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1258/2535] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:03:32 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 15:03:32.823021 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ac627-fdba-442a-a2b9-74645832599e None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:32.823416 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ac627-fdba-442a-a2b9-74645832599e None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:32.823795 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ac627-fdba-442a-a2b9-74645832599e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:32.887901 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-a25ac627-fdba-442a-a2b9-74645832599e None None] MFA Rules not processed for user `2c2b1ac1a17c43d28da8f7e9a199dea4`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:03:32.889807 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-a25ac627-fdba-442a-a2b9-74645832599e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:32.970056 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:03:33.025439 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8d9587-5b36-483d-8ebb-ebb3a4f90916 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:33.026448 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8d9587-5b36-483d-8ebb-ebb3a4f90916 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:33.027235 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8d9587-5b36-483d-8ebb-ebb3a4f90916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:33.108466 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-4f8d9587-5b36-483d-8ebb-ebb3a4f90916 None None] MFA Rules not processed for user `2c2b1ac1a17c43d28da8f7e9a199dea4`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:03:33.108685 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1278/2536] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Sep 19 15:03:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Sep 19 15:03:33.112297 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25ac627-fdba-442a-a2b9-74645832599e None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:33.115531 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-a25ac627-fdba-442a-a2b9-74645832599e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:33.119938 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-4f8d9587-5b36-483d-8ebb-ebb3a4f90916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:33.169264 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1259/2537] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Sep 19 15:03:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:03:33.172580 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8d9587-5b36-483d-8ebb-ebb3a4f90916 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:33.175261 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-4f8d9587-5b36-483d-8ebb-ebb3a4f90916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:33.316980 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25ac627-fdba-442a-a2b9-74645832599e None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:33.323136 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5f7d40-77ef-4452-bcb3-c9d5d409cec0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cb60a5e90343e69a38db4356cb3a90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:33.323765 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f7d40-77ef-4452-bcb3-c9d5d409cec0 service swift] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:33.324223 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f7d40-77ef-4452-bcb3-c9d5d409cec0 service swift] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:33.324654 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f7d40-77ef-4452-bcb3-c9d5d409cec0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:33.343848 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5f7d40-77ef-4452-bcb3-c9d5d409cec0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:33.346121 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5f7d40-77ef-4452-bcb3-c9d5d409cec0 service swift] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:33.348855 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8d9587-5b36-483d-8ebb-ebb3a4f90916 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:33.359145 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b10582d-1870-42b2-ab0b-3d46efbcfc6c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cb60a5e90343e69a38db4356cb3a90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:33.360519 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b10582d-1870-42b2-ab0b-3d46efbcfc6c service swift] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:33.361272 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b10582d-1870-42b2-ab0b-3d46efbcfc6c service swift] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:33.361900 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b10582d-1870-42b2-ab0b-3d46efbcfc6c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:33.375711 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b10582d-1870-42b2-ab0b-3d46efbcfc6c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:33.377788 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b10582d-1870-42b2-ab0b-3d46efbcfc6c service swift] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:33.385380 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1279/2538] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Sep 19 15:03:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 15:03:33.396872 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1260/2539] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Sep 19 15:03:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 15:03:43.370615 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=45 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:03:43.393018 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=86 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:03:48.548173 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5f7d40-77ef-4452-bcb3-c9d5d409cec0 service swift] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:48.588502 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5f7d40-77ef-4452-bcb3-c9d5d409cec0 service swift] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:48.603063 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f0841a-418a-484a-bffe-a2033b98fb20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:48.603687 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f0841a-418a-484a-bffe-a2033b98fb20 service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:48.603961 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f0841a-418a-484a-bffe-a2033b98fb20 service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:48.607531 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f0841a-418a-484a-bffe-a2033b98fb20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:48.610437 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-31f0841a-418a-484a-bffe-a2033b98fb20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:48.649473 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f0841a-418a-484a-bffe-a2033b98fb20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:48.650935 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f0841a-418a-484a-bffe-a2033b98fb20 service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:48.682088 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1280/2540] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:03:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 15:03:52.313304 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b10582d-1870-42b2-ab0b-3d46efbcfc6c service swift] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:52.315941 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-9b10582d-1870-42b2-ab0b-3d46efbcfc6c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:52.350134 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b10582d-1870-42b2-ab0b-3d46efbcfc6c service swift] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:52.367745 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7906dfe-6497-44d9-86fe-caf1d7bf1421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:52.369085 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7906dfe-6497-44d9-86fe-caf1d7bf1421 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:52.369674 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7906dfe-6497-44d9-86fe-caf1d7bf1421 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:52.370270 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7906dfe-6497-44d9-86fe-caf1d7bf1421 admin admin] PATH_INFO: `/v3/users/cf6e0ff5391247558bfad031e08a1c1a` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:52.372565 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7906dfe-6497-44d9-86fe-caf1d7bf1421 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf6e0ff5391247558bfad031e08a1c1a)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:52.383585 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7906dfe-6497-44d9-86fe-caf1d7bf1421 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:52.554546 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a7906dfe-6497-44d9-86fe-caf1d7bf1421 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf6e0ff5391247558bfad031e08a1c1a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:52.566247 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a7906dfe-6497-44d9-86fe-caf1d7bf1421 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf6e0ff5391247558bfad031e08a1c1a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:52.566535 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a7906dfe-6497-44d9-86fe-caf1d7bf1421 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf6e0ff5391247558bfad031e08a1c1a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:52.567031 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a7906dfe-6497-44d9-86fe-caf1d7bf1421 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf6e0ff5391247558bfad031e08a1c1a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:52.598053 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a7906dfe-6497-44d9-86fe-caf1d7bf1421 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf6e0ff5391247558bfad031e08a1c1a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:52.697276 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1261/2541] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 15:03:52 2022] DELETE /identity/v3/users/cf6e0ff5391247558bfad031e08a1c1a => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:03:53.014261 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f0841a-418a-484a-bffe-a2033b98fb20 service neutron] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:53.043649 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f0841a-418a-484a-bffe-a2033b98fb20 service neutron] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:53.043789 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143c0ae-9ed6-4d80-88b1-a86417f6351d None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:53.044444 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143c0ae-9ed6-4d80-88b1-a86417f6351d None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:53.044806 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143c0ae-9ed6-4d80-88b1-a86417f6351d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:53.122897 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-8143c0ae-9ed6-4d80-88b1-a86417f6351d None None] MFA Rules not processed for user `b525dc72432c493ca134b39bd3bc3678`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:03:53.125035 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-8143c0ae-9ed6-4d80-88b1-a86417f6351d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:53.150907 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b98727e-bea4-476d-9795-b204802c0db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:53.151742 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b98727e-bea4-476d-9795-b204802c0db0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:53.152054 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b98727e-bea4-476d-9795-b204802c0db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:53.152642 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b98727e-bea4-476d-9795-b204802c0db0 admin admin] PATH_INFO: `/v3/projects/eba4013b8c6e4eacaf090b7c04451527` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:53.154022 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b98727e-bea4-476d-9795-b204802c0db0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eba4013b8c6e4eacaf090b7c04451527)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:53.156465 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b98727e-bea4-476d-9795-b204802c0db0 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:53.342445 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-8b98727e-bea4-476d-9795-b204802c0db0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eba4013b8c6e4eacaf090b7c04451527', 'request_id': 'req-8b98727e-bea4-476d-9795-b204802c0db0'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:53.354779 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-8b98727e-bea4-476d-9795-b204802c0db0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eba4013b8c6e4eacaf090b7c04451527', 'request_id': 'req-8b98727e-bea4-476d-9795-b204802c0db0'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:53.359060 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1262/2542] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:03:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:03:53.395035 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-8b98727e-bea4-476d-9795-b204802c0db0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eba4013b8c6e4eacaf090b7c04451527', 'request_id': 'req-8b98727e-bea4-476d-9795-b204802c0db0'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:53.445096 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-8b98727e-bea4-476d-9795-b204802c0db0 admin admin] The token cache is being invalidate because project eba4013b8c6e4eacaf090b7c04451527 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:03:53.445096 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-8b98727e-bea4-476d-9795-b204802c0db0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:53.445875 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-8b98727e-bea4-476d-9795-b204802c0db0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:53.456121 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1281/2543] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 15:03:53 2022] DELETE /identity/v3/projects/eba4013b8c6e4eacaf090b7c04451527 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:03:53.457182 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8143c0ae-9ed6-4d80-88b1-a86417f6351d None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:53.460091 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-8143c0ae-9ed6-4d80-88b1-a86417f6351d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:53.495498 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8143c0ae-9ed6-4d80-88b1-a86417f6351d None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:53.749590 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e270611-74cd-42b1-b2ec-330b41533e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:53.751103 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e270611-74cd-42b1-b2ec-330b41533e4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:53.751737 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e270611-74cd-42b1-b2ec-330b41533e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:53.752465 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e270611-74cd-42b1-b2ec-330b41533e4e admin admin] PATH_INFO: `/v3/users/9a4539c267734afcaf126bb61a501d39` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:53.758214 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e270611-74cd-42b1-b2ec-330b41533e4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a4539c267734afcaf126bb61a501d39)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:53.762053 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e270611-74cd-42b1-b2ec-330b41533e4e admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:53.814118 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:03:53.903908 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0e270611-74cd-42b1-b2ec-330b41533e4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a4539c267734afcaf126bb61a501d39'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:53.922921 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0e270611-74cd-42b1-b2ec-330b41533e4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a4539c267734afcaf126bb61a501d39'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:53.923582 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0e270611-74cd-42b1-b2ec-330b41533e4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a4539c267734afcaf126bb61a501d39'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:53.924323 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0e270611-74cd-42b1-b2ec-330b41533e4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a4539c267734afcaf126bb61a501d39'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:53.965766 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0e270611-74cd-42b1-b2ec-330b41533e4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a4539c267734afcaf126bb61a501d39'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:54.046844 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1263/2544] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 15:03:53 2022] DELETE /identity/v3/users/9a4539c267734afcaf126bb61a501d39 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:03:54.590389 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b98727e-bea4-476d-9795-b204802c0db0 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:54.592816 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-8b98727e-bea4-476d-9795-b204802c0db0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:54.614089 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b98727e-bea4-476d-9795-b204802c0db0 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:54.761525 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c6c8ff-4e55-4c0c-a018-2a48a458cf82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:54.762547 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c6c8ff-4e55-4c0c-a018-2a48a458cf82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:54.762998 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c6c8ff-4e55-4c0c-a018-2a48a458cf82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:54.763448 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c6c8ff-4e55-4c0c-a018-2a48a458cf82 admin admin] PATH_INFO: `/v3/projects/c12da6cb46cf455d93bf9ee9e023baa9` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:54.765900 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c6c8ff-4e55-4c0c-a018-2a48a458cf82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c12da6cb46cf455d93bf9ee9e023baa9)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:54.769520 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c6c8ff-4e55-4c0c-a018-2a48a458cf82 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:54.789420 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:03:54.900066 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-00c6c8ff-4e55-4c0c-a018-2a48a458cf82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c12da6cb46cf455d93bf9ee9e023baa9', 'request_id': 'req-00c6c8ff-4e55-4c0c-a018-2a48a458cf82'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:54.909081 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-00c6c8ff-4e55-4c0c-a018-2a48a458cf82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c12da6cb46cf455d93bf9ee9e023baa9', 'request_id': 'req-00c6c8ff-4e55-4c0c-a018-2a48a458cf82'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:54.921041 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-00c6c8ff-4e55-4c0c-a018-2a48a458cf82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c12da6cb46cf455d93bf9ee9e023baa9', 'request_id': 'req-00c6c8ff-4e55-4c0c-a018-2a48a458cf82'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:54.947751 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-00c6c8ff-4e55-4c0c-a018-2a48a458cf82 admin admin] The token cache is being invalidate because project c12da6cb46cf455d93bf9ee9e023baa9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:03:54.947751 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-00c6c8ff-4e55-4c0c-a018-2a48a458cf82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:54.948777 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-00c6c8ff-4e55-4c0c-a018-2a48a458cf82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:54.952211 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1282/2545] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 15:03:54 2022] DELETE /identity/v3/projects/c12da6cb46cf455d93bf9ee9e023baa9 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:03:56.370145 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e270611-74cd-42b1-b2ec-330b41533e4e admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:56.372521 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-0e270611-74cd-42b1-b2ec-330b41533e4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:56.479456 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e270611-74cd-42b1-b2ec-330b41533e4e admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:56.481255 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c6c8ff-4e55-4c0c-a018-2a48a458cf82 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:56.483073 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-00c6c8ff-4e55-4c0c-a018-2a48a458cf82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:56.593382 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0f379f-9970-4086-bf79-87533ead752b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da0a58c526f34afda909e4ede2b1e1c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:56.594511 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f379f-9970-4086-bf79-87533ead752b service placement] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:56.595077 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f379f-9970-4086-bf79-87533ead752b service placement] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:56.595836 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f379f-9970-4086-bf79-87533ead752b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:56.599140 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-5e0f379f-9970-4086-bf79-87533ead752b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:56.617231 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c6c8ff-4e55-4c0c-a018-2a48a458cf82 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:56.618256 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0f379f-9970-4086-bf79-87533ead752b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:56.620745 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0f379f-9970-4086-bf79-87533ead752b service placement] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:56.623545 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1ef98c-0b7e-4b9d-bc79-512677b73c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:56.624271 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ef98c-0b7e-4b9d-bc79-512677b73c2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:56.624557 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ef98c-0b7e-4b9d-bc79-512677b73c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:56.624872 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ef98c-0b7e-4b9d-bc79-512677b73c2c admin admin] PATH_INFO: `/v3/users/f1c836a721f54178a02d864ce57c776e` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:56.626144 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1ef98c-0b7e-4b9d-bc79-512677b73c2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1c836a721f54178a02d864ce57c776e)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:56.628194 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1ef98c-0b7e-4b9d-bc79-512677b73c2c admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:56.637439 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1264/2546] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:03:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:03:56.702513 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-4e1ef98c-0b7e-4b9d-bc79-512677b73c2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1c836a721f54178a02d864ce57c776e'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:56.712772 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-4e1ef98c-0b7e-4b9d-bc79-512677b73c2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1c836a721f54178a02d864ce57c776e'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:56.713578 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-4e1ef98c-0b7e-4b9d-bc79-512677b73c2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1c836a721f54178a02d864ce57c776e'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:56.714428 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-4e1ef98c-0b7e-4b9d-bc79-512677b73c2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1c836a721f54178a02d864ce57c776e'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:56.734774 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-4e1ef98c-0b7e-4b9d-bc79-512677b73c2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1c836a721f54178a02d864ce57c776e'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:56.755383 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1283/2547] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 15:03:56 2022] DELETE /identity/v3/users/f1c836a721f54178a02d864ce57c776e => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:03:56.968720 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0f379f-9970-4086-bf79-87533ead752b service placement] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:56.991892 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0f379f-9970-4086-bf79-87533ead752b service placement] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:57.037865 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:03:57.073084 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f770cc02-2ea5-41aa-83b5-9c34b48d9687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:57.073703 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f770cc02-2ea5-41aa-83b5-9c34b48d9687 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:57.073981 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f770cc02-2ea5-41aa-83b5-9c34b48d9687 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:57.074249 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f770cc02-2ea5-41aa-83b5-9c34b48d9687 admin admin] PATH_INFO: `/v3/projects/ee9b210f840e485fb5cd1a0dd0e0fa52` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:57.075714 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f770cc02-2ea5-41aa-83b5-9c34b48d9687 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee9b210f840e485fb5cd1a0dd0e0fa52)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:57.077768 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f770cc02-2ea5-41aa-83b5-9c34b48d9687 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:57.139983 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f770cc02-2ea5-41aa-83b5-9c34b48d9687 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee9b210f840e485fb5cd1a0dd0e0fa52', 'request_id': 'req-f770cc02-2ea5-41aa-83b5-9c34b48d9687'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:57.148424 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f770cc02-2ea5-41aa-83b5-9c34b48d9687 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee9b210f840e485fb5cd1a0dd0e0fa52', 'request_id': 'req-f770cc02-2ea5-41aa-83b5-9c34b48d9687'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:57.158479 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f770cc02-2ea5-41aa-83b5-9c34b48d9687 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee9b210f840e485fb5cd1a0dd0e0fa52', 'request_id': 'req-f770cc02-2ea5-41aa-83b5-9c34b48d9687'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:57.174280 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f770cc02-2ea5-41aa-83b5-9c34b48d9687 admin admin] The token cache is being invalidate because project ee9b210f840e485fb5cd1a0dd0e0fa52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:03:57.174640 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f770cc02-2ea5-41aa-83b5-9c34b48d9687 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:57.175315 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f770cc02-2ea5-41aa-83b5-9c34b48d9687 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:03:57.176887 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1265/2548] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 15:03:56 2022] DELETE /identity/v3/projects/ee9b210f840e485fb5cd1a0dd0e0fa52 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:03:57.183362 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee169c-e61a-4dae-a6f5-68477bd2113f None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:57.183643 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee169c-e61a-4dae-a6f5-68477bd2113f None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:57.183989 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee169c-e61a-4dae-a6f5-68477bd2113f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:57.231333 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:03:57.267451 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-6eee169c-e61a-4dae-a6f5-68477bd2113f None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:03:57.269484 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-6eee169c-e61a-4dae-a6f5-68477bd2113f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:57.351077 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1284/2549] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:03:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:03:57.365497 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cddcb13-90ee-45e9-81af-c8816fe53e3f None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:57.366625 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cddcb13-90ee-45e9-81af-c8816fe53e3f None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:57.367208 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cddcb13-90ee-45e9-81af-c8816fe53e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:57.402130 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-1cddcb13-90ee-45e9-81af-c8816fe53e3f None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:03:57.404029 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-1cddcb13-90ee-45e9-81af-c8816fe53e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:57.417705 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1266/2550] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:03:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:03:57.422891 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eee169c-e61a-4dae-a6f5-68477bd2113f None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:57.434565 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eee169c-e61a-4dae-a6f5-68477bd2113f None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:57.444680 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a037f4-4df1-41ce-b9bc-8e9e5925e16e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:57.447189 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a037f4-4df1-41ce-b9bc-8e9e5925e16e admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:57.447472 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a037f4-4df1-41ce-b9bc-8e9e5925e16e admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:57.447749 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a037f4-4df1-41ce-b9bc-8e9e5925e16e admin admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:57.448426 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a037f4-4df1-41ce-b9bc-8e9e5925e16e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:03:57.448745 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a037f4-4df1-41ce-b9bc-8e9e5925e16e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:57.451192 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a037f4-4df1-41ce-b9bc-8e9e5925e16e admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:57.465847 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1285/2551] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 19 15:03:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:03:57.472384 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cddcb13-90ee-45e9-81af-c8816fe53e3f None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:57.487215 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cddcb13-90ee-45e9-81af-c8816fe53e3f None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:57.492939 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a872c-111e-4ac6-b520-290b0ea525c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:57.493701 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a872c-111e-4ac6-b520-290b0ea525c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:57.494125 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a872c-111e-4ac6-b520-290b0ea525c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:57.494428 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a872c-111e-4ac6-b520-290b0ea525c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:57.495071 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91a872c-111e-4ac6-b520-290b0ea525c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:57.497049 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91a872c-111e-4ac6-b520-290b0ea525c0 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:57.534373 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1267/2552] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 15:03:57 2022] POST /identity/v3/projects => generated 365 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:03:57.539705 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a037f4-4df1-41ce-b9bc-8e9e5925e16e admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:57.553638 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a037f4-4df1-41ce-b9bc-8e9e5925e16e admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:57.627278 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdf8f73-7faa-4f97-ae6d-2022d1a15f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:57.627935 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf8f73-7faa-4f97-ae6d-2022d1a15f22 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:57.628221 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf8f73-7faa-4f97-ae6d-2022d1a15f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:57.628486 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf8f73-7faa-4f97-ae6d-2022d1a15f22 admin admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:57.629170 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdf8f73-7faa-4f97-ae6d-2022d1a15f22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:57.631250 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdf8f73-7faa-4f97-ae6d-2022d1a15f22 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:57.658887 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1286/2553] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 15:03:57 2022] POST /identity/v3/users => generated 283 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:03:57.663678 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a872c-111e-4ac6-b520-290b0ea525c0 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:57.676704 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a872c-111e-4ac6-b520-290b0ea525c0 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:57.682699 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7a36ef-9688-4a6e-b880-240afcda5e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:57.683495 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a36ef-9688-4a6e-b880-240afcda5e6e admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:57.683882 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a36ef-9688-4a6e-b880-240afcda5e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:57.684294 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a36ef-9688-4a6e-b880-240afcda5e6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:57.685059 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7a36ef-9688-4a6e-b880-240afcda5e6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:57.687588 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7a36ef-9688-4a6e-b880-240afcda5e6e admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:57.706976 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1268/2554] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 15:03:57 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:03:57.708499 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdf8f73-7faa-4f97-ae6d-2022d1a15f22 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:57.719775 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdf8f73-7faa-4f97-ae6d-2022d1a15f22 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:57.725327 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb94fe3-8a03-45e9-a391-b5c836355627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:57.726003 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb94fe3-8a03-45e9-a391-b5c836355627 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:57.726281 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb94fe3-8a03-45e9-a391-b5c836355627 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:57.726676 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb94fe3-8a03-45e9-a391-b5c836355627 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:57.727348 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb94fe3-8a03-45e9-a391-b5c836355627 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:57.729020 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb94fe3-8a03-45e9-a391-b5c836355627 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:57.749126 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1287/2555] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 15:03:57 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:03:57.754622 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7a36ef-9688-4a6e-b880-240afcda5e6e admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:57.775708 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7a36ef-9688-4a6e-b880-240afcda5e6e admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:57.784901 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fb3dd9-d53b-48a7-ac1d-aa8447eb2b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:57.785951 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fb3dd9-d53b-48a7-ac1d-aa8447eb2b0d admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:57.786444 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fb3dd9-d53b-48a7-ac1d-aa8447eb2b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:57.786886 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fb3dd9-d53b-48a7-ac1d-aa8447eb2b0d admin admin] PATH_INFO: `/v3/projects/c6bc915a99cc40bdb6048c933c61bae9/users/8641a8f761254e5fbe4cd83d3f53bb55/roles/74de6794e3b3422b93d26f993d260c35` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:57.819049 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fb3dd9-d53b-48a7-ac1d-aa8447eb2b0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6bc915a99cc40bdb6048c933c61bae9, user_id=8641a8f761254e5fbe4cd83d3f53bb55, role_id=74de6794e3b3422b93d26f993d260c35)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:57.827519 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fb3dd9-d53b-48a7-ac1d-aa8447eb2b0d admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:57.848215 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1269/2556] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 15:03:57 2022] PUT /identity/v3/projects/c6bc915a99cc40bdb6048c933c61bae9/users/8641a8f761254e5fbe4cd83d3f53bb55/roles/74de6794e3b3422b93d26f993d260c35 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:03:57.868204 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b8f38-7ce6-4e56-b941-67e13c591d30 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:57.868583 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b8f38-7ce6-4e56-b941-67e13c591d30 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:57.868913 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b8f38-7ce6-4e56-b941-67e13c591d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:57.922198 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-e79b8f38-7ce6-4e56-b941-67e13c591d30 None None] MFA Rules not processed for user `8641a8f761254e5fbe4cd83d3f53bb55`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:03:57.924363 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-e79b8f38-7ce6-4e56-b941-67e13c591d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:58.001580 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:03:58.030719 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1288/2557] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:03:57 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:03:58.042953 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fb3dd9-d53b-48a7-ac1d-aa8447eb2b0d admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:58.056197 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-39fb3dd9-d53b-48a7-ac1d-aa8447eb2b0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:58.144356 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:03:58.176216 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fb3dd9-d53b-48a7-ac1d-aa8447eb2b0d admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:58.181369 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d926b011-3390-4d48-b8a9-79468b2f8564 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df648c909ddb41418128b43f925f5ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:58.182189 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d926b011-3390-4d48-b8a9-79468b2f8564 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:58.182701 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d926b011-3390-4d48-b8a9-79468b2f8564 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:58.183073 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d926b011-3390-4d48-b8a9-79468b2f8564 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:58.196735 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d926b011-3390-4d48-b8a9-79468b2f8564 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:58.198459 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d926b011-3390-4d48-b8a9-79468b2f8564 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:58.209565 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1270/2558] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:03:58 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:03:58.911586 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520595d1-0410-42c4-a3fa-44616fc059aa None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:58.912401 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520595d1-0410-42c4-a3fa-44616fc059aa None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:58.912597 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520595d1-0410-42c4-a3fa-44616fc059aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:58.938491 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-520595d1-0410-42c4-a3fa-44616fc059aa None None] MFA Rules not processed for user `2c2b1ac1a17c43d28da8f7e9a199dea4`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:03:58.939902 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-520595d1-0410-42c4-a3fa-44616fc059aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:59.037466 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1289/2559] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Sep 19 15:03:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:03:59.052016 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d926b011-3390-4d48-b8a9-79468b2f8564 service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:03:59.053988 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d926b011-3390-4d48-b8a9-79468b2f8564 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:03:59.164298 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d926b011-3390-4d48-b8a9-79468b2f8564 service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:03:59.171545 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11a4e0a-7a1f-41ee-87ec-ad0e61aaab25 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cb60a5e90343e69a38db4356cb3a90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:03:59.172327 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a4e0a-7a1f-41ee-87ec-ad0e61aaab25 service swift] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:03:59.172629 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a4e0a-7a1f-41ee-87ec-ad0e61aaab25 service swift] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:03:59.172945 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a4e0a-7a1f-41ee-87ec-ad0e61aaab25 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:03:59.183652 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11a4e0a-7a1f-41ee-87ec-ad0e61aaab25 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:03:59.185449 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11a4e0a-7a1f-41ee-87ec-ad0e61aaab25 service swift] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:03:59.198653 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1271/2560] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Sep 19 15:03:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 15:04:09.024178 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=29 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:09.175412 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520595d1-0410-42c4-a3fa-44616fc059aa None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:09.194734 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=42 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:09.274505 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520595d1-0410-42c4-a3fa-44616fc059aa None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:09.279912 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb9f33c-6702-49f0-a062-a5129e1d6714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:09.280754 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb9f33c-6702-49f0-a062-a5129e1d6714 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:09.281168 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb9f33c-6702-49f0-a062-a5129e1d6714 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:09.281542 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb9f33c-6702-49f0-a062-a5129e1d6714 admin admin] PATH_INFO: `/v3/users/8641a8f761254e5fbe4cd83d3f53bb55` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:09.282868 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb9f33c-6702-49f0-a062-a5129e1d6714 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8641a8f761254e5fbe4cd83d3f53bb55)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:09.285456 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb9f33c-6702-49f0-a062-a5129e1d6714 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:09.348847 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-7fb9f33c-6702-49f0-a062-a5129e1d6714 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8641a8f761254e5fbe4cd83d3f53bb55'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:09.358089 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-7fb9f33c-6702-49f0-a062-a5129e1d6714 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8641a8f761254e5fbe4cd83d3f53bb55'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:09.358797 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-7fb9f33c-6702-49f0-a062-a5129e1d6714 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8641a8f761254e5fbe4cd83d3f53bb55'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:09.359438 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-7fb9f33c-6702-49f0-a062-a5129e1d6714 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8641a8f761254e5fbe4cd83d3f53bb55'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:09.373248 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-7fb9f33c-6702-49f0-a062-a5129e1d6714 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8641a8f761254e5fbe4cd83d3f53bb55'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:09.388531 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1290/2561] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 15:04:09 2022] DELETE /identity/v3/users/8641a8f761254e5fbe4cd83d3f53bb55 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:04:09.394487 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9bf338-0a2b-4b61-b74e-aa7476a21a97 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:09.394787 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9bf338-0a2b-4b61-b74e-aa7476a21a97 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:09.395062 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9bf338-0a2b-4b61-b74e-aa7476a21a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:09.418652 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-6a9bf338-0a2b-4b61-b74e-aa7476a21a97 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:04:09.420023 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-6a9bf338-0a2b-4b61-b74e-aa7476a21a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:09.519915 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1272/2562] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:04:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:04:09.530879 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb9f33c-6702-49f0-a062-a5129e1d6714 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:09.532331 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-7fb9f33c-6702-49f0-a062-a5129e1d6714 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:09.634609 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb9f33c-6702-49f0-a062-a5129e1d6714 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:09.640014 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603a2635-14ce-466e-a165-ef398cd3dffc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:09.640805 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a2635-14ce-466e-a165-ef398cd3dffc service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:09.641126 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a2635-14ce-466e-a165-ef398cd3dffc service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:09.641425 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a2635-14ce-466e-a165-ef398cd3dffc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:09.653764 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603a2635-14ce-466e-a165-ef398cd3dffc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:09.655233 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603a2635-14ce-466e-a165-ef398cd3dffc service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:09.666759 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1291/2563] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:04:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 15:04:10.042676 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9bf338-0a2b-4b61-b74e-aa7476a21a97 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:10.045265 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-6a9bf338-0a2b-4b61-b74e-aa7476a21a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:10.063097 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9bf338-0a2b-4b61-b74e-aa7476a21a97 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:10.068976 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f11e099-8102-4db4-86f0-f7c5ed91aa4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:10.069963 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f11e099-8102-4db4-86f0-f7c5ed91aa4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:10.070257 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f11e099-8102-4db4-86f0-f7c5ed91aa4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:10.070517 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f11e099-8102-4db4-86f0-f7c5ed91aa4a admin admin] PATH_INFO: `/v3/projects/c6bc915a99cc40bdb6048c933c61bae9` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:10.071720 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f11e099-8102-4db4-86f0-f7c5ed91aa4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6bc915a99cc40bdb6048c933c61bae9)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:10.074724 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f11e099-8102-4db4-86f0-f7c5ed91aa4a admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:10.149532 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-1f11e099-8102-4db4-86f0-f7c5ed91aa4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6bc915a99cc40bdb6048c933c61bae9', 'request_id': 'req-1f11e099-8102-4db4-86f0-f7c5ed91aa4a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:10.160427 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-1f11e099-8102-4db4-86f0-f7c5ed91aa4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6bc915a99cc40bdb6048c933c61bae9', 'request_id': 'req-1f11e099-8102-4db4-86f0-f7c5ed91aa4a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:10.172933 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-1f11e099-8102-4db4-86f0-f7c5ed91aa4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6bc915a99cc40bdb6048c933c61bae9', 'request_id': 'req-1f11e099-8102-4db4-86f0-f7c5ed91aa4a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:10.188536 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-1f11e099-8102-4db4-86f0-f7c5ed91aa4a admin admin] The token cache is being invalidate because project c6bc915a99cc40bdb6048c933c61bae9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:04:10.188855 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-1f11e099-8102-4db4-86f0-f7c5ed91aa4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:10.189512 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-1f11e099-8102-4db4-86f0-f7c5ed91aa4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:10.191453 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1273/2564] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 15:04:10 2022] DELETE /identity/v3/projects/c6bc915a99cc40bdb6048c933c61bae9 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:04:10.198665 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf63add1-e470-4e7c-afe8-7681ac5f896a None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:10.199265 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf63add1-e470-4e7c-afe8-7681ac5f896a None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:10.199790 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf63add1-e470-4e7c-afe8-7681ac5f896a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:10.366864 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-bf63add1-e470-4e7c-afe8-7681ac5f896a None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:04:10.367994 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-bf63add1-e470-4e7c-afe8-7681ac5f896a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:10.373977 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:10.442759 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1292/2565] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:04:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:04:10.455197 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e58f5-43cc-4c5f-9481-84a4deab86e6 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:10.456092 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e58f5-43cc-4c5f-9481-84a4deab86e6 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:10.456092 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e58f5-43cc-4c5f-9481-84a4deab86e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:10.487997 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-548e58f5-43cc-4c5f-9481-84a4deab86e6 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:04:10.489781 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-548e58f5-43cc-4c5f-9481-84a4deab86e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:10.498250 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1274/2566] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:04:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:04:10.503482 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf63add1-e470-4e7c-afe8-7681ac5f896a None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:10.516184 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf63add1-e470-4e7c-afe8-7681ac5f896a None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:10.521763 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8529fea8-8a6a-4edd-873b-a21c7fbc651a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:10.522381 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8529fea8-8a6a-4edd-873b-a21c7fbc651a admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:10.522655 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8529fea8-8a6a-4edd-873b-a21c7fbc651a admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:10.522920 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8529fea8-8a6a-4edd-873b-a21c7fbc651a admin admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:10.523570 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8529fea8-8a6a-4edd-873b-a21c7fbc651a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:04:10.523869 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8529fea8-8a6a-4edd-873b-a21c7fbc651a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:10.525524 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8529fea8-8a6a-4edd-873b-a21c7fbc651a admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:10.544950 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1293/2567] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 19 15:04:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:04:10.549881 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548e58f5-43cc-4c5f-9481-84a4deab86e6 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:10.563266 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548e58f5-43cc-4c5f-9481-84a4deab86e6 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:10.571714 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c8258b-2adb-4ac7-9d65-d742b3c29265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:10.572686 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c8258b-2adb-4ac7-9d65-d742b3c29265 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:10.573204 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c8258b-2adb-4ac7-9d65-d742b3c29265 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:10.573667 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c8258b-2adb-4ac7-9d65-d742b3c29265 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:10.574774 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c8258b-2adb-4ac7-9d65-d742b3c29265 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:10.577383 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c8258b-2adb-4ac7-9d65-d742b3c29265 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:10.617112 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1275/2568] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 15:04:10 2022] POST /identity/v3/projects => generated 373 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 15:04:10.623319 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8529fea8-8a6a-4edd-873b-a21c7fbc651a admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:10.635632 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8529fea8-8a6a-4edd-873b-a21c7fbc651a admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:10.708867 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fb3265-8d78-448e-bf5d-f9a38854357b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:10.709579 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb3265-8d78-448e-bf5d-f9a38854357b admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:10.709834 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb3265-8d78-448e-bf5d-f9a38854357b admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:10.710108 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb3265-8d78-448e-bf5d-f9a38854357b admin admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:10.710945 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fb3265-8d78-448e-bf5d-f9a38854357b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:10.713198 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fb3265-8d78-448e-bf5d-f9a38854357b admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:10.739311 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1294/2569] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 15:04:10 2022] POST /identity/v3/users => generated 287 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:04:10.744296 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c8258b-2adb-4ac7-9d65-d742b3c29265 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:10.759309 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c8258b-2adb-4ac7-9d65-d742b3c29265 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:10.767531 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032db853-3fb8-423a-8c6b-762c68ba6022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:10.768558 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032db853-3fb8-423a-8c6b-762c68ba6022 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:10.769080 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032db853-3fb8-423a-8c6b-762c68ba6022 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:10.769555 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032db853-3fb8-423a-8c6b-762c68ba6022 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:10.770546 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032db853-3fb8-423a-8c6b-762c68ba6022 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:10.774129 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032db853-3fb8-423a-8c6b-762c68ba6022 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:10.791623 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1276/2570] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 15:04:10 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:04:10.796052 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fb3265-8d78-448e-bf5d-f9a38854357b admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:10.809619 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fb3265-8d78-448e-bf5d-f9a38854357b admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:10.815926 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e2f5c1-ee8f-46b4-a166-a2fe49370d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:10.816905 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e2f5c1-ee8f-46b4-a166-a2fe49370d92 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:10.817398 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e2f5c1-ee8f-46b4-a166-a2fe49370d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:10.817850 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e2f5c1-ee8f-46b4-a166-a2fe49370d92 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:10.818702 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e2f5c1-ee8f-46b4-a166-a2fe49370d92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:10.820857 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e2f5c1-ee8f-46b4-a166-a2fe49370d92 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:10.834646 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1295/2571] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 15:04:10 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 15:04:10.839619 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032db853-3fb8-423a-8c6b-762c68ba6022 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:10.854765 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032db853-3fb8-423a-8c6b-762c68ba6022 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:10.860863 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b26265c-11f3-4c53-a18b-e7eccf8267c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:10.861603 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b26265c-11f3-4c53-a18b-e7eccf8267c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:10.861890 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b26265c-11f3-4c53-a18b-e7eccf8267c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:10.862325 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b26265c-11f3-4c53-a18b-e7eccf8267c8 admin admin] PATH_INFO: `/v3/projects/e310a513ed9843559e213d9c04ca726f/users/2db963590c8046adaf0c011e6c892795/roles/74de6794e3b3422b93d26f993d260c35` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:10.888823 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b26265c-11f3-4c53-a18b-e7eccf8267c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e310a513ed9843559e213d9c04ca726f, user_id=2db963590c8046adaf0c011e6c892795, role_id=74de6794e3b3422b93d26f993d260c35)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:10.893282 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b26265c-11f3-4c53-a18b-e7eccf8267c8 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:10.910455 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1277/2572] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 15:04:10 2022] PUT /identity/v3/projects/e310a513ed9843559e213d9c04ca726f/users/2db963590c8046adaf0c011e6c892795/roles/74de6794e3b3422b93d26f993d260c35 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:04:10.927944 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9405e939-3ff5-4d55-a288-39a1588b5101 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:10.928658 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9405e939-3ff5-4d55-a288-39a1588b5101 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:10.928658 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9405e939-3ff5-4d55-a288-39a1588b5101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:10.962669 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-9405e939-3ff5-4d55-a288-39a1588b5101 None None] MFA Rules not processed for user `2db963590c8046adaf0c011e6c892795`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:04:10.963893 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-9405e939-3ff5-4d55-a288-39a1588b5101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:11.043896 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1296/2573] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:04:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:04:11.050836 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b26265c-11f3-4c53-a18b-e7eccf8267c8 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:11.083463 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:11.145246 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b26265c-11f3-4c53-a18b-e7eccf8267c8 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:11.150530 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4085cae1-fd05-4c08-addb-7154277ca626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:11.151144 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4085cae1-fd05-4c08-addb-7154277ca626 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:11.151424 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4085cae1-fd05-4c08-addb-7154277ca626 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:11.151702 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4085cae1-fd05-4c08-addb-7154277ca626 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:11.152356 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4085cae1-fd05-4c08-addb-7154277ca626 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:11.154323 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4085cae1-fd05-4c08-addb-7154277ca626 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:11.184637 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1278/2574] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 15:04:11 2022] POST /identity/v3/projects => generated 371 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:04:11.190355 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9405e939-3ff5-4d55-a288-39a1588b5101 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:11.209859 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9405e939-3ff5-4d55-a288-39a1588b5101 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:11.216146 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:11.296693 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61c8d70-ae1c-4577-9807-235521f4c97b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:11.297770 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c8d70-ae1c-4577-9807-235521f4c97b admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:11.298263 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c8d70-ae1c-4577-9807-235521f4c97b admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:11.298751 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c8d70-ae1c-4577-9807-235521f4c97b admin admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:11.299897 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61c8d70-ae1c-4577-9807-235521f4c97b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:11.303764 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61c8d70-ae1c-4577-9807-235521f4c97b admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:11.341365 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1297/2575] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 15:04:11 2022] POST /identity/v3/users => generated 292 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:04:11.346416 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4085cae1-fd05-4c08-addb-7154277ca626 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:11.361594 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4085cae1-fd05-4c08-addb-7154277ca626 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:11.368058 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5584084-327f-4cd4-9d4e-0e5b59254bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:11.368676 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5584084-327f-4cd4-9d4e-0e5b59254bca admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:11.368951 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5584084-327f-4cd4-9d4e-0e5b59254bca admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:11.369257 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5584084-327f-4cd4-9d4e-0e5b59254bca admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:11.369939 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5584084-327f-4cd4-9d4e-0e5b59254bca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:11.371558 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5584084-327f-4cd4-9d4e-0e5b59254bca admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:11.385511 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1279/2576] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 15:04:11 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:04:11.390979 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61c8d70-ae1c-4577-9807-235521f4c97b admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:11.407285 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61c8d70-ae1c-4577-9807-235521f4c97b admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:11.415261 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a2c0a2-a15b-49c4-bb88-6af582c445c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:11.416074 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a2c0a2-a15b-49c4-bb88-6af582c445c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:11.416413 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a2c0a2-a15b-49c4-bb88-6af582c445c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:11.416691 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a2c0a2-a15b-49c4-bb88-6af582c445c8 admin admin] PATH_INFO: `/v3/projects/15bc929eeb364a8888d74c1ced88e81f/users/ef78e74282134566b1a0238ce25134c4/roles/019bde1756cb40de8ce06cef6b261f79` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:11.449165 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a2c0a2-a15b-49c4-bb88-6af582c445c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15bc929eeb364a8888d74c1ced88e81f, user_id=ef78e74282134566b1a0238ce25134c4, role_id=019bde1756cb40de8ce06cef6b261f79)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:11.454965 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a2c0a2-a15b-49c4-bb88-6af582c445c8 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:11.478241 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1298/2577] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 15:04:11 2022] PUT /identity/v3/projects/15bc929eeb364a8888d74c1ced88e81f/users/ef78e74282134566b1a0238ce25134c4/roles/019bde1756cb40de8ce06cef6b261f79 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:04:11.482923 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5584084-327f-4cd4-9d4e-0e5b59254bca admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:11.493649 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5584084-327f-4cd4-9d4e-0e5b59254bca admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:11.559840 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84b122c-c335-45a8-98b1-f1946b6a6b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:11.560561 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b122c-c335-45a8-98b1-f1946b6a6b3a admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:11.560860 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b122c-c335-45a8-98b1-f1946b6a6b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:11.561210 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b122c-c335-45a8-98b1-f1946b6a6b3a admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:11.561973 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84b122c-c335-45a8-98b1-f1946b6a6b3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:11.563731 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84b122c-c335-45a8-98b1-f1946b6a6b3a admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:11.574948 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1280/2578] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 15:04:11 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:04:11.580248 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a2c0a2-a15b-49c4-bb88-6af582c445c8 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:11.592273 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a2c0a2-a15b-49c4-bb88-6af582c445c8 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:11.597761 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72224ed5-20f6-422e-bf4b-aa9759243213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:11.598555 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72224ed5-20f6-422e-bf4b-aa9759243213 admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:11.598771 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72224ed5-20f6-422e-bf4b-aa9759243213 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:11.599028 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72224ed5-20f6-422e-bf4b-aa9759243213 admin admin] PATH_INFO: `/v3/projects/15bc929eeb364a8888d74c1ced88e81f/users/ef78e74282134566b1a0238ce25134c4/roles/019bde1756cb40de8ce06cef6b261f79` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:11.601449 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72224ed5-20f6-422e-bf4b-aa9759243213 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15bc929eeb364a8888d74c1ced88e81f, user_id=ef78e74282134566b1a0238ce25134c4, role_id=019bde1756cb40de8ce06cef6b261f79)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:11.604104 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72224ed5-20f6-422e-bf4b-aa9759243213 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:11.615999 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1299/2579] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 15:04:11 2022] PUT /identity/v3/projects/15bc929eeb364a8888d74c1ced88e81f/users/ef78e74282134566b1a0238ce25134c4/roles/019bde1756cb40de8ce06cef6b261f79 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:04:11.629111 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4441c2-9227-4b9c-8519-1f1b63f2ac2c None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:11.629392 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4441c2-9227-4b9c-8519-1f1b63f2ac2c None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:11.629670 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4441c2-9227-4b9c-8519-1f1b63f2ac2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:11.663868 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-3e4441c2-9227-4b9c-8519-1f1b63f2ac2c None None] MFA Rules not processed for user `ef78e74282134566b1a0238ce25134c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:04:11.665307 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-3e4441c2-9227-4b9c-8519-1f1b63f2ac2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:11.752411 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1281/2580] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:04:11 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:04:11.764371 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72224ed5-20f6-422e-bf4b-aa9759243213 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:11.766471 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-72224ed5-20f6-422e-bf4b-aa9759243213 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:11.833542 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72224ed5-20f6-422e-bf4b-aa9759243213 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:11.840184 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a21f0af-f043-4aec-a6cb-8141ad81cc2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df648c909ddb41418128b43f925f5ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:11.841014 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a21f0af-f043-4aec-a6cb-8141ad81cc2a service cinder] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:11.841554 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a21f0af-f043-4aec-a6cb-8141ad81cc2a service cinder] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:11.842077 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a21f0af-f043-4aec-a6cb-8141ad81cc2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:11.854813 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a21f0af-f043-4aec-a6cb-8141ad81cc2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:11.856364 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a21f0af-f043-4aec-a6cb-8141ad81cc2a service cinder] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:11.866983 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1300/2581] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:04:11 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:04:12.410581 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4441c2-9227-4b9c-8519-1f1b63f2ac2c None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:12.431007 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:12.499892 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4441c2-9227-4b9c-8519-1f1b63f2ac2c None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:12.506731 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24b9de4-ff26-4f59-85a2-66d486210d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:12.508099 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b9de4-ff26-4f59-85a2-66d486210d7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:12.508579 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b9de4-ff26-4f59-85a2-66d486210d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:12.509075 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b9de4-ff26-4f59-85a2-66d486210d7c admin admin] PATH_INFO: `/v3/users/2db963590c8046adaf0c011e6c892795` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:12.511239 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24b9de4-ff26-4f59-85a2-66d486210d7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2db963590c8046adaf0c011e6c892795)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:12.514936 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24b9de4-ff26-4f59-85a2-66d486210d7c admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:12.577728 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c24b9de4-ff26-4f59-85a2-66d486210d7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2db963590c8046adaf0c011e6c892795'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:12.590452 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c24b9de4-ff26-4f59-85a2-66d486210d7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2db963590c8046adaf0c011e6c892795'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:12.592003 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c24b9de4-ff26-4f59-85a2-66d486210d7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2db963590c8046adaf0c011e6c892795'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:12.593874 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c24b9de4-ff26-4f59-85a2-66d486210d7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2db963590c8046adaf0c011e6c892795'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:12.603397 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c24b9de4-ff26-4f59-85a2-66d486210d7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2db963590c8046adaf0c011e6c892795'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:12.627648 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1282/2582] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 15:04:12 2022] DELETE /identity/v3/users/2db963590c8046adaf0c011e6c892795 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:04:12.629555 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c999ee5-055a-47a2-bd7f-e27446df4af4 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:12.630295 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c999ee5-055a-47a2-bd7f-e27446df4af4 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:12.630295 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c999ee5-055a-47a2-bd7f-e27446df4af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:12.654464 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-1c999ee5-055a-47a2-bd7f-e27446df4af4 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:04:12.656012 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-1c999ee5-055a-47a2-bd7f-e27446df4af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:12.748442 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1301/2583] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:04:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:04:12.760165 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24b9de4-ff26-4f59-85a2-66d486210d7c admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:12.763311 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-c24b9de4-ff26-4f59-85a2-66d486210d7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:12.854941 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24b9de4-ff26-4f59-85a2-66d486210d7c admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:12.858646 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa583f48-7b2f-45d8-a95c-6a24b304e365 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:12.859258 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa583f48-7b2f-45d8-a95c-6a24b304e365 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:12.859530 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa583f48-7b2f-45d8-a95c-6a24b304e365 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:12.859802 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa583f48-7b2f-45d8-a95c-6a24b304e365 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:12.870775 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa583f48-7b2f-45d8-a95c-6a24b304e365 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:12.872190 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa583f48-7b2f-45d8-a95c-6a24b304e365 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:12.882795 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1283/2584] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:04:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:04:13.338646 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c999ee5-055a-47a2-bd7f-e27446df4af4 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:13.340458 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-1c999ee5-055a-47a2-bd7f-e27446df4af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:13.347754 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:13.366447 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c999ee5-055a-47a2-bd7f-e27446df4af4 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:13.381444 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca53146-020e-468f-9275-076c859f8e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:13.382222 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca53146-020e-468f-9275-076c859f8e2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:13.382390 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca53146-020e-468f-9275-076c859f8e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:13.382799 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca53146-020e-468f-9275-076c859f8e2a admin admin] PATH_INFO: `/v3/projects/e310a513ed9843559e213d9c04ca726f` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:13.384453 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca53146-020e-468f-9275-076c859f8e2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e310a513ed9843559e213d9c04ca726f)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:13.386854 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca53146-020e-468f-9275-076c859f8e2a admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:13.449316 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-6ca53146-020e-468f-9275-076c859f8e2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e310a513ed9843559e213d9c04ca726f', 'request_id': 'req-6ca53146-020e-468f-9275-076c859f8e2a'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:13.461737 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-6ca53146-020e-468f-9275-076c859f8e2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e310a513ed9843559e213d9c04ca726f', 'request_id': 'req-6ca53146-020e-468f-9275-076c859f8e2a'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:13.474117 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-6ca53146-020e-468f-9275-076c859f8e2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e310a513ed9843559e213d9c04ca726f', 'request_id': 'req-6ca53146-020e-468f-9275-076c859f8e2a'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:13.491377 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-6ca53146-020e-468f-9275-076c859f8e2a admin admin] The token cache is being invalidate because project e310a513ed9843559e213d9c04ca726f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:04:13.491833 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-6ca53146-020e-468f-9275-076c859f8e2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:13.492928 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-6ca53146-020e-468f-9275-076c859f8e2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:13.494842 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1302/2585] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 15:04:13 2022] DELETE /identity/v3/projects/e310a513ed9843559e213d9c04ca726f => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:04:13.499101 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa583f48-7b2f-45d8-a95c-6a24b304e365 service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:13.510622 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa583f48-7b2f-45d8-a95c-6a24b304e365 service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:13.551324 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:13.602523 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da88dba2-a205-4ae9-a9d9-6556448d93b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:13.603286 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da88dba2-a205-4ae9-a9d9-6556448d93b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:13.603760 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da88dba2-a205-4ae9-a9d9-6556448d93b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:13.604036 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da88dba2-a205-4ae9-a9d9-6556448d93b8 admin admin] PATH_INFO: `/v3/users/ef78e74282134566b1a0238ce25134c4` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:13.605285 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da88dba2-a205-4ae9-a9d9-6556448d93b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef78e74282134566b1a0238ce25134c4)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:13.607305 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da88dba2-a205-4ae9-a9d9-6556448d93b8 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:13.680680 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-da88dba2-a205-4ae9-a9d9-6556448d93b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef78e74282134566b1a0238ce25134c4'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:13.691972 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-da88dba2-a205-4ae9-a9d9-6556448d93b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef78e74282134566b1a0238ce25134c4'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:13.695171 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-da88dba2-a205-4ae9-a9d9-6556448d93b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef78e74282134566b1a0238ce25134c4'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:13.695808 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-da88dba2-a205-4ae9-a9d9-6556448d93b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef78e74282134566b1a0238ce25134c4'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:13.706211 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-da88dba2-a205-4ae9-a9d9-6556448d93b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef78e74282134566b1a0238ce25134c4'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:13.735841 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1284/2586] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 15:04:13 2022] DELETE /identity/v3/users/ef78e74282134566b1a0238ce25134c4 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:04:14.472382 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca53146-020e-468f-9275-076c859f8e2a admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:14.474304 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-6ca53146-020e-468f-9275-076c859f8e2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:14.492771 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca53146-020e-468f-9275-076c859f8e2a admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:14.558735 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611fb00e-224d-4f50-84c0-80fb4f713c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:14.559486 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611fb00e-224d-4f50-84c0-80fb4f713c57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:14.559820 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611fb00e-224d-4f50-84c0-80fb4f713c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:14.560227 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611fb00e-224d-4f50-84c0-80fb4f713c57 admin admin] PATH_INFO: `/v3/projects/15bc929eeb364a8888d74c1ced88e81f` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:14.561858 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611fb00e-224d-4f50-84c0-80fb4f713c57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15bc929eeb364a8888d74c1ced88e81f)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:14.564295 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611fb00e-224d-4f50-84c0-80fb4f713c57 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:14.629505 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-611fb00e-224d-4f50-84c0-80fb4f713c57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15bc929eeb364a8888d74c1ced88e81f', 'request_id': 'req-611fb00e-224d-4f50-84c0-80fb4f713c57'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:14.637546 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-611fb00e-224d-4f50-84c0-80fb4f713c57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15bc929eeb364a8888d74c1ced88e81f', 'request_id': 'req-611fb00e-224d-4f50-84c0-80fb4f713c57'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:14.647253 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-611fb00e-224d-4f50-84c0-80fb4f713c57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15bc929eeb364a8888d74c1ced88e81f', 'request_id': 'req-611fb00e-224d-4f50-84c0-80fb4f713c57'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:14.669319 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-611fb00e-224d-4f50-84c0-80fb4f713c57 admin admin] The token cache is being invalidate because project 15bc929eeb364a8888d74c1ced88e81f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:04:14.669635 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-611fb00e-224d-4f50-84c0-80fb4f713c57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:14.670249 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-611fb00e-224d-4f50-84c0-80fb4f713c57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:14.671740 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1303/2587] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 15:04:14 2022] DELETE /identity/v3/projects/15bc929eeb364a8888d74c1ced88e81f => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:04:14.676760 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f579294-350f-47b9-b698-36a7abf86f28 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:14.677287 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f579294-350f-47b9-b698-36a7abf86f28 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:14.677287 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f579294-350f-47b9-b698-36a7abf86f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:14.701346 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-6f579294-350f-47b9-b698-36a7abf86f28 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:04:14.702567 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-6f579294-350f-47b9-b698-36a7abf86f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:14.777636 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1285/2588] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:04:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:04:14.786207 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143c3b0-3a79-44a9-b60b-b773b73af822 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:14.786558 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143c3b0-3a79-44a9-b60b-b773b73af822 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:14.786744 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143c3b0-3a79-44a9-b60b-b773b73af822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:14.810559 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-8143c3b0-3a79-44a9-b60b-b773b73af822 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:04:14.811696 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-8143c3b0-3a79-44a9-b60b-b773b73af822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:14.821292 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1304/2589] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:04:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:04:14.826715 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f579294-350f-47b9-b698-36a7abf86f28 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:14.837248 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f579294-350f-47b9-b698-36a7abf86f28 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:14.842191 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792824a2-3bf2-43e8-984f-6afea6ccc1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:14.842793 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792824a2-3bf2-43e8-984f-6afea6ccc1ed admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:14.843225 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792824a2-3bf2-43e8-984f-6afea6ccc1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:14.843648 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792824a2-3bf2-43e8-984f-6afea6ccc1ed admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:14.844713 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792824a2-3bf2-43e8-984f-6afea6ccc1ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:04:14.845180 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792824a2-3bf2-43e8-984f-6afea6ccc1ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:14.847893 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792824a2-3bf2-43e8-984f-6afea6ccc1ed admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:14.865640 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1286/2590] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 19 15:04:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:04:14.871248 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8143c3b0-3a79-44a9-b60b-b773b73af822 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:14.881073 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8143c3b0-3a79-44a9-b60b-b773b73af822 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:14.886442 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25000cd3-4798-4809-98bf-106edadcdf02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:14.887053 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25000cd3-4798-4809-98bf-106edadcdf02 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:14.887325 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25000cd3-4798-4809-98bf-106edadcdf02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:14.887587 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25000cd3-4798-4809-98bf-106edadcdf02 admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:14.888225 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25000cd3-4798-4809-98bf-106edadcdf02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:14.890126 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25000cd3-4798-4809-98bf-106edadcdf02 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:14.895958 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:14.936969 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1305/2591] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 15:04:14 2022] POST /identity/v3/projects => generated 383 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 15:04:14.942079 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792824a2-3bf2-43e8-984f-6afea6ccc1ed admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:14.956917 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792824a2-3bf2-43e8-984f-6afea6ccc1ed admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:15.016889 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:15.045657 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b8442e-355a-4a61-b49d-0b556eb49620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:15.046321 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b8442e-355a-4a61-b49d-0b556eb49620 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:15.047869 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b8442e-355a-4a61-b49d-0b556eb49620 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:15.047869 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b8442e-355a-4a61-b49d-0b556eb49620 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:15.048265 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b8442e-355a-4a61-b49d-0b556eb49620 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:15.051467 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b8442e-355a-4a61-b49d-0b556eb49620 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:15.104089 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1287/2592] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 15:04:14 2022] POST /identity/v3/users => generated 292 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:04:15.106806 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25000cd3-4798-4809-98bf-106edadcdf02 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:15.129185 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25000cd3-4798-4809-98bf-106edadcdf02 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:15.143045 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df3af5e-42a3-4e8e-814b-bc8e66ae2c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:15.144232 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df3af5e-42a3-4e8e-814b-bc8e66ae2c9b admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:15.144595 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df3af5e-42a3-4e8e-814b-bc8e66ae2c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:15.152731 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df3af5e-42a3-4e8e-814b-bc8e66ae2c9b admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:15.152731 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df3af5e-42a3-4e8e-814b-bc8e66ae2c9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:15.154298 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df3af5e-42a3-4e8e-814b-bc8e66ae2c9b admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:15.171963 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1306/2593] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 15:04:15 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:04:15.176388 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b8442e-355a-4a61-b49d-0b556eb49620 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:15.194697 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b8442e-355a-4a61-b49d-0b556eb49620 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:15.203563 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c285bf4-0d41-4ca4-9e9b-707c17db008c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:15.204563 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c285bf4-0d41-4ca4-9e9b-707c17db008c admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:15.204939 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c285bf4-0d41-4ca4-9e9b-707c17db008c admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:15.205451 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c285bf4-0d41-4ca4-9e9b-707c17db008c admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:15.206566 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c285bf4-0d41-4ca4-9e9b-707c17db008c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:15.210599 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c285bf4-0d41-4ca4-9e9b-707c17db008c admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:15.235436 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1288/2594] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 15:04:15 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 15:04:15.237382 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df3af5e-42a3-4e8e-814b-bc8e66ae2c9b admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:15.273671 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df3af5e-42a3-4e8e-814b-bc8e66ae2c9b admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:15.279058 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779db033-ecc5-42c3-ba10-7c196321a16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:15.279746 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779db033-ecc5-42c3-ba10-7c196321a16c admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:15.280027 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779db033-ecc5-42c3-ba10-7c196321a16c admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:15.280298 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779db033-ecc5-42c3-ba10-7c196321a16c admin admin] PATH_INFO: `/v3/projects/494365ba3b9144b6947565c02a3b4f13/users/b15d03c4529b4953b8cb6f8348ab09eb/roles/74de6794e3b3422b93d26f993d260c35` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:15.302738 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779db033-ecc5-42c3-ba10-7c196321a16c admin admin] RBAC: Authorizing `identity:create_grant(project_id=494365ba3b9144b6947565c02a3b4f13, user_id=b15d03c4529b4953b8cb6f8348ab09eb, role_id=74de6794e3b3422b93d26f993d260c35)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:15.307943 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779db033-ecc5-42c3-ba10-7c196321a16c admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:15.332351 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1307/2595] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 15:04:15 2022] PUT /identity/v3/projects/494365ba3b9144b6947565c02a3b4f13/users/b15d03c4529b4953b8cb6f8348ab09eb/roles/74de6794e3b3422b93d26f993d260c35 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:04:15.351726 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff766a8-3639-46c3-a9a4-cfb6ccfb0dd5 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:15.351991 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff766a8-3639-46c3-a9a4-cfb6ccfb0dd5 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:15.352286 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff766a8-3639-46c3-a9a4-cfb6ccfb0dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:15.384962 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-9ff766a8-3639-46c3-a9a4-cfb6ccfb0dd5 None None] MFA Rules not processed for user `b15d03c4529b4953b8cb6f8348ab09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:04:15.386208 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-9ff766a8-3639-46c3-a9a4-cfb6ccfb0dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:15.486429 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1289/2596] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:04:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:04:15.492382 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779db033-ecc5-42c3-ba10-7c196321a16c admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:15.572276 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779db033-ecc5-42c3-ba10-7c196321a16c admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:15.579765 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc44232-b441-4f2c-9e95-d722f2f85d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:15.580429 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc44232-b441-4f2c-9e95-d722f2f85d09 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:15.580669 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc44232-b441-4f2c-9e95-d722f2f85d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:15.580956 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc44232-b441-4f2c-9e95-d722f2f85d09 admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:15.581621 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc44232-b441-4f2c-9e95-d722f2f85d09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:15.583613 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc44232-b441-4f2c-9e95-d722f2f85d09 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:15.627490 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1308/2597] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 15:04:15 2022] POST /identity/v3/projects => generated 383 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 15:04:15.634153 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff766a8-3639-46c3-a9a4-cfb6ccfb0dd5 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:15.646697 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff766a8-3639-46c3-a9a4-cfb6ccfb0dd5 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:15.728924 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e90b83-d8f5-4ace-8366-32825c510d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:15.730030 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e90b83-d8f5-4ace-8366-32825c510d0e admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:15.730519 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e90b83-d8f5-4ace-8366-32825c510d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:15.731001 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e90b83-d8f5-4ace-8366-32825c510d0e admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:15.732161 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e90b83-d8f5-4ace-8366-32825c510d0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:15.735929 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e90b83-d8f5-4ace-8366-32825c510d0e admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:15.765741 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1290/2598] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 15:04:15 2022] POST /identity/v3/users => generated 298 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 15:04:15.770429 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc44232-b441-4f2c-9e95-d722f2f85d09 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:15.783921 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc44232-b441-4f2c-9e95-d722f2f85d09 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:15.789200 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b647f282-66e2-4783-be27-a8fad1bba1cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:15.789933 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b647f282-66e2-4783-be27-a8fad1bba1cf admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:15.790247 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b647f282-66e2-4783-be27-a8fad1bba1cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:15.790548 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b647f282-66e2-4783-be27-a8fad1bba1cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:15.791278 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b647f282-66e2-4783-be27-a8fad1bba1cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:15.792963 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b647f282-66e2-4783-be27-a8fad1bba1cf admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:15.805112 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1309/2599] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 15:04:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:04:15.811130 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e90b83-d8f5-4ace-8366-32825c510d0e admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:15.823056 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e90b83-d8f5-4ace-8366-32825c510d0e admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:15.828932 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e16635-2e81-4c24-90de-6fe8202c849a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:15.829713 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e16635-2e81-4c24-90de-6fe8202c849a admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:15.830024 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e16635-2e81-4c24-90de-6fe8202c849a admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:15.830411 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e16635-2e81-4c24-90de-6fe8202c849a admin admin] PATH_INFO: `/v3/projects/2f62d7a6ed2e4e14b531e3f439204ccd/users/a489899fd05a432cb5990399957deef9/roles/019bde1756cb40de8ce06cef6b261f79` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:15.849469 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e16635-2e81-4c24-90de-6fe8202c849a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f62d7a6ed2e4e14b531e3f439204ccd, user_id=a489899fd05a432cb5990399957deef9, role_id=019bde1756cb40de8ce06cef6b261f79)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:15.852444 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e16635-2e81-4c24-90de-6fe8202c849a admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:15.873448 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1291/2600] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 15:04:15 2022] PUT /identity/v3/projects/2f62d7a6ed2e4e14b531e3f439204ccd/users/a489899fd05a432cb5990399957deef9/roles/019bde1756cb40de8ce06cef6b261f79 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:04:15.878677 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b647f282-66e2-4783-be27-a8fad1bba1cf admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:15.894944 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b647f282-66e2-4783-be27-a8fad1bba1cf admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:15.966690 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03215681-ce77-4e3a-a1d8-f5c5c453526d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:15.967354 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03215681-ce77-4e3a-a1d8-f5c5c453526d admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:15.967643 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03215681-ce77-4e3a-a1d8-f5c5c453526d admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:15.967930 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03215681-ce77-4e3a-a1d8-f5c5c453526d admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:15.969067 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03215681-ce77-4e3a-a1d8-f5c5c453526d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:15.970749 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03215681-ce77-4e3a-a1d8-f5c5c453526d admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:15.983274 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1310/2601] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 15:04:15 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:04:15.989170 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e16635-2e81-4c24-90de-6fe8202c849a admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:16.003707 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e16635-2e81-4c24-90de-6fe8202c849a admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:16.009113 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06beb49-e001-4c60-82cc-3c66aec119b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:16.009935 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06beb49-e001-4c60-82cc-3c66aec119b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:16.010389 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06beb49-e001-4c60-82cc-3c66aec119b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:16.010766 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06beb49-e001-4c60-82cc-3c66aec119b5 admin admin] PATH_INFO: `/v3/projects/2f62d7a6ed2e4e14b531e3f439204ccd/users/a489899fd05a432cb5990399957deef9/roles/019bde1756cb40de8ce06cef6b261f79` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:16.012930 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06beb49-e001-4c60-82cc-3c66aec119b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f62d7a6ed2e4e14b531e3f439204ccd, user_id=a489899fd05a432cb5990399957deef9, role_id=019bde1756cb40de8ce06cef6b261f79)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:16.015671 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06beb49-e001-4c60-82cc-3c66aec119b5 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:16.028589 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1292/2602] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 15:04:15 2022] PUT /identity/v3/projects/2f62d7a6ed2e4e14b531e3f439204ccd/users/a489899fd05a432cb5990399957deef9/roles/019bde1756cb40de8ce06cef6b261f79 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:04:16.040143 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e27bfe-5a9d-4d31-a35d-d597078c27a6 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:16.040426 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e27bfe-5a9d-4d31-a35d-d597078c27a6 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:16.040717 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e27bfe-5a9d-4d31-a35d-d597078c27a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:16.071306 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-e9e27bfe-5a9d-4d31-a35d-d597078c27a6 None None] MFA Rules not processed for user `a489899fd05a432cb5990399957deef9`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:04:16.072550 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-e9e27bfe-5a9d-4d31-a35d-d597078c27a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:16.083533 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:16.166110 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1311/2603] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:04:16 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:04:16.181662 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06beb49-e001-4c60-82cc-3c66aec119b5 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:16.183636 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e06beb49-e001-4c60-82cc-3c66aec119b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:16.191437 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:16.267103 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06beb49-e001-4c60-82cc-3c66aec119b5 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:16.275435 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff6d231-a2f0-4a56-8ac4-4868b619f952 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df648c909ddb41418128b43f925f5ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:16.276095 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff6d231-a2f0-4a56-8ac4-4868b619f952 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:16.276378 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff6d231-a2f0-4a56-8ac4-4868b619f952 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:16.276648 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff6d231-a2f0-4a56-8ac4-4868b619f952 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:16.295807 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff6d231-a2f0-4a56-8ac4-4868b619f952 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:16.297316 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff6d231-a2f0-4a56-8ac4-4868b619f952 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:16.309023 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1293/2604] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:04:16 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:04:16.469452 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e27bfe-5a9d-4d31-a35d-d597078c27a6 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:16.484781 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e27bfe-5a9d-4d31-a35d-d597078c27a6 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:16.496979 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13113357-cbe8-4d18-96ef-364d5e43e181 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df648c909ddb41418128b43f925f5ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:16.496979 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13113357-cbe8-4d18-96ef-364d5e43e181 service cinder] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:16.496979 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13113357-cbe8-4d18-96ef-364d5e43e181 service cinder] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:16.496979 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13113357-cbe8-4d18-96ef-364d5e43e181 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:16.574498 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13113357-cbe8-4d18-96ef-364d5e43e181 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:16.576592 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13113357-cbe8-4d18-96ef-364d5e43e181 service cinder] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:16.592438 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1312/2605] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:04:16 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:04:17.524367 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847ce3e1-1be5-44b3-baf7-86932fe2e0f1 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:17.525503 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847ce3e1-1be5-44b3-baf7-86932fe2e0f1 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:17.526058 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847ce3e1-1be5-44b3-baf7-86932fe2e0f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:17.571125 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-847ce3e1-1be5-44b3-baf7-86932fe2e0f1 None None] MFA Rules not processed for user `2c2b1ac1a17c43d28da8f7e9a199dea4`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:04:17.573811 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-847ce3e1-1be5-44b3-baf7-86932fe2e0f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:17.738345 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1294/2606] 10.222.0.26 () {58 vars in 967 bytes} [Mon Sep 19 15:04:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:04:17.773926 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13113357-cbe8-4d18-96ef-364d5e43e181 service cinder] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:17.775465 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-13113357-cbe8-4d18-96ef-364d5e43e181 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:17.874279 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13113357-cbe8-4d18-96ef-364d5e43e181 service cinder] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:17.881904 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208ebf53-8937-4371-9961-a81aeb7300cb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cb60a5e90343e69a38db4356cb3a90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:17.882867 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ebf53-8937-4371-9961-a81aeb7300cb service swift] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:17.883319 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ebf53-8937-4371-9961-a81aeb7300cb service swift] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:17.883766 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ebf53-8937-4371-9961-a81aeb7300cb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:17.898748 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208ebf53-8937-4371-9961-a81aeb7300cb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:17.901782 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208ebf53-8937-4371-9961-a81aeb7300cb service swift] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:17.923566 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1313/2607] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Sep 19 15:04:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 15:04:19.449420 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847ce3e1-1be5-44b3-baf7-86932fe2e0f1 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:19.571806 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847ce3e1-1be5-44b3-baf7-86932fe2e0f1 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:19.583749 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92598de3-efb9-4ed5-b904-767f45155a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:19.584471 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92598de3-efb9-4ed5-b904-767f45155a87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:19.584769 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92598de3-efb9-4ed5-b904-767f45155a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:19.585057 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92598de3-efb9-4ed5-b904-767f45155a87 admin admin] PATH_INFO: `/v3/users/b15d03c4529b4953b8cb6f8348ab09eb` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:19.586241 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92598de3-efb9-4ed5-b904-767f45155a87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b15d03c4529b4953b8cb6f8348ab09eb)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:19.588199 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92598de3-efb9-4ed5-b904-767f45155a87 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:19.642011 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-92598de3-efb9-4ed5-b904-767f45155a87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b15d03c4529b4953b8cb6f8348ab09eb'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:19.651164 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-92598de3-efb9-4ed5-b904-767f45155a87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b15d03c4529b4953b8cb6f8348ab09eb'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:19.651776 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-92598de3-efb9-4ed5-b904-767f45155a87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b15d03c4529b4953b8cb6f8348ab09eb'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:19.652404 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-92598de3-efb9-4ed5-b904-767f45155a87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b15d03c4529b4953b8cb6f8348ab09eb'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:19.653842 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:19.666124 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-92598de3-efb9-4ed5-b904-767f45155a87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b15d03c4529b4953b8cb6f8348ab09eb'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:19.691891 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1295/2608] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 15:04:19 2022] DELETE /identity/v3/users/b15d03c4529b4953b8cb6f8348ab09eb => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:04:19.697857 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e020ca-1e1c-49c3-8b17-f038308f6630 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:19.698733 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e020ca-1e1c-49c3-8b17-f038308f6630 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:19.698733 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e020ca-1e1c-49c3-8b17-f038308f6630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:19.720837 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-98e020ca-1e1c-49c3-8b17-f038308f6630 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:04:19.722167 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-98e020ca-1e1c-49c3-8b17-f038308f6630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:19.782696 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:19.828410 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1314/2609] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:04:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:04:19.840724 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92598de3-efb9-4ed5-b904-767f45155a87 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:19.843171 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-92598de3-efb9-4ed5-b904-767f45155a87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:19.946289 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92598de3-efb9-4ed5-b904-767f45155a87 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:19.951080 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10adf16c-5522-46fb-8393-63f500d8602e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:19.951776 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10adf16c-5522-46fb-8393-63f500d8602e service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:19.952062 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10adf16c-5522-46fb-8393-63f500d8602e service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:19.952335 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10adf16c-5522-46fb-8393-63f500d8602e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:19.972459 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10adf16c-5522-46fb-8393-63f500d8602e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:19.973971 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10adf16c-5522-46fb-8393-63f500d8602e service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:19.985749 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1296/2610] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:04:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:04:20.448336 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e020ca-1e1c-49c3-8b17-f038308f6630 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:20.451272 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-98e020ca-1e1c-49c3-8b17-f038308f6630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:20.468710 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e020ca-1e1c-49c3-8b17-f038308f6630 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:20.473522 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d18067-ea85-4ee5-90be-7a3a1737b4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:20.474185 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d18067-ea85-4ee5-90be-7a3a1737b4fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:20.475126 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d18067-ea85-4ee5-90be-7a3a1737b4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:20.475126 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d18067-ea85-4ee5-90be-7a3a1737b4fe admin admin] PATH_INFO: `/v3/projects/494365ba3b9144b6947565c02a3b4f13` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:20.476572 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d18067-ea85-4ee5-90be-7a3a1737b4fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=494365ba3b9144b6947565c02a3b4f13)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:20.478529 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d18067-ea85-4ee5-90be-7a3a1737b4fe admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:20.544460 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-58d18067-ea85-4ee5-90be-7a3a1737b4fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '494365ba3b9144b6947565c02a3b4f13', 'request_id': 'req-58d18067-ea85-4ee5-90be-7a3a1737b4fe'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:20.551451 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-58d18067-ea85-4ee5-90be-7a3a1737b4fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '494365ba3b9144b6947565c02a3b4f13', 'request_id': 'req-58d18067-ea85-4ee5-90be-7a3a1737b4fe'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:20.560948 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-58d18067-ea85-4ee5-90be-7a3a1737b4fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '494365ba3b9144b6947565c02a3b4f13', 'request_id': 'req-58d18067-ea85-4ee5-90be-7a3a1737b4fe'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:20.576258 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-58d18067-ea85-4ee5-90be-7a3a1737b4fe admin admin] The token cache is being invalidate because project 494365ba3b9144b6947565c02a3b4f13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:04:20.576539 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-58d18067-ea85-4ee5-90be-7a3a1737b4fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:20.577247 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-58d18067-ea85-4ee5-90be-7a3a1737b4fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:20.578803 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1315/2611] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 15:04:20 2022] DELETE /identity/v3/projects/494365ba3b9144b6947565c02a3b4f13 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:04:20.585078 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10adf16c-5522-46fb-8393-63f500d8602e service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:20.595354 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10adf16c-5522-46fb-8393-63f500d8602e service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:20.664367 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fb1f24-3b70-4cc5-a1ae-7904e76f8056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:20.665035 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb1f24-3b70-4cc5-a1ae-7904e76f8056 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:20.665321 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb1f24-3b70-4cc5-a1ae-7904e76f8056 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:20.665598 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb1f24-3b70-4cc5-a1ae-7904e76f8056 admin admin] PATH_INFO: `/v3/users/a489899fd05a432cb5990399957deef9` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:20.666742 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fb1f24-3b70-4cc5-a1ae-7904e76f8056 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a489899fd05a432cb5990399957deef9)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:20.668679 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fb1f24-3b70-4cc5-a1ae-7904e76f8056 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:20.729241 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-00fb1f24-3b70-4cc5-a1ae-7904e76f8056 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a489899fd05a432cb5990399957deef9'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:20.740273 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-00fb1f24-3b70-4cc5-a1ae-7904e76f8056 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a489899fd05a432cb5990399957deef9'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:20.741118 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-00fb1f24-3b70-4cc5-a1ae-7904e76f8056 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a489899fd05a432cb5990399957deef9'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:20.741595 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-00fb1f24-3b70-4cc5-a1ae-7904e76f8056 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a489899fd05a432cb5990399957deef9'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:20.749658 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-00fb1f24-3b70-4cc5-a1ae-7904e76f8056 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a489899fd05a432cb5990399957deef9'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:20.760773 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:20.770982 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1297/2612] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 15:04:20 2022] DELETE /identity/v3/users/a489899fd05a432cb5990399957deef9 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:04:21.132813 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d18067-ea85-4ee5-90be-7a3a1737b4fe admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:21.135123 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-58d18067-ea85-4ee5-90be-7a3a1737b4fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:21.157185 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d18067-ea85-4ee5-90be-7a3a1737b4fe admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:21.233425 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0455bbe7-a9a9-4f4e-ad82-2aedcc8eb6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:21.234423 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0455bbe7-a9a9-4f4e-ad82-2aedcc8eb6df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:21.234886 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0455bbe7-a9a9-4f4e-ad82-2aedcc8eb6df admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:21.235359 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0455bbe7-a9a9-4f4e-ad82-2aedcc8eb6df admin admin] PATH_INFO: `/v3/projects/2f62d7a6ed2e4e14b531e3f439204ccd` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:21.237158 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0455bbe7-a9a9-4f4e-ad82-2aedcc8eb6df admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f62d7a6ed2e4e14b531e3f439204ccd)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:21.240551 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0455bbe7-a9a9-4f4e-ad82-2aedcc8eb6df admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:21.297533 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-0455bbe7-a9a9-4f4e-ad82-2aedcc8eb6df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f62d7a6ed2e4e14b531e3f439204ccd', 'request_id': 'req-0455bbe7-a9a9-4f4e-ad82-2aedcc8eb6df'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:21.307099 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-0455bbe7-a9a9-4f4e-ad82-2aedcc8eb6df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f62d7a6ed2e4e14b531e3f439204ccd', 'request_id': 'req-0455bbe7-a9a9-4f4e-ad82-2aedcc8eb6df'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:21.318507 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-0455bbe7-a9a9-4f4e-ad82-2aedcc8eb6df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f62d7a6ed2e4e14b531e3f439204ccd', 'request_id': 'req-0455bbe7-a9a9-4f4e-ad82-2aedcc8eb6df'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:21.320190 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:21.337373 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-0455bbe7-a9a9-4f4e-ad82-2aedcc8eb6df admin admin] The token cache is being invalidate because project 2f62d7a6ed2e4e14b531e3f439204ccd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:04:21.337676 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-0455bbe7-a9a9-4f4e-ad82-2aedcc8eb6df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:21.338612 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-0455bbe7-a9a9-4f4e-ad82-2aedcc8eb6df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:21.340345 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1316/2613] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 15:04:21 2022] DELETE /identity/v3/projects/2f62d7a6ed2e4e14b531e3f439204ccd => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:04:21.345709 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bff626-50a2-4965-b631-23019575a525 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:21.346113 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bff626-50a2-4965-b631-23019575a525 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:21.346477 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bff626-50a2-4965-b631-23019575a525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:21.371071 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-26bff626-50a2-4965-b631-23019575a525 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:04:21.372591 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-26bff626-50a2-4965-b631-23019575a525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:21.474750 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1298/2614] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:04:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:04:21.487119 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4eaceb-a41e-480d-a870-856253a2d98e None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:21.487569 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4eaceb-a41e-480d-a870-856253a2d98e None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:21.488040 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4eaceb-a41e-480d-a870-856253a2d98e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:21.516646 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-7f4eaceb-a41e-480d-a870-856253a2d98e None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:04:21.518166 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-7f4eaceb-a41e-480d-a870-856253a2d98e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:21.528969 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1317/2615] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:04:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:04:21.534673 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bff626-50a2-4965-b631-23019575a525 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:21.551251 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bff626-50a2-4965-b631-23019575a525 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:21.558293 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2643628d-3df0-466d-b6a7-7c32b13170fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:21.558925 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2643628d-3df0-466d-b6a7-7c32b13170fb admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:21.559201 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2643628d-3df0-466d-b6a7-7c32b13170fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:21.559470 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2643628d-3df0-466d-b6a7-7c32b13170fb admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:21.560138 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2643628d-3df0-466d-b6a7-7c32b13170fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:04:21.560499 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2643628d-3df0-466d-b6a7-7c32b13170fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:21.562176 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2643628d-3df0-466d-b6a7-7c32b13170fb admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:21.584394 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1299/2616] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 19 15:04:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:04:21.589258 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4eaceb-a41e-480d-a870-856253a2d98e None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:21.602040 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4eaceb-a41e-480d-a870-856253a2d98e None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:21.610087 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f857ce3-c158-4e3a-ac2c-21568bd96613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:21.611241 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f857ce3-c158-4e3a-ac2c-21568bd96613 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:21.612008 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f857ce3-c158-4e3a-ac2c-21568bd96613 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:21.612202 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f857ce3-c158-4e3a-ac2c-21568bd96613 admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:21.613445 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f857ce3-c158-4e3a-ac2c-21568bd96613 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:21.617195 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f857ce3-c158-4e3a-ac2c-21568bd96613 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:21.660593 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1318/2617] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 15:04:21 2022] POST /identity/v3/projects => generated 385 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 15:04:21.667950 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2643628d-3df0-466d-b6a7-7c32b13170fb admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:21.687336 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2643628d-3df0-466d-b6a7-7c32b13170fb admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:21.765880 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d406ff-49eb-4a0b-bf9e-1a24196f87a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:21.766546 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d406ff-49eb-4a0b-bf9e-1a24196f87a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:21.766816 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d406ff-49eb-4a0b-bf9e-1a24196f87a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:21.767235 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d406ff-49eb-4a0b-bf9e-1a24196f87a3 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:21.767875 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d406ff-49eb-4a0b-bf9e-1a24196f87a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:21.769950 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d406ff-49eb-4a0b-bf9e-1a24196f87a3 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:21.800134 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1300/2618] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 15:04:21 2022] POST /identity/v3/users => generated 293 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:04:21.805381 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f857ce3-c158-4e3a-ac2c-21568bd96613 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:21.816491 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f857ce3-c158-4e3a-ac2c-21568bd96613 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:21.821748 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a4f1f7-fb5c-403e-96bb-10cfd4e88ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:21.822365 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a4f1f7-fb5c-403e-96bb-10cfd4e88ac6 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:21.822636 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a4f1f7-fb5c-403e-96bb-10cfd4e88ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:21.822939 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a4f1f7-fb5c-403e-96bb-10cfd4e88ac6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:21.824375 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a4f1f7-fb5c-403e-96bb-10cfd4e88ac6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:21.825859 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a4f1f7-fb5c-403e-96bb-10cfd4e88ac6 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:21.838034 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1319/2619] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 15:04:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 15:04:21.842905 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d406ff-49eb-4a0b-bf9e-1a24196f87a3 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:21.854825 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d406ff-49eb-4a0b-bf9e-1a24196f87a3 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:21.860575 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34e5950-0f74-4899-8c73-d45c810e0370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:21.861235 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34e5950-0f74-4899-8c73-d45c810e0370 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:21.861516 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34e5950-0f74-4899-8c73-d45c810e0370 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:21.861789 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34e5950-0f74-4899-8c73-d45c810e0370 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:21.862447 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34e5950-0f74-4899-8c73-d45c810e0370 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:21.864106 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34e5950-0f74-4899-8c73-d45c810e0370 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:21.878299 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1301/2620] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 15:04:21 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:04:21.883033 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a4f1f7-fb5c-403e-96bb-10cfd4e88ac6 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:21.894083 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a4f1f7-fb5c-403e-96bb-10cfd4e88ac6 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:21.900159 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c553018-9d72-4e3c-9570-cc3ead27db18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:21.900843 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c553018-9d72-4e3c-9570-cc3ead27db18 admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:21.901155 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c553018-9d72-4e3c-9570-cc3ead27db18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:21.901427 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c553018-9d72-4e3c-9570-cc3ead27db18 admin admin] PATH_INFO: `/v3/projects/779b65f8dfaf420ea0c4d170d8644d73/users/47938dea1a8442f58bb449451c7e5941/roles/74de6794e3b3422b93d26f993d260c35` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:21.920563 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c553018-9d72-4e3c-9570-cc3ead27db18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=779b65f8dfaf420ea0c4d170d8644d73, user_id=47938dea1a8442f58bb449451c7e5941, role_id=74de6794e3b3422b93d26f993d260c35)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:21.923649 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c553018-9d72-4e3c-9570-cc3ead27db18 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:21.944194 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1320/2621] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 15:04:21 2022] PUT /identity/v3/projects/779b65f8dfaf420ea0c4d170d8644d73/users/47938dea1a8442f58bb449451c7e5941/roles/74de6794e3b3422b93d26f993d260c35 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:04:21.961849 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8258d602-45f5-4d30-816c-47ff6dd5195c None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:21.962132 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8258d602-45f5-4d30-816c-47ff6dd5195c None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:21.962392 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8258d602-45f5-4d30-816c-47ff6dd5195c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:22.010529 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-8258d602-45f5-4d30-816c-47ff6dd5195c None None] MFA Rules not processed for user `47938dea1a8442f58bb449451c7e5941`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:04:22.011834 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-8258d602-45f5-4d30-816c-47ff6dd5195c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:22.078650 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:22.111676 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1302/2622] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:04:21 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:04:22.127811 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c553018-9d72-4e3c-9570-cc3ead27db18 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:22.130518 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-0c553018-9d72-4e3c-9570-cc3ead27db18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:22.208429 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c553018-9d72-4e3c-9570-cc3ead27db18 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:22.212741 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7034a2-99ec-475f-b94c-2f6502ef7b2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df648c909ddb41418128b43f925f5ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:22.213407 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7034a2-99ec-475f-b94c-2f6502ef7b2f service cinder] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:22.213689 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7034a2-99ec-475f-b94c-2f6502ef7b2f service cinder] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:22.213965 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7034a2-99ec-475f-b94c-2f6502ef7b2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:22.223946 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7034a2-99ec-475f-b94c-2f6502ef7b2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:22.225766 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7034a2-99ec-475f-b94c-2f6502ef7b2f service cinder] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:22.236422 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1321/2623] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:04:22 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:04:28.026822 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8258d602-45f5-4d30-816c-47ff6dd5195c None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:28.153066 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8258d602-45f5-4d30-816c-47ff6dd5195c None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:28.161108 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec4bf5c-c213-45f4-bd0e-c8809c030bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:28.162121 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4bf5c-c213-45f4-bd0e-c8809c030bc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:28.162493 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4bf5c-c213-45f4-bd0e-c8809c030bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:28.162841 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4bf5c-c213-45f4-bd0e-c8809c030bc9 admin admin] PATH_INFO: `/v3/users/47938dea1a8442f58bb449451c7e5941` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:28.164324 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec4bf5c-c213-45f4-bd0e-c8809c030bc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47938dea1a8442f58bb449451c7e5941)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:28.167066 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec4bf5c-c213-45f4-bd0e-c8809c030bc9 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:28.255835 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-1ec4bf5c-c213-45f4-bd0e-c8809c030bc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47938dea1a8442f58bb449451c7e5941'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:28.279988 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-1ec4bf5c-c213-45f4-bd0e-c8809c030bc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47938dea1a8442f58bb449451c7e5941'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:28.279988 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-1ec4bf5c-c213-45f4-bd0e-c8809c030bc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47938dea1a8442f58bb449451c7e5941'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:28.279988 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-1ec4bf5c-c213-45f4-bd0e-c8809c030bc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47938dea1a8442f58bb449451c7e5941'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:28.298897 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-1ec4bf5c-c213-45f4-bd0e-c8809c030bc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47938dea1a8442f58bb449451c7e5941'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:28.333506 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1303/2624] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 15:04:28 2022] DELETE /identity/v3/users/47938dea1a8442f58bb449451c7e5941 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:04:28.338924 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d961789a-781c-403f-84d5-d0c8902109c0 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:28.339456 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d961789a-781c-403f-84d5-d0c8902109c0 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:28.339794 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d961789a-781c-403f-84d5-d0c8902109c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:28.370151 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-d961789a-781c-403f-84d5-d0c8902109c0 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:04:28.372964 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-d961789a-781c-403f-84d5-d0c8902109c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:28.501312 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1322/2625] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:04:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:04:28.502862 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec4bf5c-c213-45f4-bd0e-c8809c030bc9 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:28.505121 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-1ec4bf5c-c213-45f4-bd0e-c8809c030bc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:28.516753 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d961789a-781c-403f-84d5-d0c8902109c0 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:28.519459 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-d961789a-781c-403f-84d5-d0c8902109c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:28.565877 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:28.602266 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec4bf5c-c213-45f4-bd0e-c8809c030bc9 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:28.608437 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02e0a99-77d4-48ad-a417-aa1d4faf6128 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:28.608727 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d961789a-781c-403f-84d5-d0c8902109c0 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:28.609105 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02e0a99-77d4-48ad-a417-aa1d4faf6128 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:28.609389 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02e0a99-77d4-48ad-a417-aa1d4faf6128 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:28.609780 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02e0a99-77d4-48ad-a417-aa1d4faf6128 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:28.611760 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a02e0a99-77d4-48ad-a417-aa1d4faf6128 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:28.612338 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32957d42-39ec-46b1-8e79-374239828749 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:28.613015 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32957d42-39ec-46b1-8e79-374239828749 service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:28.613315 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32957d42-39ec-46b1-8e79-374239828749 service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:28.613651 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32957d42-39ec-46b1-8e79-374239828749 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:28.631576 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32957d42-39ec-46b1-8e79-374239828749 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:28.633126 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32957d42-39ec-46b1-8e79-374239828749 service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:28.641864 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:28.644476 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1323/2626] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:04:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 15:04:28.705667 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02e0a99-77d4-48ad-a417-aa1d4faf6128 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:28.707212 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02e0a99-77d4-48ad-a417-aa1d4faf6128 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:28.718869 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1304/2627] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:04:28 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:04:29.230017 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32957d42-39ec-46b1-8e79-374239828749 service neutron] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:29.232427 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-32957d42-39ec-46b1-8e79-374239828749 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:29.255581 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32957d42-39ec-46b1-8e79-374239828749 service neutron] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:29.260956 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1ec136-5e5c-4b84-883f-e34a457da0ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:29.261790 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ec136-5e5c-4b84-883f-e34a457da0ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:29.262170 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ec136-5e5c-4b84-883f-e34a457da0ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:29.262538 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ec136-5e5c-4b84-883f-e34a457da0ae admin admin] PATH_INFO: `/v3/projects/779b65f8dfaf420ea0c4d170d8644d73` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:29.263868 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1ec136-5e5c-4b84-883f-e34a457da0ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=779b65f8dfaf420ea0c4d170d8644d73)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:29.265956 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1ec136-5e5c-4b84-883f-e34a457da0ae admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:29.345852 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-3e1ec136-5e5c-4b84-883f-e34a457da0ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '779b65f8dfaf420ea0c4d170d8644d73', 'request_id': 'req-3e1ec136-5e5c-4b84-883f-e34a457da0ae'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:29.353662 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-3e1ec136-5e5c-4b84-883f-e34a457da0ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '779b65f8dfaf420ea0c4d170d8644d73', 'request_id': 'req-3e1ec136-5e5c-4b84-883f-e34a457da0ae'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:29.368102 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-3e1ec136-5e5c-4b84-883f-e34a457da0ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '779b65f8dfaf420ea0c4d170d8644d73', 'request_id': 'req-3e1ec136-5e5c-4b84-883f-e34a457da0ae'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:29.384890 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-3e1ec136-5e5c-4b84-883f-e34a457da0ae admin admin] The token cache is being invalidate because project 779b65f8dfaf420ea0c4d170d8644d73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:04:29.385491 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-3e1ec136-5e5c-4b84-883f-e34a457da0ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:29.386670 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-3e1ec136-5e5c-4b84-883f-e34a457da0ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:29.388875 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1324/2628] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 15:04:29 2022] DELETE /identity/v3/projects/779b65f8dfaf420ea0c4d170d8644d73 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:04:29.398357 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e682a-f0b4-48ca-bbae-5acff0caa133 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:29.398357 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e682a-f0b4-48ca-bbae-5acff0caa133 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:29.398357 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e682a-f0b4-48ca-bbae-5acff0caa133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:29.458467 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-b02e682a-f0b4-48ca-bbae-5acff0caa133 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:04:29.461291 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b02e682a-f0b4-48ca-bbae-5acff0caa133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:29.609187 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1305/2629] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:04:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:04:29.615948 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06923b83-41c1-49a4-aa62-cc5a6882c2b3 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:29.616432 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06923b83-41c1-49a4-aa62-cc5a6882c2b3 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:29.616788 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06923b83-41c1-49a4-aa62-cc5a6882c2b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:29.658316 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-06923b83-41c1-49a4-aa62-cc5a6882c2b3 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:04:29.660244 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-06923b83-41c1-49a4-aa62-cc5a6882c2b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:29.671046 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1325/2630] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:04:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:04:29.678488 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02e682a-f0b4-48ca-bbae-5acff0caa133 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:29.694365 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02e682a-f0b4-48ca-bbae-5acff0caa133 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:29.702339 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2e11cb-91b1-468b-891b-9feef00d3580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:29.703916 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e11cb-91b1-468b-891b-9feef00d3580 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:29.704203 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e11cb-91b1-468b-891b-9feef00d3580 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:29.704519 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e11cb-91b1-468b-891b-9feef00d3580 admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:29.705160 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2e11cb-91b1-468b-891b-9feef00d3580 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:04:29.706579 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2e11cb-91b1-468b-891b-9feef00d3580 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:29.707942 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2e11cb-91b1-468b-891b-9feef00d3580 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:29.725979 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1306/2631] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 19 15:04:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:04:29.732853 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06923b83-41c1-49a4-aa62-cc5a6882c2b3 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:29.754026 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06923b83-41c1-49a4-aa62-cc5a6882c2b3 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:29.762137 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73627682-df49-446a-97c3-cb29f8359a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:29.762914 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73627682-df49-446a-97c3-cb29f8359a7d admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:29.763136 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73627682-df49-446a-97c3-cb29f8359a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:29.763408 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73627682-df49-446a-97c3-cb29f8359a7d admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:29.764119 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73627682-df49-446a-97c3-cb29f8359a7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:29.766445 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73627682-df49-446a-97c3-cb29f8359a7d admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:29.808791 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1326/2632] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 15:04:29 2022] POST /identity/v3/projects => generated 369 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:04:29.814891 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2e11cb-91b1-468b-891b-9feef00d3580 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:29.829989 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2e11cb-91b1-468b-891b-9feef00d3580 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:29.925052 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4354e70-770a-4d22-84c8-74e4781cedd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:29.926623 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4354e70-770a-4d22-84c8-74e4781cedd3 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:29.927310 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4354e70-770a-4d22-84c8-74e4781cedd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:29.928822 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4354e70-770a-4d22-84c8-74e4781cedd3 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:29.929759 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4354e70-770a-4d22-84c8-74e4781cedd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:29.933709 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4354e70-770a-4d22-84c8-74e4781cedd3 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:29.961438 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1307/2633] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 15:04:29 2022] POST /identity/v3/users => generated 285 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:04:29.965908 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73627682-df49-446a-97c3-cb29f8359a7d admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:29.981338 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73627682-df49-446a-97c3-cb29f8359a7d admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:29.997915 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5131c8-9d28-45d1-acec-b8efbb8c9280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:29.998825 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5131c8-9d28-45d1-acec-b8efbb8c9280 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:29.999206 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5131c8-9d28-45d1-acec-b8efbb8c9280 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:29.999580 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5131c8-9d28-45d1-acec-b8efbb8c9280 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:30.000364 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5131c8-9d28-45d1-acec-b8efbb8c9280 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:30.002259 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5131c8-9d28-45d1-acec-b8efbb8c9280 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:30.017567 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1327/2634] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 15:04:29 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:04:30.022420 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4354e70-770a-4d22-84c8-74e4781cedd3 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:30.035556 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4354e70-770a-4d22-84c8-74e4781cedd3 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:30.044563 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adb97cf-535a-4628-9829-b4268e05f3bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:30.045558 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb97cf-535a-4628-9829-b4268e05f3bc admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:30.045998 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb97cf-535a-4628-9829-b4268e05f3bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:30.046459 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb97cf-535a-4628-9829-b4268e05f3bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:30.047543 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adb97cf-535a-4628-9829-b4268e05f3bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:30.050330 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adb97cf-535a-4628-9829-b4268e05f3bc admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:30.071995 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1308/2635] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 15:04:30 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:04:30.076523 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5131c8-9d28-45d1-acec-b8efbb8c9280 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:30.089241 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5131c8-9d28-45d1-acec-b8efbb8c9280 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:30.094417 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cf7039-bfff-4358-8c63-e619d535eb9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:30.095949 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf7039-bfff-4358-8c63-e619d535eb9f admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:30.096118 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf7039-bfff-4358-8c63-e619d535eb9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:30.096381 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf7039-bfff-4358-8c63-e619d535eb9f admin admin] PATH_INFO: `/v3/projects/37bab496de2046dfa7281599cd0e06bb/users/c1b62f80ef794d518662bac549320d4a/roles/74de6794e3b3422b93d26f993d260c35` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:30.121642 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cf7039-bfff-4358-8c63-e619d535eb9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=37bab496de2046dfa7281599cd0e06bb, user_id=c1b62f80ef794d518662bac549320d4a, role_id=74de6794e3b3422b93d26f993d260c35)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:30.130645 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cf7039-bfff-4358-8c63-e619d535eb9f admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:30.150553 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1328/2636] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 15:04:30 2022] PUT /identity/v3/projects/37bab496de2046dfa7281599cd0e06bb/users/c1b62f80ef794d518662bac549320d4a/roles/74de6794e3b3422b93d26f993d260c35 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:04:30.165759 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d16460-04f3-4c8e-b295-adf6da4672cb None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:30.166268 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d16460-04f3-4c8e-b295-adf6da4672cb None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:30.166697 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d16460-04f3-4c8e-b295-adf6da4672cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:30.214576 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-05d16460-04f3-4c8e-b295-adf6da4672cb None None] MFA Rules not processed for user `c1b62f80ef794d518662bac549320d4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:04:30.216094 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-05d16460-04f3-4c8e-b295-adf6da4672cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:30.239932 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:30.345687 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1309/2637] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:04:30 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:04:30.355301 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cf7039-bfff-4358-8c63-e619d535eb9f admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:30.365556 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-65cf7039-bfff-4358-8c63-e619d535eb9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:30.507337 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cf7039-bfff-4358-8c63-e619d535eb9f admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:30.512913 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d29c98-f9e3-468c-98f4-968b024444b1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d4e9c3da83402dbe7938aaf2dcbb8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:30.513858 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d29c98-f9e3-468c-98f4-968b024444b1 service glance] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:30.514263 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d29c98-f9e3-468c-98f4-968b024444b1 service glance] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:30.514568 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d29c98-f9e3-468c-98f4-968b024444b1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:30.525865 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:30.533634 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d29c98-f9e3-468c-98f4-968b024444b1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:30.536131 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d29c98-f9e3-468c-98f4-968b024444b1 service glance] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:30.561169 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1329/2638] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:04:30 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:04:40.337427 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=21 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:40.561433 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=3 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:42.655097 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d16460-04f3-4c8e-b295-adf6da4672cb None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:42.657650 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-05d16460-04f3-4c8e-b295-adf6da4672cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:42.731097 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d16460-04f3-4c8e-b295-adf6da4672cb None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:42.737141 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02560ec5-9116-4c47-992b-bc257b82bb5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:42.738171 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02560ec5-9116-4c47-992b-bc257b82bb5b service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:42.738673 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02560ec5-9116-4c47-992b-bc257b82bb5b service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:42.739218 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02560ec5-9116-4c47-992b-bc257b82bb5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:42.742362 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-02560ec5-9116-4c47-992b-bc257b82bb5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:42.833498 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02560ec5-9116-4c47-992b-bc257b82bb5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:42.834968 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02560ec5-9116-4c47-992b-bc257b82bb5b service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:42.851119 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1310/2639] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:04:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 15:04:46.925725 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d29c98-f9e3-468c-98f4-968b024444b1 service glance] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:46.928107 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-09d29c98-f9e3-468c-98f4-968b024444b1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:46.952475 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d29c98-f9e3-468c-98f4-968b024444b1 service glance] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:46.959939 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2990621-4efc-4350-b885-37d2c264e034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:46.960727 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2990621-4efc-4350-b885-37d2c264e034 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:46.961140 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2990621-4efc-4350-b885-37d2c264e034 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:46.961498 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2990621-4efc-4350-b885-37d2c264e034 admin admin] PATH_INFO: `/v3/users/53fe9d2b2e8b4d22acb170b18f697515` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:46.962780 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2990621-4efc-4350-b885-37d2c264e034 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53fe9d2b2e8b4d22acb170b18f697515)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:46.965043 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2990621-4efc-4350-b885-37d2c264e034 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:47.038936 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-b2990621-4efc-4350-b885-37d2c264e034 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53fe9d2b2e8b4d22acb170b18f697515'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:47.051658 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-b2990621-4efc-4350-b885-37d2c264e034 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53fe9d2b2e8b4d22acb170b18f697515'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:47.053049 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-b2990621-4efc-4350-b885-37d2c264e034 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53fe9d2b2e8b4d22acb170b18f697515'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:47.053897 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-b2990621-4efc-4350-b885-37d2c264e034 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53fe9d2b2e8b4d22acb170b18f697515'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:47.072150 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-b2990621-4efc-4350-b885-37d2c264e034 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53fe9d2b2e8b4d22acb170b18f697515'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:47.086601 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1330/2640] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 15:04:46 2022] DELETE /identity/v3/users/53fe9d2b2e8b4d22acb170b18f697515 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:04:47.280257 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02560ec5-9116-4c47-992b-bc257b82bb5b service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:47.295137 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02560ec5-9116-4c47-992b-bc257b82bb5b service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:47.364254 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfd4b87-e502-47c5-9e69-0efc0386518e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:47.364919 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd4b87-e502-47c5-9e69-0efc0386518e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:47.365225 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd4b87-e502-47c5-9e69-0efc0386518e admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:47.365622 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd4b87-e502-47c5-9e69-0efc0386518e admin admin] PATH_INFO: `/v3/projects/545bb63f05564531a5a0cba573041f9c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:47.367244 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfd4b87-e502-47c5-9e69-0efc0386518e admin admin] RBAC: Authorizing `identity:delete_project(project_id=545bb63f05564531a5a0cba573041f9c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:47.369185 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfd4b87-e502-47c5-9e69-0efc0386518e admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:47.421286 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2bfd4b87-e502-47c5-9e69-0efc0386518e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '545bb63f05564531a5a0cba573041f9c', 'request_id': 'req-2bfd4b87-e502-47c5-9e69-0efc0386518e'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:47.423240 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:47.429222 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2bfd4b87-e502-47c5-9e69-0efc0386518e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '545bb63f05564531a5a0cba573041f9c', 'request_id': 'req-2bfd4b87-e502-47c5-9e69-0efc0386518e'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:47.439114 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2bfd4b87-e502-47c5-9e69-0efc0386518e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '545bb63f05564531a5a0cba573041f9c', 'request_id': 'req-2bfd4b87-e502-47c5-9e69-0efc0386518e'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:47.452610 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2bfd4b87-e502-47c5-9e69-0efc0386518e admin admin] The token cache is being invalidate because project 545bb63f05564531a5a0cba573041f9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:04:47.452959 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2bfd4b87-e502-47c5-9e69-0efc0386518e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:47.453575 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2bfd4b87-e502-47c5-9e69-0efc0386518e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:47.455137 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1311/2641] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 15:04:47 2022] DELETE /identity/v3/projects/545bb63f05564531a5a0cba573041f9c => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:04:47.460738 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8211c4e-686d-4c91-a5cc-afe321634f83 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:47.461060 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8211c4e-686d-4c91-a5cc-afe321634f83 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:47.461338 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8211c4e-686d-4c91-a5cc-afe321634f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:47.483847 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-c8211c4e-686d-4c91-a5cc-afe321634f83 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:04:47.485212 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-c8211c4e-686d-4c91-a5cc-afe321634f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:47.560781 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1331/2642] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:04:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:04:47.569071 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06696c18-b29b-4c66-bd24-b1edae731efa None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:47.569446 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06696c18-b29b-4c66-bd24-b1edae731efa None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:47.569787 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06696c18-b29b-4c66-bd24-b1edae731efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:47.601763 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-06696c18-b29b-4c66-bd24-b1edae731efa None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:04:47.603032 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-06696c18-b29b-4c66-bd24-b1edae731efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:47.611527 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1312/2643] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:04:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:04:47.616656 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8211c4e-686d-4c91-a5cc-afe321634f83 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:47.627753 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8211c4e-686d-4c91-a5cc-afe321634f83 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:47.632784 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb560b-be8b-4d0e-9968-9f55000fa820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:47.633416 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb560b-be8b-4d0e-9968-9f55000fa820 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:47.633685 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb560b-be8b-4d0e-9968-9f55000fa820 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:47.633949 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb560b-be8b-4d0e-9968-9f55000fa820 admin admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:47.634620 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cb560b-be8b-4d0e-9968-9f55000fa820 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:04:47.634925 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cb560b-be8b-4d0e-9968-9f55000fa820 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:47.636523 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cb560b-be8b-4d0e-9968-9f55000fa820 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:47.649722 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1332/2644] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 19 15:04:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:04:47.654892 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06696c18-b29b-4c66-bd24-b1edae731efa None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:47.665214 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06696c18-b29b-4c66-bd24-b1edae731efa None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:47.670977 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c270ab02-350d-4ebb-a882-fc7d57a6cf30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:47.671594 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c270ab02-350d-4ebb-a882-fc7d57a6cf30 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:47.671867 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c270ab02-350d-4ebb-a882-fc7d57a6cf30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:47.672145 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c270ab02-350d-4ebb-a882-fc7d57a6cf30 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:47.672774 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c270ab02-350d-4ebb-a882-fc7d57a6cf30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:47.674743 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c270ab02-350d-4ebb-a882-fc7d57a6cf30 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:47.708183 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1313/2645] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 15:04:47 2022] POST /identity/v3/projects => generated 387 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:04:47.713258 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb560b-be8b-4d0e-9968-9f55000fa820 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:47.724896 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb560b-be8b-4d0e-9968-9f55000fa820 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:47.796133 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41048c35-0e33-44c9-8155-9c6998ee324b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:47.796691 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41048c35-0e33-44c9-8155-9c6998ee324b admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:47.796970 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41048c35-0e33-44c9-8155-9c6998ee324b admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:47.797272 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41048c35-0e33-44c9-8155-9c6998ee324b admin admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:47.797983 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41048c35-0e33-44c9-8155-9c6998ee324b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:47.800012 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41048c35-0e33-44c9-8155-9c6998ee324b admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:47.810008 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:47.836365 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1333/2646] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 15:04:47 2022] POST /identity/v3/users => generated 294 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:04:47.837753 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c270ab02-350d-4ebb-a882-fc7d57a6cf30 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:47.850774 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c270ab02-350d-4ebb-a882-fc7d57a6cf30 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:47.856367 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d28a4d-b0e5-407a-bfb2-2252611788fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:47.856979 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d28a4d-b0e5-407a-bfb2-2252611788fa admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:47.857286 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d28a4d-b0e5-407a-bfb2-2252611788fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:47.857556 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d28a4d-b0e5-407a-bfb2-2252611788fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:47.858200 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d28a4d-b0e5-407a-bfb2-2252611788fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:47.859801 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d28a4d-b0e5-407a-bfb2-2252611788fa admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:47.871607 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1314/2647] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 15:04:47 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:04:47.876156 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41048c35-0e33-44c9-8155-9c6998ee324b admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:47.887280 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41048c35-0e33-44c9-8155-9c6998ee324b admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:47.892539 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57864cf3-4c5a-4915-b2d9-4eb4c8fb8fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:47.893224 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57864cf3-4c5a-4915-b2d9-4eb4c8fb8fd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:47.893478 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57864cf3-4c5a-4915-b2d9-4eb4c8fb8fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:47.893751 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57864cf3-4c5a-4915-b2d9-4eb4c8fb8fd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:47.894406 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57864cf3-4c5a-4915-b2d9-4eb4c8fb8fd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:47.896377 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57864cf3-4c5a-4915-b2d9-4eb4c8fb8fd6 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:47.908546 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1334/2648] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 15:04:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:04:47.913494 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d28a4d-b0e5-407a-bfb2-2252611788fa admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:47.924337 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d28a4d-b0e5-407a-bfb2-2252611788fa admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:47.930631 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74267ed5-732f-4a9b-aeae-645b36085cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:47.931304 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74267ed5-732f-4a9b-aeae-645b36085cbf admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:47.931603 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74267ed5-732f-4a9b-aeae-645b36085cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:47.931863 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74267ed5-732f-4a9b-aeae-645b36085cbf admin admin] PATH_INFO: `/v3/projects/4cb3a848530f4e1492050c642c7fb346/users/74366a9bb48348418f2d0a2c819c01b7/roles/74de6794e3b3422b93d26f993d260c35` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:47.956981 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74267ed5-732f-4a9b-aeae-645b36085cbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cb3a848530f4e1492050c642c7fb346, user_id=74366a9bb48348418f2d0a2c819c01b7, role_id=74de6794e3b3422b93d26f993d260c35)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:47.960089 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74267ed5-732f-4a9b-aeae-645b36085cbf admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:47.978138 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1315/2649] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 15:04:47 2022] PUT /identity/v3/projects/4cb3a848530f4e1492050c642c7fb346/users/74366a9bb48348418f2d0a2c819c01b7/roles/74de6794e3b3422b93d26f993d260c35 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:04:47.989402 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52490b7-78f9-4fe6-8a2e-545bab8ae497 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:47.990324 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52490b7-78f9-4fe6-8a2e-545bab8ae497 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:47.990324 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52490b7-78f9-4fe6-8a2e-545bab8ae497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:48.025437 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-f52490b7-78f9-4fe6-8a2e-545bab8ae497 None None] MFA Rules not processed for user `74366a9bb48348418f2d0a2c819c01b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:04:48.026709 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-f52490b7-78f9-4fe6-8a2e-545bab8ae497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:48.111675 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1335/2650] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:04:47 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:04:48.117228 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74267ed5-732f-4a9b-aeae-645b36085cbf admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:48.182916 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74267ed5-732f-4a9b-aeae-645b36085cbf admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:48.187893 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce04462-19e9-4c8b-9dd0-ee3e999b13e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:48.188499 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce04462-19e9-4c8b-9dd0-ee3e999b13e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:48.188771 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce04462-19e9-4c8b-9dd0-ee3e999b13e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:48.189064 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce04462-19e9-4c8b-9dd0-ee3e999b13e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:48.189690 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce04462-19e9-4c8b-9dd0-ee3e999b13e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:48.191665 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce04462-19e9-4c8b-9dd0-ee3e999b13e9 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:48.227015 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1316/2651] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 15:04:48 2022] POST /identity/v3/projects => generated 387 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:04:48.232715 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52490b7-78f9-4fe6-8a2e-545bab8ae497 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:48.245402 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52490b7-78f9-4fe6-8a2e-545bab8ae497 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:48.309188 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a286e9c5-4e56-402f-89d3-0555acfcbfda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:48.309817 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a286e9c5-4e56-402f-89d3-0555acfcbfda admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:48.310116 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a286e9c5-4e56-402f-89d3-0555acfcbfda admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:48.310389 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a286e9c5-4e56-402f-89d3-0555acfcbfda admin admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:48.311020 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a286e9c5-4e56-402f-89d3-0555acfcbfda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:48.313045 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a286e9c5-4e56-402f-89d3-0555acfcbfda admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:48.338508 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1336/2652] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 15:04:48 2022] POST /identity/v3/users => generated 294 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:04:48.343192 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce04462-19e9-4c8b-9dd0-ee3e999b13e9 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:48.356867 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce04462-19e9-4c8b-9dd0-ee3e999b13e9 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:48.363523 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d997720a-ddaf-4664-86ad-7c05a35b6bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:48.364003 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d997720a-ddaf-4664-86ad-7c05a35b6bb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:48.364303 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d997720a-ddaf-4664-86ad-7c05a35b6bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:48.365289 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d997720a-ddaf-4664-86ad-7c05a35b6bb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:48.365947 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d997720a-ddaf-4664-86ad-7c05a35b6bb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:48.367623 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d997720a-ddaf-4664-86ad-7c05a35b6bb6 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:48.379854 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1317/2653] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 15:04:48 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 15:04:48.385575 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a286e9c5-4e56-402f-89d3-0555acfcbfda admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:48.398112 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a286e9c5-4e56-402f-89d3-0555acfcbfda admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:48.404965 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0095bc-1ab8-4d55-89ee-9efa24ac8849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:48.405793 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0095bc-1ab8-4d55-89ee-9efa24ac8849 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:48.406112 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0095bc-1ab8-4d55-89ee-9efa24ac8849 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:48.406437 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0095bc-1ab8-4d55-89ee-9efa24ac8849 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:48.407156 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0095bc-1ab8-4d55-89ee-9efa24ac8849 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:48.409083 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0095bc-1ab8-4d55-89ee-9efa24ac8849 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:48.421636 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1337/2654] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 15:04:48 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:04:48.427375 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d997720a-ddaf-4664-86ad-7c05a35b6bb6 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:48.438617 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d997720a-ddaf-4664-86ad-7c05a35b6bb6 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:48.446810 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff8f48a-92a9-4d6e-9457-323884b454f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:48.447661 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff8f48a-92a9-4d6e-9457-323884b454f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:48.448123 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff8f48a-92a9-4d6e-9457-323884b454f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:48.448533 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff8f48a-92a9-4d6e-9457-323884b454f6 admin admin] PATH_INFO: `/v3/projects/fb5a285d5b7c4013b8aad5b6d13f22e8/users/d10fc0cf9a99435ca9d53cb029055ce7/roles/74de6794e3b3422b93d26f993d260c35` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:48.472556 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff8f48a-92a9-4d6e-9457-323884b454f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb5a285d5b7c4013b8aad5b6d13f22e8, user_id=d10fc0cf9a99435ca9d53cb029055ce7, role_id=74de6794e3b3422b93d26f993d260c35)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:48.475712 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff8f48a-92a9-4d6e-9457-323884b454f6 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:48.491947 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1318/2655] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 15:04:48 2022] PUT /identity/v3/projects/fb5a285d5b7c4013b8aad5b6d13f22e8/users/d10fc0cf9a99435ca9d53cb029055ce7/roles/74de6794e3b3422b93d26f993d260c35 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:04:48.506180 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e7475b-4a57-4722-8b09-e7654c65ce6a None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:48.506466 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e7475b-4a57-4722-8b09-e7654c65ce6a None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:48.506811 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e7475b-4a57-4722-8b09-e7654c65ce6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:48.538311 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-26e7475b-4a57-4722-8b09-e7654c65ce6a None None] MFA Rules not processed for user `d10fc0cf9a99435ca9d53cb029055ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:04:48.539617 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-26e7475b-4a57-4722-8b09-e7654c65ce6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:48.578329 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:48.614645 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1338/2656] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:04:48 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:04:48.620179 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff8f48a-92a9-4d6e-9457-323884b454f6 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:48.658842 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:48.696840 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff8f48a-92a9-4d6e-9457-323884b454f6 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:48.702559 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43cb1d0-da44-446b-8435-6720ebc86554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:48.703167 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43cb1d0-da44-446b-8435-6720ebc86554 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:48.703442 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43cb1d0-da44-446b-8435-6720ebc86554 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:48.703711 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43cb1d0-da44-446b-8435-6720ebc86554 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:48.704353 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43cb1d0-da44-446b-8435-6720ebc86554 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:48.706313 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43cb1d0-da44-446b-8435-6720ebc86554 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:48.740944 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1319/2657] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 15:04:48 2022] POST /identity/v3/projects => generated 387 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:04:48.745268 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e7475b-4a57-4722-8b09-e7654c65ce6a None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:48.757764 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e7475b-4a57-4722-8b09-e7654c65ce6a None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:48.823400 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d532b37-fd7f-4634-89d5-e41295255d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:48.824026 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d532b37-fd7f-4634-89d5-e41295255d64 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:48.824298 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d532b37-fd7f-4634-89d5-e41295255d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:48.824576 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d532b37-fd7f-4634-89d5-e41295255d64 admin admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:48.825598 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d532b37-fd7f-4634-89d5-e41295255d64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:48.827534 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d532b37-fd7f-4634-89d5-e41295255d64 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:48.857843 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1339/2658] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 15:04:48 2022] POST /identity/v3/users => generated 300 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:04:48.862085 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43cb1d0-da44-446b-8435-6720ebc86554 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:48.873531 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43cb1d0-da44-446b-8435-6720ebc86554 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:48.878242 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea96ae71-a7ff-47db-b326-3e0bf4693343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:48.878843 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea96ae71-a7ff-47db-b326-3e0bf4693343 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:48.879215 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea96ae71-a7ff-47db-b326-3e0bf4693343 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:48.879489 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea96ae71-a7ff-47db-b326-3e0bf4693343 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:48.880938 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea96ae71-a7ff-47db-b326-3e0bf4693343 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:48.882598 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea96ae71-a7ff-47db-b326-3e0bf4693343 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:48.894176 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1320/2659] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 15:04:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 15:04:48.899877 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d532b37-fd7f-4634-89d5-e41295255d64 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:48.916058 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d532b37-fd7f-4634-89d5-e41295255d64 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:48.922419 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c09b159-033c-4894-a4c7-90a63adc059e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:48.923074 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c09b159-033c-4894-a4c7-90a63adc059e admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:48.923512 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c09b159-033c-4894-a4c7-90a63adc059e admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:48.923686 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c09b159-033c-4894-a4c7-90a63adc059e admin admin] PATH_INFO: `/v3/projects/299247e8aab74422942235a62102f95a/users/ed6407e170fb48a7a049518dc19d6e34/roles/019bde1756cb40de8ce06cef6b261f79` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:48.942721 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c09b159-033c-4894-a4c7-90a63adc059e admin admin] RBAC: Authorizing `identity:create_grant(project_id=299247e8aab74422942235a62102f95a, user_id=ed6407e170fb48a7a049518dc19d6e34, role_id=019bde1756cb40de8ce06cef6b261f79)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:48.945468 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c09b159-033c-4894-a4c7-90a63adc059e admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:48.961929 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1340/2660] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 15:04:48 2022] PUT /identity/v3/projects/299247e8aab74422942235a62102f95a/users/ed6407e170fb48a7a049518dc19d6e34/roles/019bde1756cb40de8ce06cef6b261f79 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:04:48.966186 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea96ae71-a7ff-47db-b326-3e0bf4693343 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:48.977623 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea96ae71-a7ff-47db-b326-3e0bf4693343 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:49.042715 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24a8ec7-bff7-40e2-8301-883a527d6a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:49.043404 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a8ec7-bff7-40e2-8301-883a527d6a62 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:49.043631 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a8ec7-bff7-40e2-8301-883a527d6a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:49.043865 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a8ec7-bff7-40e2-8301-883a527d6a62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:49.044529 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24a8ec7-bff7-40e2-8301-883a527d6a62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:49.048604 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24a8ec7-bff7-40e2-8301-883a527d6a62 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:49.060089 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1321/2661] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 15:04:48 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 15:04:49.065137 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c09b159-033c-4894-a4c7-90a63adc059e admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:49.077751 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c09b159-033c-4894-a4c7-90a63adc059e admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:49.082962 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5f9545-e29c-4482-a27e-dda571812915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:49.084193 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5f9545-e29c-4482-a27e-dda571812915 admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:49.084442 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5f9545-e29c-4482-a27e-dda571812915 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:49.084743 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5f9545-e29c-4482-a27e-dda571812915 admin admin] PATH_INFO: `/v3/projects/299247e8aab74422942235a62102f95a/users/ed6407e170fb48a7a049518dc19d6e34/roles/019bde1756cb40de8ce06cef6b261f79` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:49.086883 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5f9545-e29c-4482-a27e-dda571812915 admin admin] RBAC: Authorizing `identity:create_grant(project_id=299247e8aab74422942235a62102f95a, user_id=ed6407e170fb48a7a049518dc19d6e34, role_id=019bde1756cb40de8ce06cef6b261f79)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:49.091712 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5f9545-e29c-4482-a27e-dda571812915 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:49.103432 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1341/2662] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 15:04:49 2022] PUT /identity/v3/projects/299247e8aab74422942235a62102f95a/users/ed6407e170fb48a7a049518dc19d6e34/roles/019bde1756cb40de8ce06cef6b261f79 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:04:49.114203 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58741e7b-3011-4b27-8b0f-737048e3b15a None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:49.114486 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58741e7b-3011-4b27-8b0f-737048e3b15a None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:49.114749 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58741e7b-3011-4b27-8b0f-737048e3b15a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:49.144075 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-58741e7b-3011-4b27-8b0f-737048e3b15a None None] MFA Rules not processed for user `ed6407e170fb48a7a049518dc19d6e34`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:04:49.145370 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-58741e7b-3011-4b27-8b0f-737048e3b15a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:49.227814 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1322/2663] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:04:49 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:04:49.242318 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5f9545-e29c-4482-a27e-dda571812915 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:49.244498 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-db5f9545-e29c-4482-a27e-dda571812915 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:49.310131 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5f9545-e29c-4482-a27e-dda571812915 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:49.313952 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a5bcf-4506-4849-9cbe-4009a6373d11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df648c909ddb41418128b43f925f5ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:49.314567 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a5bcf-4506-4849-9cbe-4009a6373d11 service cinder] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:49.314837 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a5bcf-4506-4849-9cbe-4009a6373d11 service cinder] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:49.315100 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a5bcf-4506-4849-9cbe-4009a6373d11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:49.326196 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888a5bcf-4506-4849-9cbe-4009a6373d11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:49.327626 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888a5bcf-4506-4849-9cbe-4009a6373d11 service cinder] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:49.340052 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1342/2664] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:04:49 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:04:49.998368 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58741e7b-3011-4b27-8b0f-737048e3b15a None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:50.015582 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58741e7b-3011-4b27-8b0f-737048e3b15a None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:50.020691 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d62784-d172-4e48-8f6c-0f512782ad9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df648c909ddb41418128b43f925f5ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:50.021166 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d62784-d172-4e48-8f6c-0f512782ad9a service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:50.021646 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d62784-d172-4e48-8f6c-0f512782ad9a service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:50.021919 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d62784-d172-4e48-8f6c-0f512782ad9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:50.046296 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:50.090275 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d62784-d172-4e48-8f6c-0f512782ad9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:50.091735 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d62784-d172-4e48-8f6c-0f512782ad9a service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:50.113099 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1323/2665] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:04:49 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:04:54.373333 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a5bcf-4506-4849-9cbe-4009a6373d11 service cinder] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:54.374835 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-888a5bcf-4506-4849-9cbe-4009a6373d11 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:54.387260 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a5bcf-4506-4849-9cbe-4009a6373d11 service cinder] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:54.391166 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087d9629-38f9-45cf-ae86-e2c4e0432e1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df648c909ddb41418128b43f925f5ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:54.391839 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087d9629-38f9-45cf-ae86-e2c4e0432e1c service cinder] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:54.392059 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087d9629-38f9-45cf-ae86-e2c4e0432e1c service cinder] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:54.392340 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087d9629-38f9-45cf-ae86-e2c4e0432e1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:54.440372 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:54.473011 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087d9629-38f9-45cf-ae86-e2c4e0432e1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:54.474646 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087d9629-38f9-45cf-ae86-e2c4e0432e1c service cinder] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:54.485193 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1343/2666] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:04:54 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:04:56.934943 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d62784-d172-4e48-8f6c-0f512782ad9a service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:57.009526 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d62784-d172-4e48-8f6c-0f512782ad9a service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:57.015236 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c7b85d-3702-4c01-8998-bb4e2b7d4263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:57.015874 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7b85d-3702-4c01-8998-bb4e2b7d4263 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:57.016149 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7b85d-3702-4c01-8998-bb4e2b7d4263 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:57.016494 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7b85d-3702-4c01-8998-bb4e2b7d4263 admin admin] PATH_INFO: `/v3/users/74366a9bb48348418f2d0a2c819c01b7` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:57.017580 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c7b85d-3702-4c01-8998-bb4e2b7d4263 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74366a9bb48348418f2d0a2c819c01b7)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:57.019506 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c7b85d-3702-4c01-8998-bb4e2b7d4263 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:57.080475 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-98c7b85d-3702-4c01-8998-bb4e2b7d4263 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74366a9bb48348418f2d0a2c819c01b7'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:57.089592 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-98c7b85d-3702-4c01-8998-bb4e2b7d4263 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74366a9bb48348418f2d0a2c819c01b7'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:57.090291 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-98c7b85d-3702-4c01-8998-bb4e2b7d4263 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74366a9bb48348418f2d0a2c819c01b7'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:57.090925 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-98c7b85d-3702-4c01-8998-bb4e2b7d4263 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74366a9bb48348418f2d0a2c819c01b7'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:57.098638 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-98c7b85d-3702-4c01-8998-bb4e2b7d4263 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74366a9bb48348418f2d0a2c819c01b7'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:57.125670 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1324/2667] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 15:04:56 2022] DELETE /identity/v3/users/74366a9bb48348418f2d0a2c819c01b7 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:04:57.130952 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e7d5f4-82f4-46fd-9c8d-496054a7622d None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:57.131584 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e7d5f4-82f4-46fd-9c8d-496054a7622d None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:57.131584 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e7d5f4-82f4-46fd-9c8d-496054a7622d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:57.153301 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-59e7d5f4-82f4-46fd-9c8d-496054a7622d None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:04:57.154575 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-59e7d5f4-82f4-46fd-9c8d-496054a7622d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:57.223132 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1344/2668] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:04:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:04:57.236204 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c7b85d-3702-4c01-8998-bb4e2b7d4263 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:57.238117 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-98c7b85d-3702-4c01-8998-bb4e2b7d4263 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:57.297385 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:57.320682 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c7b85d-3702-4c01-8998-bb4e2b7d4263 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:57.326482 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5779d38b-0ffb-44a8-855e-2d4fe4bc131c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:57.327164 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5779d38b-0ffb-44a8-855e-2d4fe4bc131c service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:57.327443 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5779d38b-0ffb-44a8-855e-2d4fe4bc131c service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:57.327714 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5779d38b-0ffb-44a8-855e-2d4fe4bc131c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:57.340525 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5779d38b-0ffb-44a8-855e-2d4fe4bc131c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:57.342277 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5779d38b-0ffb-44a8-855e-2d4fe4bc131c service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:57.356221 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1325/2669] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:04:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:04:57.705404 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e7d5f4-82f4-46fd-9c8d-496054a7622d None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:57.707224 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-59e7d5f4-82f4-46fd-9c8d-496054a7622d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:57.724976 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e7d5f4-82f4-46fd-9c8d-496054a7622d None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:57.732186 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50398cd8-d272-41d6-a0f7-5f7f050b0012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:57.733105 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50398cd8-d272-41d6-a0f7-5f7f050b0012 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:57.733460 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50398cd8-d272-41d6-a0f7-5f7f050b0012 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:57.733780 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50398cd8-d272-41d6-a0f7-5f7f050b0012 admin admin] PATH_INFO: `/v3/projects/4cb3a848530f4e1492050c642c7fb346` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:57.736958 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50398cd8-d272-41d6-a0f7-5f7f050b0012 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cb3a848530f4e1492050c642c7fb346)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:57.737490 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50398cd8-d272-41d6-a0f7-5f7f050b0012 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:57.798511 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-50398cd8-d272-41d6-a0f7-5f7f050b0012 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cb3a848530f4e1492050c642c7fb346', 'request_id': 'req-50398cd8-d272-41d6-a0f7-5f7f050b0012'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:57.807542 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-50398cd8-d272-41d6-a0f7-5f7f050b0012 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cb3a848530f4e1492050c642c7fb346', 'request_id': 'req-50398cd8-d272-41d6-a0f7-5f7f050b0012'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:57.815017 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-50398cd8-d272-41d6-a0f7-5f7f050b0012 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cb3a848530f4e1492050c642c7fb346', 'request_id': 'req-50398cd8-d272-41d6-a0f7-5f7f050b0012'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:57.828429 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-50398cd8-d272-41d6-a0f7-5f7f050b0012 admin admin] The token cache is being invalidate because project 4cb3a848530f4e1492050c642c7fb346 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:04:57.828721 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-50398cd8-d272-41d6-a0f7-5f7f050b0012 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:57.829404 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-50398cd8-d272-41d6-a0f7-5f7f050b0012 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:57.831040 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1345/2670] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 15:04:57 2022] DELETE /identity/v3/projects/4cb3a848530f4e1492050c642c7fb346 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:04:57.836336 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5779d38b-0ffb-44a8-855e-2d4fe4bc131c service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:57.854302 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5779d38b-0ffb-44a8-855e-2d4fe4bc131c service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:57.924504 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7e1aa7-0c03-49bd-83d0-73d7dcb81474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:57.925108 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7e1aa7-0c03-49bd-83d0-73d7dcb81474 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:57.925386 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7e1aa7-0c03-49bd-83d0-73d7dcb81474 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:57.925659 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7e1aa7-0c03-49bd-83d0-73d7dcb81474 admin admin] PATH_INFO: `/v3/users/d10fc0cf9a99435ca9d53cb029055ce7` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:57.926862 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7e1aa7-0c03-49bd-83d0-73d7dcb81474 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d10fc0cf9a99435ca9d53cb029055ce7)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:57.929694 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7e1aa7-0c03-49bd-83d0-73d7dcb81474 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:57.987273 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-1f7e1aa7-0c03-49bd-83d0-73d7dcb81474 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd10fc0cf9a99435ca9d53cb029055ce7'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:57.997305 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-1f7e1aa7-0c03-49bd-83d0-73d7dcb81474 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd10fc0cf9a99435ca9d53cb029055ce7'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:57.998010 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-1f7e1aa7-0c03-49bd-83d0-73d7dcb81474 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd10fc0cf9a99435ca9d53cb029055ce7'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:57.998567 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-1f7e1aa7-0c03-49bd-83d0-73d7dcb81474 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd10fc0cf9a99435ca9d53cb029055ce7'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:58.007235 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-1f7e1aa7-0c03-49bd-83d0-73d7dcb81474 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd10fc0cf9a99435ca9d53cb029055ce7'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:58.025868 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1326/2671] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 15:04:57 2022] DELETE /identity/v3/users/d10fc0cf9a99435ca9d53cb029055ce7 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:04:58.334605 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50398cd8-d272-41d6-a0f7-5f7f050b0012 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:58.336545 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-50398cd8-d272-41d6-a0f7-5f7f050b0012 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:58.351633 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50398cd8-d272-41d6-a0f7-5f7f050b0012 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:58.408523 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:58.421425 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c10d6e7-751b-4047-ba6e-a225c28e9471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:58.422081 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c10d6e7-751b-4047-ba6e-a225c28e9471 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:58.422352 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c10d6e7-751b-4047-ba6e-a225c28e9471 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:58.422621 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c10d6e7-751b-4047-ba6e-a225c28e9471 admin admin] PATH_INFO: `/v3/projects/fb5a285d5b7c4013b8aad5b6d13f22e8` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:58.423776 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c10d6e7-751b-4047-ba6e-a225c28e9471 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb5a285d5b7c4013b8aad5b6d13f22e8)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:58.425769 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c10d6e7-751b-4047-ba6e-a225c28e9471 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:58.486227 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-7c10d6e7-751b-4047-ba6e-a225c28e9471 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb5a285d5b7c4013b8aad5b6d13f22e8', 'request_id': 'req-7c10d6e7-751b-4047-ba6e-a225c28e9471'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:58.493368 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-7c10d6e7-751b-4047-ba6e-a225c28e9471 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb5a285d5b7c4013b8aad5b6d13f22e8', 'request_id': 'req-7c10d6e7-751b-4047-ba6e-a225c28e9471'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:58.502553 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-7c10d6e7-751b-4047-ba6e-a225c28e9471 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb5a285d5b7c4013b8aad5b6d13f22e8', 'request_id': 'req-7c10d6e7-751b-4047-ba6e-a225c28e9471'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:58.515204 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-7c10d6e7-751b-4047-ba6e-a225c28e9471 admin admin] The token cache is being invalidate because project fb5a285d5b7c4013b8aad5b6d13f22e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:04:58.515476 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-7c10d6e7-751b-4047-ba6e-a225c28e9471 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:58.516137 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-7c10d6e7-751b-4047-ba6e-a225c28e9471 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:58.517736 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1346/2672] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 15:04:58 2022] DELETE /identity/v3/projects/fb5a285d5b7c4013b8aad5b6d13f22e8 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:04:58.525147 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7e1aa7-0c03-49bd-83d0-73d7dcb81474 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:58.527917 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-1f7e1aa7-0c03-49bd-83d0-73d7dcb81474 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:58.541408 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c10d6e7-751b-4047-ba6e-a225c28e9471 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:58.542988 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-7c10d6e7-751b-4047-ba6e-a225c28e9471 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:58.548926 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7e1aa7-0c03-49bd-83d0-73d7dcb81474 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:58.625572 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c10d6e7-751b-4047-ba6e-a225c28e9471 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:58.625866 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049e653e-89f5-4e3e-94e3-24ce3040b471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:58.626870 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e653e-89f5-4e3e-94e3-24ce3040b471 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:58.627150 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e653e-89f5-4e3e-94e3-24ce3040b471 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:58.627419 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e653e-89f5-4e3e-94e3-24ce3040b471 admin admin] PATH_INFO: `/v3/users/ed6407e170fb48a7a049518dc19d6e34` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:58.628552 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049e653e-89f5-4e3e-94e3-24ce3040b471 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed6407e170fb48a7a049518dc19d6e34)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:58.630642 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049e653e-89f5-4e3e-94e3-24ce3040b471 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:58.631545 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31886e3a-0b8d-44c2-81d3-bfb35691c469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:58.632190 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31886e3a-0b8d-44c2-81d3-bfb35691c469 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:58.632460 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31886e3a-0b8d-44c2-81d3-bfb35691c469 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:58.632716 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31886e3a-0b8d-44c2-81d3-bfb35691c469 admin admin] PATH_INFO: `/v3/users/c1b62f80ef794d518662bac549320d4a` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:58.633873 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:58.634013 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31886e3a-0b8d-44c2-81d3-bfb35691c469 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1b62f80ef794d518662bac549320d4a)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:58.636208 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31886e3a-0b8d-44c2-81d3-bfb35691c469 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:58.703802 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-049e653e-89f5-4e3e-94e3-24ce3040b471 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed6407e170fb48a7a049518dc19d6e34'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:58.707827 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-31886e3a-0b8d-44c2-81d3-bfb35691c469 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1b62f80ef794d518662bac549320d4a'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:58.716684 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-049e653e-89f5-4e3e-94e3-24ce3040b471 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed6407e170fb48a7a049518dc19d6e34'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:58.717477 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-049e653e-89f5-4e3e-94e3-24ce3040b471 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed6407e170fb48a7a049518dc19d6e34'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:58.718278 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-049e653e-89f5-4e3e-94e3-24ce3040b471 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed6407e170fb48a7a049518dc19d6e34'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:58.720024 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-31886e3a-0b8d-44c2-81d3-bfb35691c469 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1b62f80ef794d518662bac549320d4a'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:58.721455 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-31886e3a-0b8d-44c2-81d3-bfb35691c469 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1b62f80ef794d518662bac549320d4a'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:58.722372 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-31886e3a-0b8d-44c2-81d3-bfb35691c469 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1b62f80ef794d518662bac549320d4a'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:58.726989 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-049e653e-89f5-4e3e-94e3-24ce3040b471 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed6407e170fb48a7a049518dc19d6e34'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:58.742461 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-31886e3a-0b8d-44c2-81d3-bfb35691c469 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1b62f80ef794d518662bac549320d4a'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:58.757302 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1347/2673] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 15:04:58 2022] DELETE /identity/v3/users/c1b62f80ef794d518662bac549320d4a => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:04:58.757600 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1327/2674] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 15:04:58 2022] DELETE /identity/v3/users/ed6407e170fb48a7a049518dc19d6e34 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:04:58.770715 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b4771-af2b-4a3a-816c-4180ca398ab7 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:58.770715 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b4771-af2b-4a3a-816c-4180ca398ab7 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:58.770715 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b4771-af2b-4a3a-816c-4180ca398ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:58.781528 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:58.814201 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-f08b4771-af2b-4a3a-816c-4180ca398ab7 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:04:58.815516 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-f08b4771-af2b-4a3a-816c-4180ca398ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:58.896945 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1348/2675] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:04:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:04:58.909312 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049e653e-89f5-4e3e-94e3-24ce3040b471 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:58.911262 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-049e653e-89f5-4e3e-94e3-24ce3040b471 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:58.990717 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049e653e-89f5-4e3e-94e3-24ce3040b471 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:59.063679 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f8c0f0-069e-4b57-ae43-12ddeebe5111 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:59.064624 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f8c0f0-069e-4b57-ae43-12ddeebe5111 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:59.065163 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f8c0f0-069e-4b57-ae43-12ddeebe5111 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:59.065801 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f8c0f0-069e-4b57-ae43-12ddeebe5111 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:59.082206 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f8c0f0-069e-4b57-ae43-12ddeebe5111 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:59.084583 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f8c0f0-069e-4b57-ae43-12ddeebe5111 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:59.095323 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08b4771-af2b-4a3a-816c-4180ca398ab7 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:59.097420 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-f08b4771-af2b-4a3a-816c-4180ca398ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:59.105834 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1328/2676] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:04:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:04:59.118582 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08b4771-af2b-4a3a-816c-4180ca398ab7 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:59.123790 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d6f3a9-33ce-4dea-bcd8-c0dbdce09998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:59.124449 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d6f3a9-33ce-4dea-bcd8-c0dbdce09998 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:59.124792 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d6f3a9-33ce-4dea-bcd8-c0dbdce09998 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:59.125105 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d6f3a9-33ce-4dea-bcd8-c0dbdce09998 admin admin] PATH_INFO: `/v3/projects/299247e8aab74422942235a62102f95a` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:59.126322 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d6f3a9-33ce-4dea-bcd8-c0dbdce09998 admin admin] RBAC: Authorizing `identity:delete_project(project_id=299247e8aab74422942235a62102f95a)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:59.128220 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d6f3a9-33ce-4dea-bcd8-c0dbdce09998 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:59.193771 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-42d6f3a9-33ce-4dea-bcd8-c0dbdce09998 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '299247e8aab74422942235a62102f95a', 'request_id': 'req-42d6f3a9-33ce-4dea-bcd8-c0dbdce09998'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:59.206039 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-42d6f3a9-33ce-4dea-bcd8-c0dbdce09998 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '299247e8aab74422942235a62102f95a', 'request_id': 'req-42d6f3a9-33ce-4dea-bcd8-c0dbdce09998'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:59.222030 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-42d6f3a9-33ce-4dea-bcd8-c0dbdce09998 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '299247e8aab74422942235a62102f95a', 'request_id': 'req-42d6f3a9-33ce-4dea-bcd8-c0dbdce09998'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:59.240142 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-42d6f3a9-33ce-4dea-bcd8-c0dbdce09998 admin admin] The token cache is being invalidate because project 299247e8aab74422942235a62102f95a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:04:59.240545 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-42d6f3a9-33ce-4dea-bcd8-c0dbdce09998 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:59.241314 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-42d6f3a9-33ce-4dea-bcd8-c0dbdce09998 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:59.242860 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1349/2677] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 15:04:59 2022] DELETE /identity/v3/projects/299247e8aab74422942235a62102f95a => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:04:59.249811 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c01ed6e-a6b0-4e91-b478-1ad30720042c None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:59.250245 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c01ed6e-a6b0-4e91-b478-1ad30720042c None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:59.250757 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c01ed6e-a6b0-4e91-b478-1ad30720042c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:59.276067 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-6c01ed6e-a6b0-4e91-b478-1ad30720042c None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:04:59.276067 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-6c01ed6e-a6b0-4e91-b478-1ad30720042c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:59.318992 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:59.372552 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1329/2678] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:04:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:04:59.381382 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4600d60-8e04-42b0-8ea5-dee4ff12ad92 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:59.381986 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4600d60-8e04-42b0-8ea5-dee4ff12ad92 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:59.381986 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4600d60-8e04-42b0-8ea5-dee4ff12ad92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:59.406466 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-a4600d60-8e04-42b0-8ea5-dee4ff12ad92 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:04:59.408950 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-a4600d60-8e04-42b0-8ea5-dee4ff12ad92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:59.424983 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1350/2679] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:04:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:04:59.425906 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c01ed6e-a6b0-4e91-b478-1ad30720042c None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:59.437267 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c01ed6e-a6b0-4e91-b478-1ad30720042c None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:59.444421 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40d85aa-c4ad-486b-bb7f-52708fbebe7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:59.445478 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d85aa-c4ad-486b-bb7f-52708fbebe7b admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:59.445779 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d85aa-c4ad-486b-bb7f-52708fbebe7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:59.446048 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d85aa-c4ad-486b-bb7f-52708fbebe7b admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:59.446834 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40d85aa-c4ad-486b-bb7f-52708fbebe7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:04:59.447198 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40d85aa-c4ad-486b-bb7f-52708fbebe7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:59.449359 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40d85aa-c4ad-486b-bb7f-52708fbebe7b admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:59.472009 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1330/2680] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 19 15:04:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:04:59.477497 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4600d60-8e04-42b0-8ea5-dee4ff12ad92 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:59.485139 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40d85aa-c4ad-486b-bb7f-52708fbebe7b admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:59.487149 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e40d85aa-c4ad-486b-bb7f-52708fbebe7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:59.492352 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4600d60-8e04-42b0-8ea5-dee4ff12ad92 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:59.500564 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bc227b-7018-434e-a5b8-976741fd39a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:59.501437 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40d85aa-c4ad-486b-bb7f-52708fbebe7b admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:59.501802 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc227b-7018-434e-a5b8-976741fd39a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:59.502366 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc227b-7018-434e-a5b8-976741fd39a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:59.502795 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc227b-7018-434e-a5b8-976741fd39a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:59.503718 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bc227b-7018-434e-a5b8-976741fd39a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:59.507172 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bc227b-7018-434e-a5b8-976741fd39a0 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:59.508864 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318139e5-f257-4480-bae5-7317cf85f08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:59.509847 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318139e5-f257-4480-bae5-7317cf85f08c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:59.510366 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318139e5-f257-4480-bae5-7317cf85f08c admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:59.510972 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318139e5-f257-4480-bae5-7317cf85f08c admin admin] PATH_INFO: `/v3/projects/37bab496de2046dfa7281599cd0e06bb` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:59.512855 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318139e5-f257-4480-bae5-7317cf85f08c admin admin] RBAC: Authorizing `identity:delete_project(project_id=37bab496de2046dfa7281599cd0e06bb)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:59.514984 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318139e5-f257-4480-bae5-7317cf85f08c admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:59.561028 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1351/2681] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 15:04:59 2022] POST /identity/v3/projects => generated 385 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:04:59.563421 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bc227b-7018-434e-a5b8-976741fd39a0 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:59.580862 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-318139e5-f257-4480-bae5-7317cf85f08c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37bab496de2046dfa7281599cd0e06bb', 'request_id': 'req-318139e5-f257-4480-bae5-7317cf85f08c'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:59.588877 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-318139e5-f257-4480-bae5-7317cf85f08c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37bab496de2046dfa7281599cd0e06bb', 'request_id': 'req-318139e5-f257-4480-bae5-7317cf85f08c'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:59.599955 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-318139e5-f257-4480-bae5-7317cf85f08c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37bab496de2046dfa7281599cd0e06bb', 'request_id': 'req-318139e5-f257-4480-bae5-7317cf85f08c'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:59.612163 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-318139e5-f257-4480-bae5-7317cf85f08c admin admin] The token cache is being invalidate because project 37bab496de2046dfa7281599cd0e06bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:04:59.612441 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-318139e5-f257-4480-bae5-7317cf85f08c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:59.613158 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-318139e5-f257-4480-bae5-7317cf85f08c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:04:59.615226 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1331/2682] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 15:04:59 2022] DELETE /identity/v3/projects/37bab496de2046dfa7281599cd0e06bb => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:04:59.621264 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b4fa3-8c11-4060-bafe-8dc437f0ec0b None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:59.621932 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b4fa3-8c11-4060-bafe-8dc437f0ec0b None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:59.622898 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b4fa3-8c11-4060-bafe-8dc437f0ec0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:59.637420 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:59.642595 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bc227b-7018-434e-a5b8-976741fd39a0 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:59.646885 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-379b4fa3-8c11-4060-bafe-8dc437f0ec0b None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:04:59.648624 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-379b4fa3-8c11-4060-bafe-8dc437f0ec0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:59.716830 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0557b001-eb0c-4319-8476-46b7da70afd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:59.717485 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0557b001-eb0c-4319-8476-46b7da70afd8 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:59.717873 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0557b001-eb0c-4319-8476-46b7da70afd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:59.718154 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0557b001-eb0c-4319-8476-46b7da70afd8 admin admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:59.718813 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0557b001-eb0c-4319-8476-46b7da70afd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:59.720786 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0557b001-eb0c-4319-8476-46b7da70afd8 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:59.729410 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1332/2683] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:04:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:04:59.737339 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e9e8c-e9b5-4eb0-aa25-1efc6055e189 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:59.737630 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e9e8c-e9b5-4eb0-aa25-1efc6055e189 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:59.737903 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e9e8c-e9b5-4eb0-aa25-1efc6055e189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:59.749832 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1352/2684] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 15:04:59 2022] POST /identity/v3/users => generated 293 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 15:04:59.754189 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0557b001-eb0c-4319-8476-46b7da70afd8 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:59.757017 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-0557b001-eb0c-4319-8476-46b7da70afd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:59.769894 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0557b001-eb0c-4319-8476-46b7da70afd8 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:59.773307 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-cf6e9e8c-e9b5-4eb0-aa25-1efc6055e189 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:04:59.775345 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-cf6e9e8c-e9b5-4eb0-aa25-1efc6055e189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:04:59.776106 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5d4f66-f9a6-46a6-a5c8-1b5f121f6592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:59.776751 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5d4f66-f9a6-46a6-a5c8-1b5f121f6592 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:59.777070 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5d4f66-f9a6-46a6-a5c8-1b5f121f6592 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:59.777363 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5d4f66-f9a6-46a6-a5c8-1b5f121f6592 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:59.777985 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5d4f66-f9a6-46a6-a5c8-1b5f121f6592 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:59.779614 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5d4f66-f9a6-46a6-a5c8-1b5f121f6592 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:59.784795 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1333/2685] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:04:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:04:59.789490 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6e9e8c-e9b5-4eb0-aa25-1efc6055e189 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:59.795983 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1353/2686] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 15:04:59 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:04:59.801557 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5d4f66-f9a6-46a6-a5c8-1b5f121f6592 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:59.805482 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6e9e8c-e9b5-4eb0-aa25-1efc6055e189 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:59.812166 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5525a6-81c1-4a04-afac-b57cb88f1c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:59.813211 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5525a6-81c1-4a04-afac-b57cb88f1c2d admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:59.813697 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5525a6-81c1-4a04-afac-b57cb88f1c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:59.813903 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5d4f66-f9a6-46a6-a5c8-1b5f121f6592 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:59.814076 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5525a6-81c1-4a04-afac-b57cb88f1c2d admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:59.815018 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5525a6-81c1-4a04-afac-b57cb88f1c2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:04:59.815462 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5525a6-81c1-4a04-afac-b57cb88f1c2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:59.818979 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5525a6-81c1-4a04-afac-b57cb88f1c2d admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:59.820751 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a961b2e4-d7f6-410b-b23a-d93483dff0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:59.821483 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a961b2e4-d7f6-410b-b23a-d93483dff0d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:59.821775 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a961b2e4-d7f6-410b-b23a-d93483dff0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:59.822044 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a961b2e4-d7f6-410b-b23a-d93483dff0d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:59.822698 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a961b2e4-d7f6-410b-b23a-d93483dff0d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:59.824288 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a961b2e4-d7f6-410b-b23a-d93483dff0d3 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:59.833173 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1334/2687] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 19 15:04:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 15:04:59.840422 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5525a6-81c1-4a04-afac-b57cb88f1c2d admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:59.840870 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1354/2688] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 15:04:59 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:04:59.846491 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a961b2e4-d7f6-410b-b23a-d93483dff0d3 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:59.852615 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5525a6-81c1-4a04-afac-b57cb88f1c2d admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:59.856838 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a961b2e4-d7f6-410b-b23a-d93483dff0d3 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:04:59.859211 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba541e71-546b-4bd6-bca8-827564d9f2ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:59.859828 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba541e71-546b-4bd6-bca8-827564d9f2ff admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:59.860115 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba541e71-546b-4bd6-bca8-827564d9f2ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:59.860399 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba541e71-546b-4bd6-bca8-827564d9f2ff admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:59.861064 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba541e71-546b-4bd6-bca8-827564d9f2ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:59.861728 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ed66ac-3ae7-422f-aa2e-2850aaf99395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:04:59.862514 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ed66ac-3ae7-422f-aa2e-2850aaf99395 admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:59.862685 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ed66ac-3ae7-422f-aa2e-2850aaf99395 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:59.862906 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ed66ac-3ae7-422f-aa2e-2850aaf99395 admin admin] PATH_INFO: `/v3/projects/33ac89ef06ad4137bc67ea1197404aa3/users/5c82dc5ae0bd4840b763c8943e73b21c/roles/74de6794e3b3422b93d26f993d260c35` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:59.863017 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba541e71-546b-4bd6-bca8-827564d9f2ff admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:59.880129 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ed66ac-3ae7-422f-aa2e-2850aaf99395 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33ac89ef06ad4137bc67ea1197404aa3, user_id=5c82dc5ae0bd4840b763c8943e73b21c, role_id=74de6794e3b3422b93d26f993d260c35)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:04:59.891595 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ed66ac-3ae7-422f-aa2e-2850aaf99395 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:04:59.903831 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1355/2689] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 15:04:59 2022] PUT /identity/v3/projects/33ac89ef06ad4137bc67ea1197404aa3/users/5c82dc5ae0bd4840b763c8943e73b21c/roles/74de6794e3b3422b93d26f993d260c35 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:04:59.909074 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1335/2690] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 15:04:59 2022] POST /identity/v3/projects => generated 381 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:04:59.916042 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ed66ac-3ae7-422f-aa2e-2850aaf99395 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:04:59.917814 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5de86c-f034-420c-9ea4-321f4607eb60 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:04:59.918101 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5de86c-f034-420c-9ea4-321f4607eb60 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:04:59.918374 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5de86c-f034-420c-9ea4-321f4607eb60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:04:59.941495 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:04:59.956501 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-3e5de86c-f034-420c-9ea4-321f4607eb60 None None] MFA Rules not processed for user `5c82dc5ae0bd4840b763c8943e73b21c`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:04:59.959551 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-3e5de86c-f034-420c-9ea4-321f4607eb60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:05:00.015440 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ed66ac-3ae7-422f-aa2e-2850aaf99395 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:00.041267 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1336/2691] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:04:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:05:00.046017 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5de86c-f034-420c-9ea4-321f4607eb60 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:00.077362 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:05:00.088668 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c939c57-7c51-40ac-97d7-c04ca77e0c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:00.089517 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c939c57-7c51-40ac-97d7-c04ca77e0c04 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:00.090129 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c939c57-7c51-40ac-97d7-c04ca77e0c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:00.090749 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c939c57-7c51-40ac-97d7-c04ca77e0c04 admin admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:00.091994 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c939c57-7c51-40ac-97d7-c04ca77e0c04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:00.095036 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c939c57-7c51-40ac-97d7-c04ca77e0c04 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:00.123924 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1356/2692] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 15:04:59 2022] POST /identity/v3/users => generated 291 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:05:00.124664 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5de86c-f034-420c-9ea4-321f4607eb60 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:00.128101 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c939c57-7c51-40ac-97d7-c04ca77e0c04 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:00.130040 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117c9237-5a82-4a42-a755-edd4d772a543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:00.130893 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c9237-5a82-4a42-a755-edd4d772a543 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:00.131041 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c9237-5a82-4a42-a755-edd4d772a543 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:00.131317 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c9237-5a82-4a42-a755-edd4d772a543 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:00.131966 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117c9237-5a82-4a42-a755-edd4d772a543 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:00.133962 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117c9237-5a82-4a42-a755-edd4d772a543 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:00.138707 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c939c57-7c51-40ac-97d7-c04ca77e0c04 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:00.145845 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a861192-fc00-4465-a358-a7354e0f09ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:00.146246 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a861192-fc00-4465-a358-a7354e0f09ba admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:00.146549 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a861192-fc00-4465-a358-a7354e0f09ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:00.146786 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a861192-fc00-4465-a358-a7354e0f09ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:00.147437 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a861192-fc00-4465-a358-a7354e0f09ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:00.149189 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a861192-fc00-4465-a358-a7354e0f09ba admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:00.159828 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1357/2693] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 15:05:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:05:00.164286 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a861192-fc00-4465-a358-a7354e0f09ba admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:00.171918 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1337/2694] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 15:05:00 2022] POST /identity/v3/projects => generated 387 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:05:00.174283 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a861192-fc00-4465-a358-a7354e0f09ba admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:00.176231 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117c9237-5a82-4a42-a755-edd4d772a543 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:00.253795 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfd19cc-7645-44ae-aef9-383d9afcecf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:00.254602 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfd19cc-7645-44ae-aef9-383d9afcecf2 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:00.255051 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfd19cc-7645-44ae-aef9-383d9afcecf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:00.255512 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfd19cc-7645-44ae-aef9-383d9afcecf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:00.256742 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfd19cc-7645-44ae-aef9-383d9afcecf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:00.259578 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfd19cc-7645-44ae-aef9-383d9afcecf2 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:00.260339 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117c9237-5a82-4a42-a755-edd4d772a543 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:00.267201 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6017b3-357b-4db4-9382-2ee06158037b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:00.268032 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6017b3-357b-4db4-9382-2ee06158037b admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:00.268461 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6017b3-357b-4db4-9382-2ee06158037b admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:00.268899 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6017b3-357b-4db4-9382-2ee06158037b admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:00.269721 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6017b3-357b-4db4-9382-2ee06158037b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:00.272293 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6017b3-357b-4db4-9382-2ee06158037b admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:00.276842 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1358/2695] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 15:05:00 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 15:05:00.281154 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfd19cc-7645-44ae-aef9-383d9afcecf2 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:00.294469 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfd19cc-7645-44ae-aef9-383d9afcecf2 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:00.297885 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1338/2696] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 15:05:00 2022] POST /identity/v3/users => generated 300 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:05:00.302759 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc2b6c6-7747-402b-a201-4527091cf21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:00.303125 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6017b3-357b-4db4-9382-2ee06158037b admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:00.303890 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc2b6c6-7747-402b-a201-4527091cf21a admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:00.304373 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc2b6c6-7747-402b-a201-4527091cf21a admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:00.304839 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc2b6c6-7747-402b-a201-4527091cf21a admin admin] PATH_INFO: `/v3/projects/3251e2d5c25048898285a48d16ac4598/users/0a75c02eaed1429e875df112c175671c/roles/74de6794e3b3422b93d26f993d260c35` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:00.314646 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6017b3-357b-4db4-9382-2ee06158037b admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:00.322913 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b25f77-c8e6-4eed-a856-76d94ee520ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:00.323956 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b25f77-c8e6-4eed-a856-76d94ee520ae admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:00.324432 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b25f77-c8e6-4eed-a856-76d94ee520ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:00.325264 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b25f77-c8e6-4eed-a856-76d94ee520ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:00.326245 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b25f77-c8e6-4eed-a856-76d94ee520ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:00.326853 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc2b6c6-7747-402b-a201-4527091cf21a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3251e2d5c25048898285a48d16ac4598, user_id=0a75c02eaed1429e875df112c175671c, role_id=74de6794e3b3422b93d26f993d260c35)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:00.329157 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b25f77-c8e6-4eed-a856-76d94ee520ae admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:00.329635 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc2b6c6-7747-402b-a201-4527091cf21a admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:00.340410 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1339/2697] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 15:05:00 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 15:05:00.344615 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b25f77-c8e6-4eed-a856-76d94ee520ae admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:00.350775 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:05:00.352784 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1359/2698] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 15:05:00 2022] PUT /identity/v3/projects/3251e2d5c25048898285a48d16ac4598/users/0a75c02eaed1429e875df112c175671c/roles/74de6794e3b3422b93d26f993d260c35 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:05:00.356262 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b25f77-c8e6-4eed-a856-76d94ee520ae admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:00.357926 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65135a45-65fc-4ac0-bf31-818d282f8c09 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:00.358205 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65135a45-65fc-4ac0-bf31-818d282f8c09 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:00.358474 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65135a45-65fc-4ac0-bf31-818d282f8c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:00.383685 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-65135a45-65fc-4ac0-bf31-818d282f8c09 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:05:00.385045 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-65135a45-65fc-4ac0-bf31-818d282f8c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:05:00.439864 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff4392a-2b7b-4d73-99ec-fde85af9e532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:00.440560 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff4392a-2b7b-4d73-99ec-fde85af9e532 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:00.440839 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff4392a-2b7b-4d73-99ec-fde85af9e532 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:00.441154 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff4392a-2b7b-4d73-99ec-fde85af9e532 admin admin] PATH_INFO: `/v3/projects/4e8e9b99497647639d1d09b09a74b8e0/users/c8f9f7d4ae944cfa9f335bb4ceefea9f/roles/019bde1756cb40de8ce06cef6b261f79` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:00.470461 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff4392a-2b7b-4d73-99ec-fde85af9e532 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e8e9b99497647639d1d09b09a74b8e0, user_id=c8f9f7d4ae944cfa9f335bb4ceefea9f, role_id=019bde1756cb40de8ce06cef6b261f79)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:00.473564 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff4392a-2b7b-4d73-99ec-fde85af9e532 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:00.480256 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1360/2699] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:05:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:05:00.491113 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1340/2700] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 15:05:00 2022] PUT /identity/v3/projects/4e8e9b99497647639d1d09b09a74b8e0/users/c8f9f7d4ae944cfa9f335bb4ceefea9f/roles/019bde1756cb40de8ce06cef6b261f79 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:05:00.492444 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65135a45-65fc-4ac0-bf31-818d282f8c09 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:00.493906 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-65135a45-65fc-4ac0-bf31-818d282f8c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:05:00.496490 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff4392a-2b7b-4d73-99ec-fde85af9e532 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:00.563974 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:05:00.571159 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65135a45-65fc-4ac0-bf31-818d282f8c09 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:00.588627 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff4392a-2b7b-4d73-99ec-fde85af9e532 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:00.593677 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea8387b-1d28-49fd-9bad-09d6eb17e9f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:00.594303 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea8387b-1d28-49fd-9bad-09d6eb17e9f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:00.594594 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea8387b-1d28-49fd-9bad-09d6eb17e9f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:00.594863 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea8387b-1d28-49fd-9bad-09d6eb17e9f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:00.595523 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea8387b-1d28-49fd-9bad-09d6eb17e9f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:00.597217 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea8387b-1d28-49fd-9bad-09d6eb17e9f4 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:00.613165 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1341/2701] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 15:05:00 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:05:00.618230 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea8387b-1d28-49fd-9bad-09d6eb17e9f4 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:00.628687 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea8387b-1d28-49fd-9bad-09d6eb17e9f4 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:00.634259 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8386d6-c59f-4eab-a3f8-6c9fc7464e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:00.634937 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8386d6-c59f-4eab-a3f8-6c9fc7464e7d admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:00.635221 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8386d6-c59f-4eab-a3f8-6c9fc7464e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:00.635495 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8386d6-c59f-4eab-a3f8-6c9fc7464e7d admin admin] PATH_INFO: `/v3/projects/4e8e9b99497647639d1d09b09a74b8e0/users/c8f9f7d4ae944cfa9f335bb4ceefea9f/roles/019bde1756cb40de8ce06cef6b261f79` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:00.637532 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8386d6-c59f-4eab-a3f8-6c9fc7464e7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e8e9b99497647639d1d09b09a74b8e0, user_id=c8f9f7d4ae944cfa9f335bb4ceefea9f, role_id=019bde1756cb40de8ce06cef6b261f79)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:00.640251 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8386d6-c59f-4eab-a3f8-6c9fc7464e7d admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:00.641200 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36346949-2758-41e7-8b84-f01caff7401c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:00.641928 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36346949-2758-41e7-8b84-f01caff7401c service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:00.642298 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36346949-2758-41e7-8b84-f01caff7401c service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:00.642749 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36346949-2758-41e7-8b84-f01caff7401c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:00.651920 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1342/2702] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 15:05:00 2022] PUT /identity/v3/projects/4e8e9b99497647639d1d09b09a74b8e0/users/c8f9f7d4ae944cfa9f335bb4ceefea9f/roles/019bde1756cb40de8ce06cef6b261f79 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:05:00.653730 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36346949-2758-41e7-8b84-f01caff7401c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:00.655190 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36346949-2758-41e7-8b84-f01caff7401c service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:00.663155 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb1c970-60eb-4f33-b086-a7d4b0e4a8c5 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:00.663463 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb1c970-60eb-4f33-b086-a7d4b0e4a8c5 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:00.663724 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb1c970-60eb-4f33-b086-a7d4b0e4a8c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:00.668463 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1361/2703] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:05:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:05:00.702230 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-2cb1c970-60eb-4f33-b086-a7d4b0e4a8c5 None None] MFA Rules not processed for user `c8f9f7d4ae944cfa9f335bb4ceefea9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:05:00.703616 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2cb1c970-60eb-4f33-b086-a7d4b0e4a8c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:05:00.794008 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:05:00.810379 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1343/2704] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:05:00 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:05:00.824709 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36346949-2758-41e7-8b84-f01caff7401c service neutron] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:00.826695 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-36346949-2758-41e7-8b84-f01caff7401c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:05:00.913097 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36346949-2758-41e7-8b84-f01caff7401c service neutron] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:00.981693 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea80de1-317e-408b-86b4-19d404dcb551 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df648c909ddb41418128b43f925f5ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:00.982308 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea80de1-317e-408b-86b4-19d404dcb551 service cinder] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:00.982582 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea80de1-317e-408b-86b4-19d404dcb551 service cinder] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:00.982847 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea80de1-317e-408b-86b4-19d404dcb551 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:01.003262 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea80de1-317e-408b-86b4-19d404dcb551 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:01.006845 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea80de1-317e-408b-86b4-19d404dcb551 service cinder] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:01.024961 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1362/2705] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:05:00 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 15:05:01.492114 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e56978-e5d6-45a0-8683-67ce7eac136f None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:01.492664 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e56978-e5d6-45a0-8683-67ce7eac136f None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:01.492664 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e56978-e5d6-45a0-8683-67ce7eac136f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:01.526417 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-21e56978-e5d6-45a0-8683-67ce7eac136f None None] MFA Rules not processed for user `0a75c02eaed1429e875df112c175671c`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:05:01.527780 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-21e56978-e5d6-45a0-8683-67ce7eac136f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:05:01.606901 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1344/2706] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:05:01 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:05:01.620359 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea80de1-317e-408b-86b4-19d404dcb551 service cinder] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:01.621884 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-9ea80de1-317e-408b-86b4-19d404dcb551 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:05:01.634384 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea80de1-317e-408b-86b4-19d404dcb551 service cinder] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:01.638441 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cca424-ce33-4b2b-8823-a7318d152131 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df648c909ddb41418128b43f925f5ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:01.639152 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cca424-ce33-4b2b-8823-a7318d152131 service cinder] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:01.639556 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cca424-ce33-4b2b-8823-a7318d152131 service cinder] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:01.639922 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cca424-ce33-4b2b-8823-a7318d152131 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:01.651219 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cca424-ce33-4b2b-8823-a7318d152131 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:01.652891 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cca424-ce33-4b2b-8823-a7318d152131 service cinder] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:01.665635 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1363/2707] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:05:01 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 15:05:01.758081 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e56978-e5d6-45a0-8683-67ce7eac136f None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:01.849866 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e56978-e5d6-45a0-8683-67ce7eac136f None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:01.858024 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ff11e0-55c6-4106-b79d-a94bae0135fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:01.859229 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ff11e0-55c6-4106-b79d-a94bae0135fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:01.860011 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ff11e0-55c6-4106-b79d-a94bae0135fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:01.860392 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ff11e0-55c6-4106-b79d-a94bae0135fe admin admin] PATH_INFO: `/v3/users/5c82dc5ae0bd4840b763c8943e73b21c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:01.861735 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ff11e0-55c6-4106-b79d-a94bae0135fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c82dc5ae0bd4840b763c8943e73b21c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:01.863703 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ff11e0-55c6-4106-b79d-a94bae0135fe admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:01.918574 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a1ff11e0-55c6-4106-b79d-a94bae0135fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c82dc5ae0bd4840b763c8943e73b21c'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:01.928231 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a1ff11e0-55c6-4106-b79d-a94bae0135fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c82dc5ae0bd4840b763c8943e73b21c'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:01.929370 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a1ff11e0-55c6-4106-b79d-a94bae0135fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c82dc5ae0bd4840b763c8943e73b21c'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:01.930174 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a1ff11e0-55c6-4106-b79d-a94bae0135fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c82dc5ae0bd4840b763c8943e73b21c'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:01.938672 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a1ff11e0-55c6-4106-b79d-a94bae0135fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c82dc5ae0bd4840b763c8943e73b21c'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:01.962267 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1345/2708] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 15:05:01 2022] DELETE /identity/v3/users/5c82dc5ae0bd4840b763c8943e73b21c => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:05:01.967814 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916946d2-072c-4902-bba2-64b8695e2fea None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:01.968101 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916946d2-072c-4902-bba2-64b8695e2fea None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:01.968383 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916946d2-072c-4902-bba2-64b8695e2fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:02.005906 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-916946d2-072c-4902-bba2-64b8695e2fea None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:05:02.007310 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-916946d2-072c-4902-bba2-64b8695e2fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:05:02.067771 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:05:02.091160 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1364/2709] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:05:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:05:02.105894 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ff11e0-55c6-4106-b79d-a94bae0135fe admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:02.108274 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a1ff11e0-55c6-4106-b79d-a94bae0135fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:05:02.114499 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:05:02.180890 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ff11e0-55c6-4106-b79d-a94bae0135fe admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:02.184836 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d868f6-8102-4366-a974-238c97c23aae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:02.185477 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d868f6-8102-4366-a974-238c97c23aae service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:02.185760 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d868f6-8102-4366-a974-238c97c23aae service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:02.186048 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d868f6-8102-4366-a974-238c97c23aae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:02.197127 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d868f6-8102-4366-a974-238c97c23aae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:02.198588 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d868f6-8102-4366-a974-238c97c23aae service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:02.209794 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1346/2710] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:05:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:05:02.557953 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916946d2-072c-4902-bba2-64b8695e2fea None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:02.559421 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-916946d2-072c-4902-bba2-64b8695e2fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:05:02.572939 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916946d2-072c-4902-bba2-64b8695e2fea None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:02.579061 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83d8df0-6623-4e7c-892b-b31e35ba5928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:02.579717 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d8df0-6623-4e7c-892b-b31e35ba5928 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:02.580006 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d8df0-6623-4e7c-892b-b31e35ba5928 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:02.580258 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d8df0-6623-4e7c-892b-b31e35ba5928 admin admin] PATH_INFO: `/v3/projects/33ac89ef06ad4137bc67ea1197404aa3` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:02.581623 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83d8df0-6623-4e7c-892b-b31e35ba5928 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33ac89ef06ad4137bc67ea1197404aa3)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:02.583690 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83d8df0-6623-4e7c-892b-b31e35ba5928 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:02.640315 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-b83d8df0-6623-4e7c-892b-b31e35ba5928 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33ac89ef06ad4137bc67ea1197404aa3', 'request_id': 'req-b83d8df0-6623-4e7c-892b-b31e35ba5928'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:02.646674 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-b83d8df0-6623-4e7c-892b-b31e35ba5928 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33ac89ef06ad4137bc67ea1197404aa3', 'request_id': 'req-b83d8df0-6623-4e7c-892b-b31e35ba5928'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:02.665347 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-b83d8df0-6623-4e7c-892b-b31e35ba5928 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33ac89ef06ad4137bc67ea1197404aa3', 'request_id': 'req-b83d8df0-6623-4e7c-892b-b31e35ba5928'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:02.682844 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-b83d8df0-6623-4e7c-892b-b31e35ba5928 admin admin] The token cache is being invalidate because project 33ac89ef06ad4137bc67ea1197404aa3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:05:02.683115 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-b83d8df0-6623-4e7c-892b-b31e35ba5928 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:02.684070 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-b83d8df0-6623-4e7c-892b-b31e35ba5928 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:02.686238 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1365/2711] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 15:05:02 2022] DELETE /identity/v3/projects/33ac89ef06ad4137bc67ea1197404aa3 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:05:02.694237 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d868f6-8102-4366-a974-238c97c23aae service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:02.706262 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d868f6-8102-4366-a974-238c97c23aae service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:02.782739 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e0275e-16d2-4bd6-aedc-b38b384d0b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:02.783380 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0275e-16d2-4bd6-aedc-b38b384d0b25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:02.783656 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0275e-16d2-4bd6-aedc-b38b384d0b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:02.783925 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0275e-16d2-4bd6-aedc-b38b384d0b25 admin admin] PATH_INFO: `/v3/users/c8f9f7d4ae944cfa9f335bb4ceefea9f` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:02.785149 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e0275e-16d2-4bd6-aedc-b38b384d0b25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8f9f7d4ae944cfa9f335bb4ceefea9f)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:02.787705 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e0275e-16d2-4bd6-aedc-b38b384d0b25 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:02.848305 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-40e0275e-16d2-4bd6-aedc-b38b384d0b25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8f9f7d4ae944cfa9f335bb4ceefea9f'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:02.860089 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-40e0275e-16d2-4bd6-aedc-b38b384d0b25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8f9f7d4ae944cfa9f335bb4ceefea9f'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:02.860854 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-40e0275e-16d2-4bd6-aedc-b38b384d0b25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8f9f7d4ae944cfa9f335bb4ceefea9f'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:02.861582 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-40e0275e-16d2-4bd6-aedc-b38b384d0b25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8f9f7d4ae944cfa9f335bb4ceefea9f'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:02.870420 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-40e0275e-16d2-4bd6-aedc-b38b384d0b25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8f9f7d4ae944cfa9f335bb4ceefea9f'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:02.891122 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1347/2712] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 15:05:02 2022] DELETE /identity/v3/users/c8f9f7d4ae944cfa9f335bb4ceefea9f => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:05:03.137873 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c18c5-d851-42a0-95ec-e41ee0dffc32 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:03.138337 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c18c5-d851-42a0-95ec-e41ee0dffc32 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:03.138779 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c18c5-d851-42a0-95ec-e41ee0dffc32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:03.170481 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-980c18c5-d851-42a0-95ec-e41ee0dffc32 None None] MFA Rules not processed for user `0a75c02eaed1429e875df112c175671c`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:05:03.171659 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-980c18c5-d851-42a0-95ec-e41ee0dffc32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:05:03.243298 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1366/2713] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:05:03 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:05:03.535970 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e0275e-16d2-4bd6-aedc-b38b384d0b25 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:03.537780 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-40e0275e-16d2-4bd6-aedc-b38b384d0b25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:05:03.576712 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:05:03.620154 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e0275e-16d2-4bd6-aedc-b38b384d0b25 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:03.625059 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1b3ed6-3319-4bc0-b40a-f476aa865a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:03.625706 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1b3ed6-3319-4bc0-b40a-f476aa865a79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:03.625955 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1b3ed6-3319-4bc0-b40a-f476aa865a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:03.626252 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1b3ed6-3319-4bc0-b40a-f476aa865a79 admin admin] PATH_INFO: `/v3/projects/4e8e9b99497647639d1d09b09a74b8e0` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:03.627335 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1b3ed6-3319-4bc0-b40a-f476aa865a79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e8e9b99497647639d1d09b09a74b8e0)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:03.629286 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1b3ed6-3319-4bc0-b40a-f476aa865a79 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:03.696503 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-3f1b3ed6-3319-4bc0-b40a-f476aa865a79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e8e9b99497647639d1d09b09a74b8e0', 'request_id': 'req-3f1b3ed6-3319-4bc0-b40a-f476aa865a79'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:03.703932 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-3f1b3ed6-3319-4bc0-b40a-f476aa865a79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e8e9b99497647639d1d09b09a74b8e0', 'request_id': 'req-3f1b3ed6-3319-4bc0-b40a-f476aa865a79'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:03.715892 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-3f1b3ed6-3319-4bc0-b40a-f476aa865a79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e8e9b99497647639d1d09b09a74b8e0', 'request_id': 'req-3f1b3ed6-3319-4bc0-b40a-f476aa865a79'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:03.732978 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-3f1b3ed6-3319-4bc0-b40a-f476aa865a79 admin admin] The token cache is being invalidate because project 4e8e9b99497647639d1d09b09a74b8e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:05:03.733317 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-3f1b3ed6-3319-4bc0-b40a-f476aa865a79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:03.734046 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-3f1b3ed6-3319-4bc0-b40a-f476aa865a79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:03.735968 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1348/2714] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 15:05:03 2022] DELETE /identity/v3/projects/4e8e9b99497647639d1d09b09a74b8e0 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:05:03.744629 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50260dbc-4582-4202-a88c-52031adc6f43 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:03.745273 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50260dbc-4582-4202-a88c-52031adc6f43 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:03.745555 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50260dbc-4582-4202-a88c-52031adc6f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:03.776505 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-50260dbc-4582-4202-a88c-52031adc6f43 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:05:03.777764 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-50260dbc-4582-4202-a88c-52031adc6f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:05:03.876707 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1367/2715] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:05:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:05:03.887750 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aeff91-d902-41ea-89f0-161dc8ab4d7f None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:03.888499 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aeff91-d902-41ea-89f0-161dc8ab4d7f None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:03.888818 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aeff91-d902-41ea-89f0-161dc8ab4d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:03.923974 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-a5aeff91-d902-41ea-89f0-161dc8ab4d7f None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:05:03.925449 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a5aeff91-d902-41ea-89f0-161dc8ab4d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:05:03.935963 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1349/2716] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:05:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:05:03.940013 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50260dbc-4582-4202-a88c-52031adc6f43 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:03.951679 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50260dbc-4582-4202-a88c-52031adc6f43 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:03.956704 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a050ee-ef23-41fb-95fa-3f715b13f6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:03.957562 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a050ee-ef23-41fb-95fa-3f715b13f6a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:03.958030 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a050ee-ef23-41fb-95fa-3f715b13f6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:03.958949 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a050ee-ef23-41fb-95fa-3f715b13f6a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:03.959774 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a050ee-ef23-41fb-95fa-3f715b13f6a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:05:03.960231 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a050ee-ef23-41fb-95fa-3f715b13f6a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:03.962026 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a050ee-ef23-41fb-95fa-3f715b13f6a0 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:03.989173 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1368/2717] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 19 15:05:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:05:03.991889 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aeff91-d902-41ea-89f0-161dc8ab4d7f None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:04.003613 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aeff91-d902-41ea-89f0-161dc8ab4d7f None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:04.013322 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a2a520-dee0-4225-8cae-2ffe1db9d31b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:04.013322 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2a520-dee0-4225-8cae-2ffe1db9d31b admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:04.013322 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2a520-dee0-4225-8cae-2ffe1db9d31b admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:04.013765 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2a520-dee0-4225-8cae-2ffe1db9d31b admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:04.020550 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a2a520-dee0-4225-8cae-2ffe1db9d31b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:04.020550 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a2a520-dee0-4225-8cae-2ffe1db9d31b admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:04.060066 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1350/2718] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 15:05:03 2022] POST /identity/v3/projects => generated 385 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 15:05:04.064251 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a050ee-ef23-41fb-95fa-3f715b13f6a0 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:04.083338 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a050ee-ef23-41fb-95fa-3f715b13f6a0 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:04.088499 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:05:04.158740 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a17d02-b301-4a00-a453-88773993dfd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:04.159359 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a17d02-b301-4a00-a453-88773993dfd4 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:04.159644 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a17d02-b301-4a00-a453-88773993dfd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:04.159936 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a17d02-b301-4a00-a453-88773993dfd4 admin admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:04.160626 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a17d02-b301-4a00-a453-88773993dfd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:04.162952 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a17d02-b301-4a00-a453-88773993dfd4 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:04.208855 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1369/2719] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 15:05:04 2022] POST /identity/v3/users => generated 293 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:05:04.210052 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a2a520-dee0-4225-8cae-2ffe1db9d31b admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:04.226966 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a2a520-dee0-4225-8cae-2ffe1db9d31b admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:04.233288 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac616bf2-a016-4aab-9509-cc992408de25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:04.233907 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac616bf2-a016-4aab-9509-cc992408de25 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:04.234234 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac616bf2-a016-4aab-9509-cc992408de25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:04.234505 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac616bf2-a016-4aab-9509-cc992408de25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:04.235158 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac616bf2-a016-4aab-9509-cc992408de25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:04.236851 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac616bf2-a016-4aab-9509-cc992408de25 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:04.253845 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1351/2720] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 15:05:04 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:05:04.259034 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a17d02-b301-4a00-a453-88773993dfd4 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:04.270230 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a17d02-b301-4a00-a453-88773993dfd4 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:04.276334 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62e793e-c673-42c8-9d14-cf50ceb302a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:04.277041 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e793e-c673-42c8-9d14-cf50ceb302a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:04.277911 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e793e-c673-42c8-9d14-cf50ceb302a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:04.277911 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e793e-c673-42c8-9d14-cf50ceb302a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:04.278309 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62e793e-c673-42c8-9d14-cf50ceb302a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:04.279938 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62e793e-c673-42c8-9d14-cf50ceb302a9 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:04.292614 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1370/2721] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 15:05:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 15:05:04.296827 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac616bf2-a016-4aab-9509-cc992408de25 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:04.309895 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac616bf2-a016-4aab-9509-cc992408de25 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:04.316892 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6dc16a-40b8-4ce1-ba2f-08c4546ceb3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:04.318005 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6dc16a-40b8-4ce1-ba2f-08c4546ceb3f admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:04.318447 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6dc16a-40b8-4ce1-ba2f-08c4546ceb3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:04.318823 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6dc16a-40b8-4ce1-ba2f-08c4546ceb3f admin admin] PATH_INFO: `/v3/projects/0305f9b548f243729cdc8fb9575e40b0/users/f5e67240d9fe46cba930853cdbd0f058/roles/74de6794e3b3422b93d26f993d260c35` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:04.344124 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6dc16a-40b8-4ce1-ba2f-08c4546ceb3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0305f9b548f243729cdc8fb9575e40b0, user_id=f5e67240d9fe46cba930853cdbd0f058, role_id=74de6794e3b3422b93d26f993d260c35)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:04.347065 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6dc16a-40b8-4ce1-ba2f-08c4546ceb3f admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:04.363545 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1352/2722] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 15:05:04 2022] PUT /identity/v3/projects/0305f9b548f243729cdc8fb9575e40b0/users/f5e67240d9fe46cba930853cdbd0f058/roles/74de6794e3b3422b93d26f993d260c35 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:05:04.375050 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d19d6ce-4490-4bd4-b03f-722d84596347 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:04.375201 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d19d6ce-4490-4bd4-b03f-722d84596347 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:04.375486 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d19d6ce-4490-4bd4-b03f-722d84596347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:04.407569 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-7d19d6ce-4490-4bd4-b03f-722d84596347 None None] MFA Rules not processed for user `f5e67240d9fe46cba930853cdbd0f058`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:05:04.408762 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-7d19d6ce-4490-4bd4-b03f-722d84596347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:05:04.499270 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1371/2723] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:05:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:05:04.513725 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6dc16a-40b8-4ce1-ba2f-08c4546ceb3f admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:04.517236 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-6b6dc16a-40b8-4ce1-ba2f-08c4546ceb3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:05:04.612716 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6dc16a-40b8-4ce1-ba2f-08c4546ceb3f admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:04.617418 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96599a74-8d60-4daf-9089-be67866a99a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df648c909ddb41418128b43f925f5ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:04.618206 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96599a74-8d60-4daf-9089-be67866a99a6 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:04.618489 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96599a74-8d60-4daf-9089-be67866a99a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:04.618764 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96599a74-8d60-4daf-9089-be67866a99a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:04.625342 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:05:04.629453 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96599a74-8d60-4daf-9089-be67866a99a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:04.632025 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96599a74-8d60-4daf-9089-be67866a99a6 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:04.646065 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1353/2724] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:05:04 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:05:04.666680 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d19d6ce-4490-4bd4-b03f-722d84596347 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:04.752227 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d19d6ce-4490-4bd4-b03f-722d84596347 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:04.759933 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824e4028-2741-4c39-9d77-a5d41abbf9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:04.760798 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e4028-2741-4c39-9d77-a5d41abbf9fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:04.761198 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e4028-2741-4c39-9d77-a5d41abbf9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:04.761587 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e4028-2741-4c39-9d77-a5d41abbf9fd admin admin] PATH_INFO: `/v3/users/f5e67240d9fe46cba930853cdbd0f058` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:04.762928 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824e4028-2741-4c39-9d77-a5d41abbf9fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5e67240d9fe46cba930853cdbd0f058)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:04.765719 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824e4028-2741-4c39-9d77-a5d41abbf9fd admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:04.795377 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:05:04.838023 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-824e4028-2741-4c39-9d77-a5d41abbf9fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5e67240d9fe46cba930853cdbd0f058'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:04.850801 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-824e4028-2741-4c39-9d77-a5d41abbf9fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5e67240d9fe46cba930853cdbd0f058'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:04.851848 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-824e4028-2741-4c39-9d77-a5d41abbf9fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5e67240d9fe46cba930853cdbd0f058'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:04.852812 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-824e4028-2741-4c39-9d77-a5d41abbf9fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5e67240d9fe46cba930853cdbd0f058'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:04.873281 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-824e4028-2741-4c39-9d77-a5d41abbf9fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5e67240d9fe46cba930853cdbd0f058'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:04.888604 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1372/2725] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 15:05:04 2022] DELETE /identity/v3/users/f5e67240d9fe46cba930853cdbd0f058 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:05:04.894823 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07d5e9b-14ac-4ad9-9705-2707669cffe5 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:04.895484 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07d5e9b-14ac-4ad9-9705-2707669cffe5 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:04.895484 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07d5e9b-14ac-4ad9-9705-2707669cffe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:04.916790 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-d07d5e9b-14ac-4ad9-9705-2707669cffe5 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:05:04.918212 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d07d5e9b-14ac-4ad9-9705-2707669cffe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:05:04.982887 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1354/2726] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:05:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:05:04.995167 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824e4028-2741-4c39-9d77-a5d41abbf9fd admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:04.996792 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-824e4028-2741-4c39-9d77-a5d41abbf9fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:05:05.066354 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824e4028-2741-4c39-9d77-a5d41abbf9fd admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:05.070733 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45bda58-4bbd-4a49-8098-4ab606b5febf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:05.071361 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45bda58-4bbd-4a49-8098-4ab606b5febf service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:05.071637 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45bda58-4bbd-4a49-8098-4ab606b5febf service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:05.071904 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45bda58-4bbd-4a49-8098-4ab606b5febf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:05.086226 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45bda58-4bbd-4a49-8098-4ab606b5febf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:05.087786 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45bda58-4bbd-4a49-8098-4ab606b5febf service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:05.099459 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1373/2727] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:05:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:05:05.452273 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07d5e9b-14ac-4ad9-9705-2707669cffe5 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:05.453812 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d07d5e9b-14ac-4ad9-9705-2707669cffe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:05:05.467429 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07d5e9b-14ac-4ad9-9705-2707669cffe5 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:05.473291 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d3b457-6cdf-4f68-bb25-a96fe9209d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:05.474026 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d3b457-6cdf-4f68-bb25-a96fe9209d91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:05.474452 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d3b457-6cdf-4f68-bb25-a96fe9209d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:05.474766 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d3b457-6cdf-4f68-bb25-a96fe9209d91 admin admin] PATH_INFO: `/v3/projects/0305f9b548f243729cdc8fb9575e40b0` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:05.476255 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d3b457-6cdf-4f68-bb25-a96fe9209d91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0305f9b548f243729cdc8fb9575e40b0)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:05.478307 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d3b457-6cdf-4f68-bb25-a96fe9209d91 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:05.543170 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e4d3b457-6cdf-4f68-bb25-a96fe9209d91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0305f9b548f243729cdc8fb9575e40b0', 'request_id': 'req-e4d3b457-6cdf-4f68-bb25-a96fe9209d91'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:05.556908 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e4d3b457-6cdf-4f68-bb25-a96fe9209d91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0305f9b548f243729cdc8fb9575e40b0', 'request_id': 'req-e4d3b457-6cdf-4f68-bb25-a96fe9209d91'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:05.567174 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e4d3b457-6cdf-4f68-bb25-a96fe9209d91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0305f9b548f243729cdc8fb9575e40b0', 'request_id': 'req-e4d3b457-6cdf-4f68-bb25-a96fe9209d91'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:05.582799 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e4d3b457-6cdf-4f68-bb25-a96fe9209d91 admin admin] The token cache is being invalidate because project 0305f9b548f243729cdc8fb9575e40b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:05:05.583087 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e4d3b457-6cdf-4f68-bb25-a96fe9209d91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:05.583871 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e4d3b457-6cdf-4f68-bb25-a96fe9209d91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:05.590222 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1355/2728] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 15:05:05 2022] DELETE /identity/v3/projects/0305f9b548f243729cdc8fb9575e40b0 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:05:05.590829 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ecc7ac-e170-4449-a0f7-3626e3beae3f None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:05.591105 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ecc7ac-e170-4449-a0f7-3626e3beae3f None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:05.591367 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ecc7ac-e170-4449-a0f7-3626e3beae3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:05.612540 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-59ecc7ac-e170-4449-a0f7-3626e3beae3f None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:05:05.613918 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-59ecc7ac-e170-4449-a0f7-3626e3beae3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:05:05.690846 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1374/2729] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:05:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:05:05.700886 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53082f45-eb88-41e5-b13b-dc482cd48d99 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:05.701194 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53082f45-eb88-41e5-b13b-dc482cd48d99 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:05.701493 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53082f45-eb88-41e5-b13b-dc482cd48d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:05.739043 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-53082f45-eb88-41e5-b13b-dc482cd48d99 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:05:05.740375 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-53082f45-eb88-41e5-b13b-dc482cd48d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:05:05.753159 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1356/2730] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:05:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:05:05.754694 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ecc7ac-e170-4449-a0f7-3626e3beae3f None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:05.768827 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ecc7ac-e170-4449-a0f7-3626e3beae3f None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:05.775548 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d9482c-ba2c-4b49-bad1-85545d855dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:05.776461 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d9482c-ba2c-4b49-bad1-85545d855dcb admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:05.776896 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d9482c-ba2c-4b49-bad1-85545d855dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:05.777294 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d9482c-ba2c-4b49-bad1-85545d855dcb admin admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:05.778047 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d9482c-ba2c-4b49-bad1-85545d855dcb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:05:05.778395 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d9482c-ba2c-4b49-bad1-85545d855dcb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:05.780534 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d9482c-ba2c-4b49-bad1-85545d855dcb admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:05.796072 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1375/2731] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 19 15:05:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:05:05.800566 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53082f45-eb88-41e5-b13b-dc482cd48d99 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:05.811770 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53082f45-eb88-41e5-b13b-dc482cd48d99 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:05.817476 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14c3528-805f-407e-b102-1b6317e97e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:05.818101 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c3528-805f-407e-b102-1b6317e97e14 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:05.818521 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c3528-805f-407e-b102-1b6317e97e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:05.819313 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c3528-805f-407e-b102-1b6317e97e14 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:05.819965 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14c3528-805f-407e-b102-1b6317e97e14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:05.821939 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14c3528-805f-407e-b102-1b6317e97e14 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:05.858567 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1357/2732] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 15:05:05 2022] POST /identity/v3/projects => generated 371 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:05:05.859847 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d9482c-ba2c-4b49-bad1-85545d855dcb admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:05.871788 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d9482c-ba2c-4b49-bad1-85545d855dcb admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:05.899247 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:05:05.954936 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaba76d6-8be8-4a1f-8c19-83ec50fd8606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:05.955546 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba76d6-8be8-4a1f-8c19-83ec50fd8606 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:05.955825 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba76d6-8be8-4a1f-8c19-83ec50fd8606 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:05.956097 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba76d6-8be8-4a1f-8c19-83ec50fd8606 admin admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:05.956762 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaba76d6-8be8-4a1f-8c19-83ec50fd8606 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:05.958787 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaba76d6-8be8-4a1f-8c19-83ec50fd8606 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:05.987127 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1376/2733] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 15:05:05 2022] POST /identity/v3/users => generated 286 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:05:05.992189 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14c3528-805f-407e-b102-1b6317e97e14 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:06.005646 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14c3528-805f-407e-b102-1b6317e97e14 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:06.011583 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bbf85a-5363-4b9e-a5c6-cb2fc1aad78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:06.012236 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bbf85a-5363-4b9e-a5c6-cb2fc1aad78a admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:06.012512 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bbf85a-5363-4b9e-a5c6-cb2fc1aad78a admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:06.012791 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bbf85a-5363-4b9e-a5c6-cb2fc1aad78a admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:06.013468 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bbf85a-5363-4b9e-a5c6-cb2fc1aad78a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:06.015135 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bbf85a-5363-4b9e-a5c6-cb2fc1aad78a admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:06.029768 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1358/2734] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 15:05:05 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 15:05:06.037557 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaba76d6-8be8-4a1f-8c19-83ec50fd8606 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:06.055014 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaba76d6-8be8-4a1f-8c19-83ec50fd8606 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:06.060238 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60b492c-7c08-47c3-bb9b-cc343c4ad940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:06.060947 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60b492c-7c08-47c3-bb9b-cc343c4ad940 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:06.061314 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60b492c-7c08-47c3-bb9b-cc343c4ad940 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:06.061654 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60b492c-7c08-47c3-bb9b-cc343c4ad940 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:06.062440 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60b492c-7c08-47c3-bb9b-cc343c4ad940 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:06.064063 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60b492c-7c08-47c3-bb9b-cc343c4ad940 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:06.076358 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1377/2735] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 15:05:06 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 15:05:06.080923 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bbf85a-5363-4b9e-a5c6-cb2fc1aad78a admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:06.091965 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bbf85a-5363-4b9e-a5c6-cb2fc1aad78a admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:06.099304 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a0b0db-551a-4bcf-b990-44b3b4529ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:06.100412 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a0b0db-551a-4bcf-b990-44b3b4529ed9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:06.100882 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a0b0db-551a-4bcf-b990-44b3b4529ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:06.101311 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a0b0db-551a-4bcf-b990-44b3b4529ed9 admin admin] PATH_INFO: `/v3/projects/6902d01dee114ab6999bf8602a088012/users/1ee1a994bcb1485c80588a3e14000373/roles/74de6794e3b3422b93d26f993d260c35` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:06.124796 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a0b0db-551a-4bcf-b990-44b3b4529ed9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6902d01dee114ab6999bf8602a088012, user_id=1ee1a994bcb1485c80588a3e14000373, role_id=74de6794e3b3422b93d26f993d260c35)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:06.128634 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a0b0db-551a-4bcf-b990-44b3b4529ed9 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:06.146044 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1359/2736] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 15:05:06 2022] PUT /identity/v3/projects/6902d01dee114ab6999bf8602a088012/users/1ee1a994bcb1485c80588a3e14000373/roles/74de6794e3b3422b93d26f993d260c35 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:05:06.160041 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a9511e-42d6-4dac-9747-e52816a1e414 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:06.160330 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a9511e-42d6-4dac-9747-e52816a1e414 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:06.160603 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a9511e-42d6-4dac-9747-e52816a1e414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:06.199850 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-d6a9511e-42d6-4dac-9747-e52816a1e414 None None] MFA Rules not processed for user `1ee1a994bcb1485c80588a3e14000373`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:05:06.200874 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-d6a9511e-42d6-4dac-9747-e52816a1e414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:05:06.288863 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1378/2737] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:05:06 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:05:06.302564 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a0b0db-551a-4bcf-b990-44b3b4529ed9 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:06.304152 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-06a0b0db-551a-4bcf-b990-44b3b4529ed9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:05:06.323538 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:05:06.386211 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a0b0db-551a-4bcf-b990-44b3b4529ed9 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:06.390927 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651c1a74-7f2d-4abe-ac85-78e18d95b161 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df648c909ddb41418128b43f925f5ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:06.391370 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c1a74-7f2d-4abe-ac85-78e18d95b161 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:06.391602 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c1a74-7f2d-4abe-ac85-78e18d95b161 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:06.391898 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c1a74-7f2d-4abe-ac85-78e18d95b161 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:06.403239 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651c1a74-7f2d-4abe-ac85-78e18d95b161 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:06.405625 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651c1a74-7f2d-4abe-ac85-78e18d95b161 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:06.416024 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1360/2738] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:05:06 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:05:06.439712 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a9511e-42d6-4dac-9747-e52816a1e414 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:06.533063 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a9511e-42d6-4dac-9747-e52816a1e414 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:06.538517 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151b98a2-7d9e-4ea2-80e3-569edcc4b90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:06.539242 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151b98a2-7d9e-4ea2-80e3-569edcc4b90f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:06.539589 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151b98a2-7d9e-4ea2-80e3-569edcc4b90f admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:06.540240 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151b98a2-7d9e-4ea2-80e3-569edcc4b90f admin admin] PATH_INFO: `/v3/users/1ee1a994bcb1485c80588a3e14000373` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:06.541556 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151b98a2-7d9e-4ea2-80e3-569edcc4b90f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ee1a994bcb1485c80588a3e14000373)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:06.543762 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151b98a2-7d9e-4ea2-80e3-569edcc4b90f admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:06.611220 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:05:06.623192 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-151b98a2-7d9e-4ea2-80e3-569edcc4b90f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ee1a994bcb1485c80588a3e14000373'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:06.635483 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-151b98a2-7d9e-4ea2-80e3-569edcc4b90f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ee1a994bcb1485c80588a3e14000373'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:06.636391 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-151b98a2-7d9e-4ea2-80e3-569edcc4b90f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ee1a994bcb1485c80588a3e14000373'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:06.641032 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-151b98a2-7d9e-4ea2-80e3-569edcc4b90f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ee1a994bcb1485c80588a3e14000373'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:06.660828 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-151b98a2-7d9e-4ea2-80e3-569edcc4b90f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ee1a994bcb1485c80588a3e14000373'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:06.679125 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1379/2739] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 15:05:06 2022] DELETE /identity/v3/users/1ee1a994bcb1485c80588a3e14000373 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:05:06.682881 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec686cc7-946a-48af-95ea-f216dee374b1 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:06.683511 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec686cc7-946a-48af-95ea-f216dee374b1 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:06.683788 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec686cc7-946a-48af-95ea-f216dee374b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:06.709196 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-ec686cc7-946a-48af-95ea-f216dee374b1 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:05:06.710301 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ec686cc7-946a-48af-95ea-f216dee374b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:05:06.794388 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1361/2740] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:05:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:05:06.807548 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151b98a2-7d9e-4ea2-80e3-569edcc4b90f admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:06.810443 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-151b98a2-7d9e-4ea2-80e3-569edcc4b90f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:05:06.905573 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151b98a2-7d9e-4ea2-80e3-569edcc4b90f admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:06.909868 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976591ad-4f1f-4a66-9adb-9070d89dd38e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:06.910492 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976591ad-4f1f-4a66-9adb-9070d89dd38e service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:06.910827 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976591ad-4f1f-4a66-9adb-9070d89dd38e service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:06.911167 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976591ad-4f1f-4a66-9adb-9070d89dd38e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:06.923268 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976591ad-4f1f-4a66-9adb-9070d89dd38e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:06.924614 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976591ad-4f1f-4a66-9adb-9070d89dd38e service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:06.938607 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1380/2741] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:05:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 15:05:07.334815 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec686cc7-946a-48af-95ea-f216dee374b1 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:07.336323 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ec686cc7-946a-48af-95ea-f216dee374b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:05:07.359802 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec686cc7-946a-48af-95ea-f216dee374b1 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:07.371498 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f241d79b-5842-4ce1-b764-cad787cb43d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:07.372595 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f241d79b-5842-4ce1-b764-cad787cb43d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:07.373646 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f241d79b-5842-4ce1-b764-cad787cb43d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:07.373989 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f241d79b-5842-4ce1-b764-cad787cb43d5 admin admin] PATH_INFO: `/v3/projects/6902d01dee114ab6999bf8602a088012` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:07.375997 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f241d79b-5842-4ce1-b764-cad787cb43d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6902d01dee114ab6999bf8602a088012)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:07.378138 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f241d79b-5842-4ce1-b764-cad787cb43d5 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:07.441094 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f241d79b-5842-4ce1-b764-cad787cb43d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6902d01dee114ab6999bf8602a088012', 'request_id': 'req-f241d79b-5842-4ce1-b764-cad787cb43d5'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:07.452727 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f241d79b-5842-4ce1-b764-cad787cb43d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6902d01dee114ab6999bf8602a088012', 'request_id': 'req-f241d79b-5842-4ce1-b764-cad787cb43d5'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:07.467427 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f241d79b-5842-4ce1-b764-cad787cb43d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6902d01dee114ab6999bf8602a088012', 'request_id': 'req-f241d79b-5842-4ce1-b764-cad787cb43d5'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:07.481274 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f241d79b-5842-4ce1-b764-cad787cb43d5 admin admin] The token cache is being invalidate because project 6902d01dee114ab6999bf8602a088012 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:05:07.481727 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f241d79b-5842-4ce1-b764-cad787cb43d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:07.482612 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f241d79b-5842-4ce1-b764-cad787cb43d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:07.484428 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1362/2742] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 15:05:07 2022] DELETE /identity/v3/projects/6902d01dee114ab6999bf8602a088012 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:05:07.491811 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40b44f4-34dd-4f52-9e97-f1e3a07c0e6a None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:07.492567 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40b44f4-34dd-4f52-9e97-f1e3a07c0e6a None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:07.493573 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40b44f4-34dd-4f52-9e97-f1e3a07c0e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:07.523104 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-a40b44f4-34dd-4f52-9e97-f1e3a07c0e6a None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:05:07.524561 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-a40b44f4-34dd-4f52-9e97-f1e3a07c0e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:05:07.602415 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1381/2743] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:05:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:05:07.610366 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9258d971-761d-44ff-8d31-ef04827170cb None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:07.610649 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9258d971-761d-44ff-8d31-ef04827170cb None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:07.610923 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9258d971-761d-44ff-8d31-ef04827170cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:07.634080 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-9258d971-761d-44ff-8d31-ef04827170cb None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:05:07.635325 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-9258d971-761d-44ff-8d31-ef04827170cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:05:07.644392 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1363/2744] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:05:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:05:07.649535 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40b44f4-34dd-4f52-9e97-f1e3a07c0e6a None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:07.660232 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40b44f4-34dd-4f52-9e97-f1e3a07c0e6a None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:07.668014 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eb1d13-1798-4329-9c03-26545fe1a777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:07.668799 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eb1d13-1798-4329-9c03-26545fe1a777 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:07.668926 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eb1d13-1798-4329-9c03-26545fe1a777 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:07.669172 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eb1d13-1798-4329-9c03-26545fe1a777 admin admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:07.669859 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eb1d13-1798-4329-9c03-26545fe1a777 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:05:07.670157 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eb1d13-1798-4329-9c03-26545fe1a777 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:07.671767 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eb1d13-1798-4329-9c03-26545fe1a777 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:07.684674 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1382/2745] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 19 15:05:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 15:05:07.691523 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9258d971-761d-44ff-8d31-ef04827170cb None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:07.703447 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9258d971-761d-44ff-8d31-ef04827170cb None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:07.708285 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf9e32f-8086-476d-bdaa-756a0fb50422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:07.708936 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf9e32f-8086-476d-bdaa-756a0fb50422 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:07.709301 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf9e32f-8086-476d-bdaa-756a0fb50422 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:07.709568 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf9e32f-8086-476d-bdaa-756a0fb50422 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:07.710225 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf9e32f-8086-476d-bdaa-756a0fb50422 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:07.712137 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf9e32f-8086-476d-bdaa-756a0fb50422 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:07.750247 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1364/2746] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 15:05:07 2022] POST /identity/v3/projects => generated 377 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:05:07.753845 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eb1d13-1798-4329-9c03-26545fe1a777 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:07.771796 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eb1d13-1798-4329-9c03-26545fe1a777 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:07.829311 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:05:07.850488 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549247bd-161f-4fcf-b154-0d00c8852049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:07.851029 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549247bd-161f-4fcf-b154-0d00c8852049 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:07.851300 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549247bd-161f-4fcf-b154-0d00c8852049 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:07.851563 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549247bd-161f-4fcf-b154-0d00c8852049 admin admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:07.852219 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549247bd-161f-4fcf-b154-0d00c8852049 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:07.854194 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549247bd-161f-4fcf-b154-0d00c8852049 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:07.878840 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1383/2747] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 15:05:07 2022] POST /identity/v3/users => generated 289 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 15:05:07.883430 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf9e32f-8086-476d-bdaa-756a0fb50422 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:07.898241 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf9e32f-8086-476d-bdaa-756a0fb50422 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:07.904002 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd825f9-76c5-4208-b823-5e06beaba4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:07.904625 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd825f9-76c5-4208-b823-5e06beaba4c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:07.904873 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd825f9-76c5-4208-b823-5e06beaba4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:07.905199 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd825f9-76c5-4208-b823-5e06beaba4c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:07.905834 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd825f9-76c5-4208-b823-5e06beaba4c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:07.907480 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd825f9-76c5-4208-b823-5e06beaba4c1 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:07.914841 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:05:07.922105 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1365/2748] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 15:05:07 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:05:07.926296 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549247bd-161f-4fcf-b154-0d00c8852049 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:07.937973 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549247bd-161f-4fcf-b154-0d00c8852049 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:07.943586 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0841a80c-c32a-46b3-8102-33e06140b138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:07.944280 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0841a80c-c32a-46b3-8102-33e06140b138 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:07.944554 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0841a80c-c32a-46b3-8102-33e06140b138 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:07.944816 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0841a80c-c32a-46b3-8102-33e06140b138 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:07.945487 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0841a80c-c32a-46b3-8102-33e06140b138 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:07.947100 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0841a80c-c32a-46b3-8102-33e06140b138 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:07.958824 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1384/2749] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 15:05:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:05:07.963669 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd825f9-76c5-4208-b823-5e06beaba4c1 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:07.978766 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd825f9-76c5-4208-b823-5e06beaba4c1 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:07.983649 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9d1e85-76ec-4703-a2f5-46c4db2bc6be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:07.984325 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d1e85-76ec-4703-a2f5-46c4db2bc6be admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:07.984598 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d1e85-76ec-4703-a2f5-46c4db2bc6be admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:07.984869 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d1e85-76ec-4703-a2f5-46c4db2bc6be admin admin] PATH_INFO: `/v3/projects/f01fff3903e2406c90e50be238e80cfd/users/384af4c71d8746ff8b92af4e46efb350/roles/74de6794e3b3422b93d26f993d260c35` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:08.002322 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9d1e85-76ec-4703-a2f5-46c4db2bc6be admin admin] RBAC: Authorizing `identity:create_grant(project_id=f01fff3903e2406c90e50be238e80cfd, user_id=384af4c71d8746ff8b92af4e46efb350, role_id=74de6794e3b3422b93d26f993d260c35)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:08.005153 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9d1e85-76ec-4703-a2f5-46c4db2bc6be admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:08.022476 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1366/2750] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 15:05:07 2022] PUT /identity/v3/projects/f01fff3903e2406c90e50be238e80cfd/users/384af4c71d8746ff8b92af4e46efb350/roles/74de6794e3b3422b93d26f993d260c35 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:05:08.040921 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de34fe-821f-4b3c-ab49-926a33e1149f None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:08.041235 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de34fe-821f-4b3c-ab49-926a33e1149f None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:08.041504 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de34fe-821f-4b3c-ab49-926a33e1149f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:08.079155 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-c9de34fe-821f-4b3c-ab49-926a33e1149f None None] MFA Rules not processed for user `384af4c71d8746ff8b92af4e46efb350`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:05:08.082399 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-c9de34fe-821f-4b3c-ab49-926a33e1149f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:05:08.170274 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1385/2751] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:05:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:05:08.174718 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9d1e85-76ec-4703-a2f5-46c4db2bc6be admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:08.257762 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9d1e85-76ec-4703-a2f5-46c4db2bc6be admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:08.262639 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb658bf6-5e82-47d3-9c11-2a2d0a5bffd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:08.263247 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb658bf6-5e82-47d3-9c11-2a2d0a5bffd7 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:08.263531 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb658bf6-5e82-47d3-9c11-2a2d0a5bffd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:08.263806 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb658bf6-5e82-47d3-9c11-2a2d0a5bffd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:08.264542 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb658bf6-5e82-47d3-9c11-2a2d0a5bffd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:08.266530 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb658bf6-5e82-47d3-9c11-2a2d0a5bffd7 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:08.305386 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1367/2752] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 15:05:08 2022] POST /identity/v3/projects => generated 375 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:05:08.310137 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9de34fe-821f-4b3c-ab49-926a33e1149f None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:08.322221 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9de34fe-821f-4b3c-ab49-926a33e1149f None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:08.387693 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aefa81f-5557-46a9-b3ee-7918610a5a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:08.388308 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aefa81f-5557-46a9-b3ee-7918610a5a19 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:08.388581 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aefa81f-5557-46a9-b3ee-7918610a5a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:08.388847 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aefa81f-5557-46a9-b3ee-7918610a5a19 admin admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:08.389542 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aefa81f-5557-46a9-b3ee-7918610a5a19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:08.391464 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aefa81f-5557-46a9-b3ee-7918610a5a19 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:08.416525 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1386/2753] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 15:05:08 2022] POST /identity/v3/users => generated 288 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:05:08.421664 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb658bf6-5e82-47d3-9c11-2a2d0a5bffd7 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:08.435332 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb658bf6-5e82-47d3-9c11-2a2d0a5bffd7 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:08.443022 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00abd984-9b55-41bd-a01f-6767d4343971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:08.444414 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00abd984-9b55-41bd-a01f-6767d4343971 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:08.444901 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00abd984-9b55-41bd-a01f-6767d4343971 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:08.445433 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00abd984-9b55-41bd-a01f-6767d4343971 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:08.446593 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00abd984-9b55-41bd-a01f-6767d4343971 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:08.449631 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00abd984-9b55-41bd-a01f-6767d4343971 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:08.465936 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1368/2754] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 15:05:08 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:05:08.470760 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aefa81f-5557-46a9-b3ee-7918610a5a19 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:08.483030 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aefa81f-5557-46a9-b3ee-7918610a5a19 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:08.487993 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9119f85f-0220-49ad-843b-08cdffe1799d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:08.488596 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9119f85f-0220-49ad-843b-08cdffe1799d admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:08.488867 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9119f85f-0220-49ad-843b-08cdffe1799d admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:08.489304 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9119f85f-0220-49ad-843b-08cdffe1799d admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:08.490000 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9119f85f-0220-49ad-843b-08cdffe1799d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:08.492192 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9119f85f-0220-49ad-843b-08cdffe1799d admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:08.504159 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1387/2755] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 15:05:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:05:08.508794 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00abd984-9b55-41bd-a01f-6767d4343971 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:08.520353 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00abd984-9b55-41bd-a01f-6767d4343971 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:08.526277 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6a29c5-af44-430c-830d-800899a55ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:08.526934 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a29c5-af44-430c-830d-800899a55ff4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:08.527206 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a29c5-af44-430c-830d-800899a55ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:08.527510 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a29c5-af44-430c-830d-800899a55ff4 admin admin] PATH_INFO: `/v3/projects/3539b0e7561a461a9d7af81ebf80dd8e/users/a3765c9a370e46e3b914401e51206277/roles/74de6794e3b3422b93d26f993d260c35` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:08.550615 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6a29c5-af44-430c-830d-800899a55ff4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3539b0e7561a461a9d7af81ebf80dd8e, user_id=a3765c9a370e46e3b914401e51206277, role_id=74de6794e3b3422b93d26f993d260c35)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:08.553738 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6a29c5-af44-430c-830d-800899a55ff4 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:08.571885 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1369/2756] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 15:05:08 2022] PUT /identity/v3/projects/3539b0e7561a461a9d7af81ebf80dd8e/users/a3765c9a370e46e3b914401e51206277/roles/74de6794e3b3422b93d26f993d260c35 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:05:08.583785 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad02beb4-20e8-4453-ac3f-4d2c06f3c5e7 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:08.584242 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad02beb4-20e8-4453-ac3f-4d2c06f3c5e7 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:08.584639 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad02beb4-20e8-4453-ac3f-4d2c06f3c5e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:08.616424 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-ad02beb4-20e8-4453-ac3f-4d2c06f3c5e7 None None] MFA Rules not processed for user `a3765c9a370e46e3b914401e51206277`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:05:08.617710 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-ad02beb4-20e8-4453-ac3f-4d2c06f3c5e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:05:08.640447 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:05:08.711159 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1388/2757] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:05:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:05:08.715844 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6a29c5-af44-430c-830d-800899a55ff4 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:08.790427 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6a29c5-af44-430c-830d-800899a55ff4 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:08.800114 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d488e73-9e8a-42fe-b321-c1508f6a5917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:08.801119 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d488e73-9e8a-42fe-b321-c1508f6a5917 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:08.801466 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d488e73-9e8a-42fe-b321-c1508f6a5917 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:08.801721 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d488e73-9e8a-42fe-b321-c1508f6a5917 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:08.802419 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d488e73-9e8a-42fe-b321-c1508f6a5917 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:08.804433 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d488e73-9e8a-42fe-b321-c1508f6a5917 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:08.839584 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1370/2758] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 15:05:08 2022] POST /identity/v3/projects => generated 375 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 15:05:08.845232 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad02beb4-20e8-4453-ac3f-4d2c06f3c5e7 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:08.857125 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad02beb4-20e8-4453-ac3f-4d2c06f3c5e7 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:08.939659 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68966f2-5961-49dd-ab22-0af947a69964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:08.940271 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68966f2-5961-49dd-ab22-0af947a69964 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:08.940550 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68966f2-5961-49dd-ab22-0af947a69964 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:08.940824 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68966f2-5961-49dd-ab22-0af947a69964 admin admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:08.941504 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68966f2-5961-49dd-ab22-0af947a69964 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:08.943517 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68966f2-5961-49dd-ab22-0af947a69964 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:08.970999 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1389/2759] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 15:05:08 2022] POST /identity/v3/users => generated 294 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 15:05:08.976132 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d488e73-9e8a-42fe-b321-c1508f6a5917 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:08.987096 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d488e73-9e8a-42fe-b321-c1508f6a5917 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:08.992138 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04f9f7f-6a42-40dc-a6a9-152cdaedc720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:08.992839 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04f9f7f-6a42-40dc-a6a9-152cdaedc720 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:08.993721 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04f9f7f-6a42-40dc-a6a9-152cdaedc720 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:08.993721 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04f9f7f-6a42-40dc-a6a9-152cdaedc720 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:08.994236 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04f9f7f-6a42-40dc-a6a9-152cdaedc720 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:08.995753 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04f9f7f-6a42-40dc-a6a9-152cdaedc720 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:09.002584 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:05:09.010251 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1371/2760] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 15:05:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 15:05:09.019431 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68966f2-5961-49dd-ab22-0af947a69964 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:09.032241 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68966f2-5961-49dd-ab22-0af947a69964 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:09.037830 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf95c4-f94c-43b6-aaba-b1cfb3846831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:09.038470 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf95c4-f94c-43b6-aaba-b1cfb3846831 admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:09.038749 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf95c4-f94c-43b6-aaba-b1cfb3846831 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:09.039022 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf95c4-f94c-43b6-aaba-b1cfb3846831 admin admin] PATH_INFO: `/v3/projects/e4d6772423ae4f499a2eba803f49c985/users/ab9dba1eb505405aaff47cf043d896f1/roles/019bde1756cb40de8ce06cef6b261f79` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:09.055647 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edf95c4-f94c-43b6-aaba-b1cfb3846831 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4d6772423ae4f499a2eba803f49c985, user_id=ab9dba1eb505405aaff47cf043d896f1, role_id=019bde1756cb40de8ce06cef6b261f79)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:09.058308 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edf95c4-f94c-43b6-aaba-b1cfb3846831 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:09.078182 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1390/2761] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 15:05:09 2022] PUT /identity/v3/projects/e4d6772423ae4f499a2eba803f49c985/users/ab9dba1eb505405aaff47cf043d896f1/roles/019bde1756cb40de8ce06cef6b261f79 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:05:09.082784 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04f9f7f-6a42-40dc-a6a9-152cdaedc720 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:09.096218 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04f9f7f-6a42-40dc-a6a9-152cdaedc720 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:09.163030 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cd4050-8782-40f3-8dd3-553dce825f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:09.163797 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd4050-8782-40f3-8dd3-553dce825f65 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:09.164169 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd4050-8782-40f3-8dd3-553dce825f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:09.164532 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd4050-8782-40f3-8dd3-553dce825f65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:09.165616 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cd4050-8782-40f3-8dd3-553dce825f65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:09.167519 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cd4050-8782-40f3-8dd3-553dce825f65 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:09.181377 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1372/2762] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 15:05:09 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:05:09.185809 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf95c4-f94c-43b6-aaba-b1cfb3846831 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:09.196935 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf95c4-f94c-43b6-aaba-b1cfb3846831 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:09.202476 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de5066a-3a6f-413f-bb52-d2861aa6764e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:09.203145 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de5066a-3a6f-413f-bb52-d2861aa6764e admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:09.203424 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de5066a-3a6f-413f-bb52-d2861aa6764e admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:09.203698 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de5066a-3a6f-413f-bb52-d2861aa6764e admin admin] PATH_INFO: `/v3/projects/e4d6772423ae4f499a2eba803f49c985/users/ab9dba1eb505405aaff47cf043d896f1/roles/019bde1756cb40de8ce06cef6b261f79` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:09.205718 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de5066a-3a6f-413f-bb52-d2861aa6764e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4d6772423ae4f499a2eba803f49c985, user_id=ab9dba1eb505405aaff47cf043d896f1, role_id=019bde1756cb40de8ce06cef6b261f79)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:09.208408 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de5066a-3a6f-413f-bb52-d2861aa6764e admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:09.223856 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1391/2763] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 15:05:09 2022] PUT /identity/v3/projects/e4d6772423ae4f499a2eba803f49c985/users/ab9dba1eb505405aaff47cf043d896f1/roles/019bde1756cb40de8ce06cef6b261f79 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:05:09.235611 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf8a36-53d4-4fd3-8491-d182350cbfd7 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:09.235910 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf8a36-53d4-4fd3-8491-d182350cbfd7 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:09.236286 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf8a36-53d4-4fd3-8491-d182350cbfd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:09.271854 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-5dbf8a36-53d4-4fd3-8491-d182350cbfd7 None None] MFA Rules not processed for user `ab9dba1eb505405aaff47cf043d896f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:05:09.274470 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-5dbf8a36-53d4-4fd3-8491-d182350cbfd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:05:09.354759 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1373/2764] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:05:09 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:05:09.368136 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de5066a-3a6f-413f-bb52-d2861aa6764e admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:09.370226 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-0de5066a-3a6f-413f-bb52-d2861aa6764e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:05:09.441153 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de5066a-3a6f-413f-bb52-d2861aa6764e admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:09.445555 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646079c8-4ba7-42c1-beb5-c409ffca4a0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df648c909ddb41418128b43f925f5ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:09.446190 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646079c8-4ba7-42c1-beb5-c409ffca4a0a service cinder] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:09.446468 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646079c8-4ba7-42c1-beb5-c409ffca4a0a service cinder] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:09.446738 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646079c8-4ba7-42c1-beb5-c409ffca4a0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:09.476132 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:05:09.519175 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646079c8-4ba7-42c1-beb5-c409ffca4a0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:09.520644 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646079c8-4ba7-42c1-beb5-c409ffca4a0a service cinder] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:09.531380 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1392/2765] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:05:09 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:05:11.147747 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbf8a36-53d4-4fd3-8491-d182350cbfd7 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:11.149296 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-5dbf8a36-53d4-4fd3-8491-d182350cbfd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:05:11.163779 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbf8a36-53d4-4fd3-8491-d182350cbfd7 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:11.169258 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985c2179-6ba1-4efe-81ce-94d5296718bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df648c909ddb41418128b43f925f5ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:11.170208 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985c2179-6ba1-4efe-81ce-94d5296718bc service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:11.170658 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985c2179-6ba1-4efe-81ce-94d5296718bc service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:11.171086 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985c2179-6ba1-4efe-81ce-94d5296718bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:11.239150 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985c2179-6ba1-4efe-81ce-94d5296718bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:11.241221 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985c2179-6ba1-4efe-81ce-94d5296718bc service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:11.252021 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1374/2766] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:05:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:05:11.895582 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646079c8-4ba7-42c1-beb5-c409ffca4a0a service cinder] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:11.905430 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646079c8-4ba7-42c1-beb5-c409ffca4a0a service cinder] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:11.910229 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0085427-4404-49f5-8c53-cbbc773d80dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df648c909ddb41418128b43f925f5ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:11.910753 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0085427-4404-49f5-8c53-cbbc773d80dd service cinder] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:11.911029 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0085427-4404-49f5-8c53-cbbc773d80dd service cinder] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:11.911295 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0085427-4404-49f5-8c53-cbbc773d80dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:11.922501 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0085427-4404-49f5-8c53-cbbc773d80dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:11.923979 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0085427-4404-49f5-8c53-cbbc773d80dd service cinder] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:11.934478 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1393/2767] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:05:11 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:05:15.974514 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985c2179-6ba1-4efe-81ce-94d5296718bc service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:16.005185 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:05:16.057034 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985c2179-6ba1-4efe-81ce-94d5296718bc service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:16.062357 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed05a59a-e5ee-4445-aeee-f9d761fa8d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:16.062999 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed05a59a-e5ee-4445-aeee-f9d761fa8d62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:16.063274 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed05a59a-e5ee-4445-aeee-f9d761fa8d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:16.063538 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed05a59a-e5ee-4445-aeee-f9d761fa8d62 admin admin] PATH_INFO: `/v3/users/384af4c71d8746ff8b92af4e46efb350` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:16.064679 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed05a59a-e5ee-4445-aeee-f9d761fa8d62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=384af4c71d8746ff8b92af4e46efb350)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:16.066662 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed05a59a-e5ee-4445-aeee-f9d761fa8d62 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:16.142784 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ed05a59a-e5ee-4445-aeee-f9d761fa8d62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '384af4c71d8746ff8b92af4e46efb350'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:16.157384 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ed05a59a-e5ee-4445-aeee-f9d761fa8d62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '384af4c71d8746ff8b92af4e46efb350'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:16.158583 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ed05a59a-e5ee-4445-aeee-f9d761fa8d62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '384af4c71d8746ff8b92af4e46efb350'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:16.159550 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ed05a59a-e5ee-4445-aeee-f9d761fa8d62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '384af4c71d8746ff8b92af4e46efb350'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:16.169745 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ed05a59a-e5ee-4445-aeee-f9d761fa8d62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '384af4c71d8746ff8b92af4e46efb350'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:16.198772 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1375/2768] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 15:05:15 2022] DELETE /identity/v3/users/384af4c71d8746ff8b92af4e46efb350 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:05:16.205474 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b342b62-36e6-4ede-8004-f31fe5a9da76 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:16.206113 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b342b62-36e6-4ede-8004-f31fe5a9da76 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:16.206278 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b342b62-36e6-4ede-8004-f31fe5a9da76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:16.233544 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-6b342b62-36e6-4ede-8004-f31fe5a9da76 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:05:16.235877 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-6b342b62-36e6-4ede-8004-f31fe5a9da76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:05:16.319460 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1394/2769] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:05:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:05:16.336214 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed05a59a-e5ee-4445-aeee-f9d761fa8d62 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:16.337857 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ed05a59a-e5ee-4445-aeee-f9d761fa8d62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:05:16.428439 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed05a59a-e5ee-4445-aeee-f9d761fa8d62 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:16.434323 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5b24df-cbef-40d2-be0c-caadbfc3b7c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:16.435372 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b24df-cbef-40d2-be0c-caadbfc3b7c5 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:16.436443 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b24df-cbef-40d2-be0c-caadbfc3b7c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:16.437692 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b24df-cbef-40d2-be0c-caadbfc3b7c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:16.452838 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5b24df-cbef-40d2-be0c-caadbfc3b7c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:16.454606 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5b24df-cbef-40d2-be0c-caadbfc3b7c5 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:16.466921 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1376/2770] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:05:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 15:05:16.831602 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b342b62-36e6-4ede-8004-f31fe5a9da76 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:16.833442 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-6b342b62-36e6-4ede-8004-f31fe5a9da76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:05:16.869636 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b342b62-36e6-4ede-8004-f31fe5a9da76 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:16.876351 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9a6bb2-0bb2-45a3-9f72-672296550ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:16.877239 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a6bb2-0bb2-45a3-9f72-672296550ac0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:16.877489 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a6bb2-0bb2-45a3-9f72-672296550ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:16.878149 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a6bb2-0bb2-45a3-9f72-672296550ac0 admin admin] PATH_INFO: `/v3/projects/f01fff3903e2406c90e50be238e80cfd` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:16.879169 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9a6bb2-0bb2-45a3-9f72-672296550ac0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f01fff3903e2406c90e50be238e80cfd)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:16.881244 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9a6bb2-0bb2-45a3-9f72-672296550ac0 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:16.943088 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-bc9a6bb2-0bb2-45a3-9f72-672296550ac0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f01fff3903e2406c90e50be238e80cfd', 'request_id': 'req-bc9a6bb2-0bb2-45a3-9f72-672296550ac0'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:16.957562 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-bc9a6bb2-0bb2-45a3-9f72-672296550ac0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f01fff3903e2406c90e50be238e80cfd', 'request_id': 'req-bc9a6bb2-0bb2-45a3-9f72-672296550ac0'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:16.967772 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-bc9a6bb2-0bb2-45a3-9f72-672296550ac0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f01fff3903e2406c90e50be238e80cfd', 'request_id': 'req-bc9a6bb2-0bb2-45a3-9f72-672296550ac0'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:16.981639 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-bc9a6bb2-0bb2-45a3-9f72-672296550ac0 admin admin] The token cache is being invalidate because project f01fff3903e2406c90e50be238e80cfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:05:16.981987 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-bc9a6bb2-0bb2-45a3-9f72-672296550ac0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:16.982668 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-bc9a6bb2-0bb2-45a3-9f72-672296550ac0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:16.984215 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1395/2771] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 15:05:16 2022] DELETE /identity/v3/projects/f01fff3903e2406c90e50be238e80cfd => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:05:16.990963 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5b24df-cbef-40d2-be0c-caadbfc3b7c5 service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:17.004890 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5b24df-cbef-40d2-be0c-caadbfc3b7c5 service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:17.069520 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:05:17.100522 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2abe3db-d7eb-4478-8e39-6c67d7a0dafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:17.101432 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2abe3db-d7eb-4478-8e39-6c67d7a0dafd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:17.101719 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2abe3db-d7eb-4478-8e39-6c67d7a0dafd admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:17.102009 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2abe3db-d7eb-4478-8e39-6c67d7a0dafd admin admin] PATH_INFO: `/v3/users/a3765c9a370e46e3b914401e51206277` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:17.103393 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2abe3db-d7eb-4478-8e39-6c67d7a0dafd admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3765c9a370e46e3b914401e51206277)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:17.105676 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2abe3db-d7eb-4478-8e39-6c67d7a0dafd admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:17.173911 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a2abe3db-d7eb-4478-8e39-6c67d7a0dafd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3765c9a370e46e3b914401e51206277'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:17.184051 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a2abe3db-d7eb-4478-8e39-6c67d7a0dafd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3765c9a370e46e3b914401e51206277'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:17.185914 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a2abe3db-d7eb-4478-8e39-6c67d7a0dafd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3765c9a370e46e3b914401e51206277'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:17.186795 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a2abe3db-d7eb-4478-8e39-6c67d7a0dafd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3765c9a370e46e3b914401e51206277'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:17.199791 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a2abe3db-d7eb-4478-8e39-6c67d7a0dafd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3765c9a370e46e3b914401e51206277'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:17.227435 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1377/2772] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 15:05:16 2022] DELETE /identity/v3/users/a3765c9a370e46e3b914401e51206277 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:05:17.579584 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9a6bb2-0bb2-45a3-9f72-672296550ac0 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:17.581850 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-bc9a6bb2-0bb2-45a3-9f72-672296550ac0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:05:17.604404 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9a6bb2-0bb2-45a3-9f72-672296550ac0 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:17.661484 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:05:17.702959 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c4e111-4300-4bce-93c0-c53689f82bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:17.703959 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c4e111-4300-4bce-93c0-c53689f82bf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:17.704404 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c4e111-4300-4bce-93c0-c53689f82bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:17.704862 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c4e111-4300-4bce-93c0-c53689f82bf8 admin admin] PATH_INFO: `/v3/projects/3539b0e7561a461a9d7af81ebf80dd8e` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:17.706608 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c4e111-4300-4bce-93c0-c53689f82bf8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3539b0e7561a461a9d7af81ebf80dd8e)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:17.709794 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c4e111-4300-4bce-93c0-c53689f82bf8 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:17.772536 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-b0c4e111-4300-4bce-93c0-c53689f82bf8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3539b0e7561a461a9d7af81ebf80dd8e', 'request_id': 'req-b0c4e111-4300-4bce-93c0-c53689f82bf8'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:17.783420 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-b0c4e111-4300-4bce-93c0-c53689f82bf8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3539b0e7561a461a9d7af81ebf80dd8e', 'request_id': 'req-b0c4e111-4300-4bce-93c0-c53689f82bf8'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:17.797450 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-b0c4e111-4300-4bce-93c0-c53689f82bf8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3539b0e7561a461a9d7af81ebf80dd8e', 'request_id': 'req-b0c4e111-4300-4bce-93c0-c53689f82bf8'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:17.812600 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-b0c4e111-4300-4bce-93c0-c53689f82bf8 admin admin] The token cache is being invalidate because project 3539b0e7561a461a9d7af81ebf80dd8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:05:17.813101 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-b0c4e111-4300-4bce-93c0-c53689f82bf8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:17.813996 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-b0c4e111-4300-4bce-93c0-c53689f82bf8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:17.815740 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1396/2773] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 15:05:17 2022] DELETE /identity/v3/projects/3539b0e7561a461a9d7af81ebf80dd8e => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:05:17.821812 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2abe3db-d7eb-4478-8e39-6c67d7a0dafd admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:17.823379 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a2abe3db-d7eb-4478-8e39-6c67d7a0dafd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:05:17.842015 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2abe3db-d7eb-4478-8e39-6c67d7a0dafd admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:17.927151 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0af4864-5736-4243-87fb-a79892423dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:17.927816 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0af4864-5736-4243-87fb-a79892423dd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:17.928175 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0af4864-5736-4243-87fb-a79892423dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:17.928428 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0af4864-5736-4243-87fb-a79892423dd5 admin admin] PATH_INFO: `/v3/users/ab9dba1eb505405aaff47cf043d896f1` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:17.929782 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0af4864-5736-4243-87fb-a79892423dd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab9dba1eb505405aaff47cf043d896f1)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:17.931825 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0af4864-5736-4243-87fb-a79892423dd5 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:18.020307 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c0af4864-5736-4243-87fb-a79892423dd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab9dba1eb505405aaff47cf043d896f1'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:18.034240 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c0af4864-5736-4243-87fb-a79892423dd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab9dba1eb505405aaff47cf043d896f1'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:18.035187 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c0af4864-5736-4243-87fb-a79892423dd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab9dba1eb505405aaff47cf043d896f1'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:18.036144 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c0af4864-5736-4243-87fb-a79892423dd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab9dba1eb505405aaff47cf043d896f1'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:18.049991 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c0af4864-5736-4243-87fb-a79892423dd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab9dba1eb505405aaff47cf043d896f1'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:18.051397 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:05:18.082945 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1378/2774] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 15:05:17 2022] DELETE /identity/v3/users/ab9dba1eb505405aaff47cf043d896f1 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:05:18.432665 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c4e111-4300-4bce-93c0-c53689f82bf8 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:18.435556 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-b0c4e111-4300-4bce-93c0-c53689f82bf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:05:18.457089 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c4e111-4300-4bce-93c0-c53689f82bf8 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:18.532315 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fa83ef-2f41-4ea5-be9d-e41d73a27c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:18.532982 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fa83ef-2f41-4ea5-be9d-e41d73a27c58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:18.533340 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fa83ef-2f41-4ea5-be9d-e41d73a27c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:18.533606 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fa83ef-2f41-4ea5-be9d-e41d73a27c58 admin admin] PATH_INFO: `/v3/projects/e4d6772423ae4f499a2eba803f49c985` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:18.534848 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fa83ef-2f41-4ea5-be9d-e41d73a27c58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4d6772423ae4f499a2eba803f49c985)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:18.537034 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fa83ef-2f41-4ea5-be9d-e41d73a27c58 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:18.601909 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-f6fa83ef-2f41-4ea5-be9d-e41d73a27c58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4d6772423ae4f499a2eba803f49c985', 'request_id': 'req-f6fa83ef-2f41-4ea5-be9d-e41d73a27c58'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:18.608582 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-f6fa83ef-2f41-4ea5-be9d-e41d73a27c58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4d6772423ae4f499a2eba803f49c985', 'request_id': 'req-f6fa83ef-2f41-4ea5-be9d-e41d73a27c58'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:18.618643 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-f6fa83ef-2f41-4ea5-be9d-e41d73a27c58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4d6772423ae4f499a2eba803f49c985', 'request_id': 'req-f6fa83ef-2f41-4ea5-be9d-e41d73a27c58'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:18.624653 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:05:18.633301 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-f6fa83ef-2f41-4ea5-be9d-e41d73a27c58 admin admin] The token cache is being invalidate because project e4d6772423ae4f499a2eba803f49c985 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:05:18.634134 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-f6fa83ef-2f41-4ea5-be9d-e41d73a27c58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:18.634929 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-f6fa83ef-2f41-4ea5-be9d-e41d73a27c58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:18.636692 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1397/2775] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 15:05:18 2022] DELETE /identity/v3/projects/e4d6772423ae4f499a2eba803f49c985 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:05:18.643835 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d4b13f-0e37-4929-b02d-0693556ce789 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:18.644335 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d4b13f-0e37-4929-b02d-0693556ce789 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:18.644683 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d4b13f-0e37-4929-b02d-0693556ce789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:18.671604 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-a3d4b13f-0e37-4929-b02d-0693556ce789 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:05:18.672958 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a3d4b13f-0e37-4929-b02d-0693556ce789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:05:18.752076 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1379/2776] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:05:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:05:18.761406 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584606aa-c78b-4727-8269-ce40df601c53 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:18.761682 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584606aa-c78b-4727-8269-ce40df601c53 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:18.762008 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584606aa-c78b-4727-8269-ce40df601c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:18.784543 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-584606aa-c78b-4727-8269-ce40df601c53 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:05:18.785814 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-584606aa-c78b-4727-8269-ce40df601c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:05:18.795624 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1398/2777] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:05:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:05:18.802783 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d4b13f-0e37-4929-b02d-0693556ce789 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:18.816749 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d4b13f-0e37-4929-b02d-0693556ce789 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:18.823387 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f80981d-fedb-4ea0-a267-41023f87e49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:18.824025 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f80981d-fedb-4ea0-a267-41023f87e49e admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:18.824303 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f80981d-fedb-4ea0-a267-41023f87e49e admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:18.824564 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f80981d-fedb-4ea0-a267-41023f87e49e admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:18.825280 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f80981d-fedb-4ea0-a267-41023f87e49e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:05:18.825907 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f80981d-fedb-4ea0-a267-41023f87e49e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:18.827568 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f80981d-fedb-4ea0-a267-41023f87e49e admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:18.841607 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1380/2778] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 19 15:05:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:05:18.847569 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584606aa-c78b-4727-8269-ce40df601c53 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:18.858299 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584606aa-c78b-4727-8269-ce40df601c53 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:18.863479 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a96ca0-b122-42f2-aee6-48fb9bd0a0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:18.864100 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a96ca0-b122-42f2-aee6-48fb9bd0a0d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:18.864373 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a96ca0-b122-42f2-aee6-48fb9bd0a0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:18.864636 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a96ca0-b122-42f2-aee6-48fb9bd0a0d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:18.865335 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a96ca0-b122-42f2-aee6-48fb9bd0a0d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:18.867499 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a96ca0-b122-42f2-aee6-48fb9bd0a0d4 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:18.912376 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1399/2779] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 15:05:18 2022] POST /identity/v3/projects => generated 383 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:05:18.917038 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f80981d-fedb-4ea0-a267-41023f87e49e admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:18.927526 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f80981d-fedb-4ea0-a267-41023f87e49e admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:19.014441 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e00679-74a6-442c-a631-feda16711a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:19.015072 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e00679-74a6-442c-a631-feda16711a2e admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:19.015348 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e00679-74a6-442c-a631-feda16711a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:19.015616 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e00679-74a6-442c-a631-feda16711a2e admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:19.016278 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e00679-74a6-442c-a631-feda16711a2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:19.018219 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e00679-74a6-442c-a631-feda16711a2e admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:19.048454 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1381/2780] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 15:05:18 2022] POST /identity/v3/users => generated 292 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:05:19.053089 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a96ca0-b122-42f2-aee6-48fb9bd0a0d4 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:19.065500 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a96ca0-b122-42f2-aee6-48fb9bd0a0d4 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:19.074599 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade58455-2a9e-414c-b36d-7937200ce51e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:19.075238 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade58455-2a9e-414c-b36d-7937200ce51e admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:19.075811 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade58455-2a9e-414c-b36d-7937200ce51e admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:19.076108 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade58455-2a9e-414c-b36d-7937200ce51e admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:19.076787 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade58455-2a9e-414c-b36d-7937200ce51e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:19.078447 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade58455-2a9e-414c-b36d-7937200ce51e admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:19.095321 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1400/2781] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 15:05:19 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 15:05:19.099779 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e00679-74a6-442c-a631-feda16711a2e admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:19.113403 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e00679-74a6-442c-a631-feda16711a2e admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:19.119553 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4af9425-99dd-4998-b95e-a8bd7d2bdc94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:19.120209 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af9425-99dd-4998-b95e-a8bd7d2bdc94 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:19.120462 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af9425-99dd-4998-b95e-a8bd7d2bdc94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:19.120736 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af9425-99dd-4998-b95e-a8bd7d2bdc94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:19.121420 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4af9425-99dd-4998-b95e-a8bd7d2bdc94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:19.123901 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4af9425-99dd-4998-b95e-a8bd7d2bdc94 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:19.139468 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1382/2782] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 15:05:19 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:05:19.144169 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade58455-2a9e-414c-b36d-7937200ce51e admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:19.156712 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade58455-2a9e-414c-b36d-7937200ce51e admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:19.164075 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f3d4a-3558-4767-8c35-5c834c52b236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:19.164597 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f3d4a-3558-4767-8c35-5c834c52b236 admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:19.164878 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f3d4a-3558-4767-8c35-5c834c52b236 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:19.165180 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f3d4a-3558-4767-8c35-5c834c52b236 admin admin] PATH_INFO: `/v3/projects/6922d25274d64981a81cac81bb042f40/users/6e5fa4822c2f434d8fd5c80e2422887b/roles/74de6794e3b3422b93d26f993d260c35` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:19.186524 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169f3d4a-3558-4767-8c35-5c834c52b236 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6922d25274d64981a81cac81bb042f40, user_id=6e5fa4822c2f434d8fd5c80e2422887b, role_id=74de6794e3b3422b93d26f993d260c35)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:19.189359 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169f3d4a-3558-4767-8c35-5c834c52b236 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:19.214952 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1401/2783] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 15:05:19 2022] PUT /identity/v3/projects/6922d25274d64981a81cac81bb042f40/users/6e5fa4822c2f434d8fd5c80e2422887b/roles/74de6794e3b3422b93d26f993d260c35 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:05:19.290432 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ccbaf-91fe-4515-830f-a104292afdc7 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:19.291018 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ccbaf-91fe-4515-830f-a104292afdc7 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:19.291391 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ccbaf-91fe-4515-830f-a104292afdc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:19.338501 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-907ccbaf-91fe-4515-830f-a104292afdc7 None None] MFA Rules not processed for user `6e5fa4822c2f434d8fd5c80e2422887b`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:05:19.339786 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-907ccbaf-91fe-4515-830f-a104292afdc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:05:19.383982 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:05:19.433356 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1383/2784] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:05:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:05:19.442587 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f3d4a-3558-4767-8c35-5c834c52b236 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:19.445026 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-169f3d4a-3558-4767-8c35-5c834c52b236 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:05:19.521802 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f3d4a-3558-4767-8c35-5c834c52b236 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:19.526999 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963e9a66-1a8f-4ccc-a610-f6d4801444ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df648c909ddb41418128b43f925f5ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:19.527645 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963e9a66-1a8f-4ccc-a610-f6d4801444ee service cinder] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:19.527919 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963e9a66-1a8f-4ccc-a610-f6d4801444ee service cinder] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:19.528168 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963e9a66-1a8f-4ccc-a610-f6d4801444ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:19.543134 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963e9a66-1a8f-4ccc-a610-f6d4801444ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:19.543134 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963e9a66-1a8f-4ccc-a610-f6d4801444ee service cinder] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:19.552398 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1402/2785] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:05:19 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:05:22.274189 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907ccbaf-91fe-4515-830f-a104292afdc7 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:22.352540 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907ccbaf-91fe-4515-830f-a104292afdc7 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:22.358070 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa9751b-b5af-4ca2-9945-9e1ce0384bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:22.358883 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa9751b-b5af-4ca2-9945-9e1ce0384bc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:22.359342 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa9751b-b5af-4ca2-9945-9e1ce0384bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:22.359768 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa9751b-b5af-4ca2-9945-9e1ce0384bc4 admin admin] PATH_INFO: `/v3/users/6e5fa4822c2f434d8fd5c80e2422887b` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:22.361386 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa9751b-b5af-4ca2-9945-9e1ce0384bc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e5fa4822c2f434d8fd5c80e2422887b)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:22.364362 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa9751b-b5af-4ca2-9945-9e1ce0384bc4 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:22.439903 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-7fa9751b-b5af-4ca2-9945-9e1ce0384bc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e5fa4822c2f434d8fd5c80e2422887b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:22.452807 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-7fa9751b-b5af-4ca2-9945-9e1ce0384bc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e5fa4822c2f434d8fd5c80e2422887b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:22.456282 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-7fa9751b-b5af-4ca2-9945-9e1ce0384bc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e5fa4822c2f434d8fd5c80e2422887b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:22.456939 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-7fa9751b-b5af-4ca2-9945-9e1ce0384bc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e5fa4822c2f434d8fd5c80e2422887b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:22.467817 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-7fa9751b-b5af-4ca2-9945-9e1ce0384bc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e5fa4822c2f434d8fd5c80e2422887b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:22.491450 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1384/2786] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 15:05:22 2022] DELETE /identity/v3/users/6e5fa4822c2f434d8fd5c80e2422887b => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:05:22.496835 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a95c17-4fa6-4a1e-ae7b-d7732d25ae5e None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:22.497663 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a95c17-4fa6-4a1e-ae7b-d7732d25ae5e None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:22.497663 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a95c17-4fa6-4a1e-ae7b-d7732d25ae5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:22.522277 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-41a95c17-4fa6-4a1e-ae7b-d7732d25ae5e None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:05:22.523809 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-41a95c17-4fa6-4a1e-ae7b-d7732d25ae5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:05:22.595927 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1403/2787] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:05:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:05:22.607578 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa9751b-b5af-4ca2-9945-9e1ce0384bc4 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:22.609201 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-7fa9751b-b5af-4ca2-9945-9e1ce0384bc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:05:22.677730 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa9751b-b5af-4ca2-9945-9e1ce0384bc4 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:22.681231 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd896f9-8e24-4da7-b69c-57e17074a78a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:22.681870 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd896f9-8e24-4da7-b69c-57e17074a78a service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:22.682131 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd896f9-8e24-4da7-b69c-57e17074a78a service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:22.682398 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd896f9-8e24-4da7-b69c-57e17074a78a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:22.696564 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd896f9-8e24-4da7-b69c-57e17074a78a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:22.697980 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd896f9-8e24-4da7-b69c-57e17074a78a service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:22.702688 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:05:22.712653 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1385/2788] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:05:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:05:23.086709 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a95c17-4fa6-4a1e-ae7b-d7732d25ae5e None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:23.088246 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-41a95c17-4fa6-4a1e-ae7b-d7732d25ae5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:05:23.105596 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a95c17-4fa6-4a1e-ae7b-d7732d25ae5e None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:23.110845 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15f9a2e-d32a-4a87-b937-cabb28005f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:23.111507 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f9a2e-d32a-4a87-b937-cabb28005f0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:23.111782 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f9a2e-d32a-4a87-b937-cabb28005f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:23.112086 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f9a2e-d32a-4a87-b937-cabb28005f0e admin admin] PATH_INFO: `/v3/projects/6922d25274d64981a81cac81bb042f40` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:23.113261 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15f9a2e-d32a-4a87-b937-cabb28005f0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6922d25274d64981a81cac81bb042f40)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:23.115261 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15f9a2e-d32a-4a87-b937-cabb28005f0e admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:23.170725 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:05:23.193568 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-d15f9a2e-d32a-4a87-b937-cabb28005f0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6922d25274d64981a81cac81bb042f40', 'request_id': 'req-d15f9a2e-d32a-4a87-b937-cabb28005f0e'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:23.205371 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-d15f9a2e-d32a-4a87-b937-cabb28005f0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6922d25274d64981a81cac81bb042f40', 'request_id': 'req-d15f9a2e-d32a-4a87-b937-cabb28005f0e'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:23.216130 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-d15f9a2e-d32a-4a87-b937-cabb28005f0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6922d25274d64981a81cac81bb042f40', 'request_id': 'req-d15f9a2e-d32a-4a87-b937-cabb28005f0e'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:23.228286 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-d15f9a2e-d32a-4a87-b937-cabb28005f0e admin admin] The token cache is being invalidate because project 6922d25274d64981a81cac81bb042f40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:05:23.228559 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-d15f9a2e-d32a-4a87-b937-cabb28005f0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:23.229167 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-d15f9a2e-d32a-4a87-b937-cabb28005f0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:23.230785 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1404/2789] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 15:05:23 2022] DELETE /identity/v3/projects/6922d25274d64981a81cac81bb042f40 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:05:28.981655 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd896f9-8e24-4da7-b69c-57e17074a78a service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:28.983282 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-9cd896f9-8e24-4da7-b69c-57e17074a78a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:05:28.997053 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd896f9-8e24-4da7-b69c-57e17074a78a service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:29.072376 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f271e8-179d-4f64-a56f-1451c5fabeb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:29.073046 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f271e8-179d-4f64-a56f-1451c5fabeb5 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:29.073425 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f271e8-179d-4f64-a56f-1451c5fabeb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:29.073589 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f271e8-179d-4f64-a56f-1451c5fabeb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:29.076188 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-98f271e8-179d-4f64-a56f-1451c5fabeb5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:05:29.182972 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f271e8-179d-4f64-a56f-1451c5fabeb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:29.186799 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f271e8-179d-4f64-a56f-1451c5fabeb5 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:29.201322 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1386/2790] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:05:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:05:33.224868 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=13,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:05:33.942002 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15f9a2e-d32a-4a87-b937-cabb28005f0e admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:33.943604 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-d15f9a2e-d32a-4a87-b937-cabb28005f0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:05:33.958248 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15f9a2e-d32a-4a87-b937-cabb28005f0e admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:33.963342 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4f8952-cb99-47bc-aa3c-daf36af54b63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:33.964052 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f8952-cb99-47bc-aa3c-daf36af54b63 service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:33.964399 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f8952-cb99-47bc-aa3c-daf36af54b63 service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:33.964675 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f8952-cb99-47bc-aa3c-daf36af54b63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:33.966567 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-2f4f8952-cb99-47bc-aa3c-daf36af54b63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:05:34.058080 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4f8952-cb99-47bc-aa3c-daf36af54b63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:34.060144 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4f8952-cb99-47bc-aa3c-daf36af54b63 service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:34.071264 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1405/2791] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:05:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:05:37.189303 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f5981a-771b-47a4-9914-3e5c26745bc8 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:37.189800 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f5981a-771b-47a4-9914-3e5c26745bc8 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:37.189904 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f5981a-771b-47a4-9914-3e5c26745bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:37.217589 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-65f5981a-771b-47a4-9914-3e5c26745bc8 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:05:37.218832 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-65f5981a-771b-47a4-9914-3e5c26745bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:05:37.229053 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1387/2792] 10.222.0.67 () {58 vars in 1016 bytes} [Mon Sep 19 15:05:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:05:37.245283 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4f8952-cb99-47bc-aa3c-daf36af54b63 service neutron] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:37.246733 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-2f4f8952-cb99-47bc-aa3c-daf36af54b63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:05:37.264425 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4f8952-cb99-47bc-aa3c-daf36af54b63 service neutron] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:37.271536 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29287cfe-d332-41c3-b6d0-82593e281de6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3017e5d92bef4cc2aeae4f28c78ba233', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:37.272172 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29287cfe-d332-41c3-b6d0-82593e281de6 service nova] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:37.272451 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29287cfe-d332-41c3-b6d0-82593e281de6 service nova] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:37.272723 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29287cfe-d332-41c3-b6d0-82593e281de6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:37.277202 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f5981a-771b-47a4-9914-3e5c26745bc8 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:37.278808 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-65f5981a-771b-47a4-9914-3e5c26745bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:05:37.287532 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29287cfe-d332-41c3-b6d0-82593e281de6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:37.289188 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29287cfe-d332-41c3-b6d0-82593e281de6 service nova] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:37.291032 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f5981a-771b-47a4-9914-3e5c26745bc8 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:37.299996 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b37a4c-3722-4d8b-827d-d3f3023e60a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:37.300741 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b37a4c-3722-4d8b-827d-d3f3023e60a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:37.301090 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b37a4c-3722-4d8b-827d-d3f3023e60a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:37.301425 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b37a4c-3722-4d8b-827d-d3f3023e60a9 admin admin] PATH_INFO: `/v3/users/ab3ebacb745f4074bb708d9a40c9161d` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:37.301708 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1406/2793] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:05:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:05:37.446087 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b37a4c-3722-4d8b-827d-d3f3023e60a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab3ebacb745f4074bb708d9a40c9161d)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:37.448082 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b37a4c-3722-4d8b-827d-d3f3023e60a9 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:37.500319 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f9b37a4c-3722-4d8b-827d-d3f3023e60a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab3ebacb745f4074bb708d9a40c9161d'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:37.508948 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f9b37a4c-3722-4d8b-827d-d3f3023e60a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab3ebacb745f4074bb708d9a40c9161d'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:37.509610 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f9b37a4c-3722-4d8b-827d-d3f3023e60a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab3ebacb745f4074bb708d9a40c9161d'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:37.510268 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f9b37a4c-3722-4d8b-827d-d3f3023e60a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab3ebacb745f4074bb708d9a40c9161d'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:37.517347 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f9b37a4c-3722-4d8b-827d-d3f3023e60a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab3ebacb745f4074bb708d9a40c9161d'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:37.528055 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:05:37.537253 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1388/2794] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 15:05:37 2022] DELETE /identity/v3/users/ab3ebacb745f4074bb708d9a40c9161d => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:05:37.735382 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29287cfe-d332-41c3-b6d0-82593e281de6 service nova] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:37.745826 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29287cfe-d332-41c3-b6d0-82593e281de6 service nova] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:37.806123 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26bf780-d9d4-4d6d-b41a-988c59202217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:37.806761 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26bf780-d9d4-4d6d-b41a-988c59202217 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:37.807036 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26bf780-d9d4-4d6d-b41a-988c59202217 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:37.807300 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26bf780-d9d4-4d6d-b41a-988c59202217 admin admin] PATH_INFO: `/v3/projects/e15ebf1df15b47e8b3c03fda475540a6` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:37.818878 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26bf780-d9d4-4d6d-b41a-988c59202217 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e15ebf1df15b47e8b3c03fda475540a6)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:37.821415 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26bf780-d9d4-4d6d-b41a-988c59202217 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:37.875502 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-f26bf780-d9d4-4d6d-b41a-988c59202217 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e15ebf1df15b47e8b3c03fda475540a6', 'request_id': 'req-f26bf780-d9d4-4d6d-b41a-988c59202217'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:37.884868 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-f26bf780-d9d4-4d6d-b41a-988c59202217 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e15ebf1df15b47e8b3c03fda475540a6', 'request_id': 'req-f26bf780-d9d4-4d6d-b41a-988c59202217'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:37.895922 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-f26bf780-d9d4-4d6d-b41a-988c59202217 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e15ebf1df15b47e8b3c03fda475540a6', 'request_id': 'req-f26bf780-d9d4-4d6d-b41a-988c59202217'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:37.908626 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-f26bf780-d9d4-4d6d-b41a-988c59202217 admin admin] The token cache is being invalidate because project e15ebf1df15b47e8b3c03fda475540a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:05:37.909064 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-f26bf780-d9d4-4d6d-b41a-988c59202217 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:37.910795 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-f26bf780-d9d4-4d6d-b41a-988c59202217 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:37.912952 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1407/2795] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 15:05:37 2022] DELETE /identity/v3/projects/e15ebf1df15b47e8b3c03fda475540a6 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:05:37.917968 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c41778-e155-4a10-af7b-9493307cfc15 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:37.918252 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c41778-e155-4a10-af7b-9493307cfc15 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:37.918545 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c41778-e155-4a10-af7b-9493307cfc15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:37.939633 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-e6c41778-e155-4a10-af7b-9493307cfc15 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:05:37.940863 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e6c41778-e155-4a10-af7b-9493307cfc15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:05:38.009360 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1389/2796] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:05:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:05:38.019020 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cdc5f5-340d-474a-98cd-1222931e1636 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:38.019245 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cdc5f5-340d-474a-98cd-1222931e1636 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:38.019536 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cdc5f5-340d-474a-98cd-1222931e1636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:38.029409 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:05:38.044720 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-82cdc5f5-340d-474a-98cd-1222931e1636 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:05:38.047302 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-82cdc5f5-340d-474a-98cd-1222931e1636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:05:38.055586 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1408/2797] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:05:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:05:38.060184 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c41778-e155-4a10-af7b-9493307cfc15 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:38.071572 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c41778-e155-4a10-af7b-9493307cfc15 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:38.077764 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9169b5f-9308-493a-81c8-2577ecfa6ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:38.078372 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9169b5f-9308-493a-81c8-2577ecfa6ac7 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:38.078759 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9169b5f-9308-493a-81c8-2577ecfa6ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:38.079093 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9169b5f-9308-493a-81c8-2577ecfa6ac7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:38.079914 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9169b5f-9308-493a-81c8-2577ecfa6ac7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:05:38.080292 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9169b5f-9308-493a-81c8-2577ecfa6ac7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:38.082227 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9169b5f-9308-493a-81c8-2577ecfa6ac7 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:38.097923 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1390/2798] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 19 15:05:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:05:38.103205 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cdc5f5-340d-474a-98cd-1222931e1636 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:38.113635 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cdc5f5-340d-474a-98cd-1222931e1636 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:38.119429 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431701ab-ea3a-4390-a5f8-d3b76e5dea6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:38.120102 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431701ab-ea3a-4390-a5f8-d3b76e5dea6e admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:38.120385 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431701ab-ea3a-4390-a5f8-d3b76e5dea6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:38.120683 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431701ab-ea3a-4390-a5f8-d3b76e5dea6e admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:38.121439 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431701ab-ea3a-4390-a5f8-d3b76e5dea6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:38.123451 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431701ab-ea3a-4390-a5f8-d3b76e5dea6e admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:38.168679 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1409/2799] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 15:05:38 2022] POST /identity/v3/projects => generated 355 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:05:38.173638 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9169b5f-9308-493a-81c8-2577ecfa6ac7 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:38.184273 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9169b5f-9308-493a-81c8-2577ecfa6ac7 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:38.245632 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79e703e-8085-44d7-aa6a-28c9f26e2da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:38.246549 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e703e-8085-44d7-aa6a-28c9f26e2da3 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:38.246549 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e703e-8085-44d7-aa6a-28c9f26e2da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:38.246760 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e703e-8085-44d7-aa6a-28c9f26e2da3 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:38.247398 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79e703e-8085-44d7-aa6a-28c9f26e2da3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:38.249360 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79e703e-8085-44d7-aa6a-28c9f26e2da3 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:38.275190 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1391/2800] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 15:05:38 2022] POST /identity/v3/users => generated 278 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:05:38.279437 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431701ab-ea3a-4390-a5f8-d3b76e5dea6e admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:38.290996 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431701ab-ea3a-4390-a5f8-d3b76e5dea6e admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:38.296954 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56e1783-bb7a-457a-90ee-5acaa027a385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:38.297833 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56e1783-bb7a-457a-90ee-5acaa027a385 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:38.298423 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56e1783-bb7a-457a-90ee-5acaa027a385 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:38.298423 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56e1783-bb7a-457a-90ee-5acaa027a385 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:38.299004 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56e1783-bb7a-457a-90ee-5acaa027a385 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:38.300627 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56e1783-bb7a-457a-90ee-5acaa027a385 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:38.311608 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1410/2801] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 15:05:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:05:38.316444 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79e703e-8085-44d7-aa6a-28c9f26e2da3 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:38.326931 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79e703e-8085-44d7-aa6a-28c9f26e2da3 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:38.332228 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42369ae9-cf80-4c16-8307-28004646e7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:38.332837 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42369ae9-cf80-4c16-8307-28004646e7ea admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:38.333126 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42369ae9-cf80-4c16-8307-28004646e7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:38.333423 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42369ae9-cf80-4c16-8307-28004646e7ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:38.334065 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42369ae9-cf80-4c16-8307-28004646e7ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:38.335670 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42369ae9-cf80-4c16-8307-28004646e7ea admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:38.347415 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1392/2802] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 15:05:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:05:38.351848 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56e1783-bb7a-457a-90ee-5acaa027a385 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:38.362691 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56e1783-bb7a-457a-90ee-5acaa027a385 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:38.368211 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3df1b42-43df-45a5-8077-385327cd545b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:38.368926 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df1b42-43df-45a5-8077-385327cd545b admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:38.369251 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df1b42-43df-45a5-8077-385327cd545b admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:38.369526 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df1b42-43df-45a5-8077-385327cd545b admin admin] PATH_INFO: `/v3/projects/fd241744634d44a9a7342df10db91274/users/7d3f418908e841258dc8249e33f4fc1a/roles/74de6794e3b3422b93d26f993d260c35` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:38.385415 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3df1b42-43df-45a5-8077-385327cd545b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd241744634d44a9a7342df10db91274, user_id=7d3f418908e841258dc8249e33f4fc1a, role_id=74de6794e3b3422b93d26f993d260c35)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:38.388076 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3df1b42-43df-45a5-8077-385327cd545b admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:38.402937 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1411/2803] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 15:05:38 2022] PUT /identity/v3/projects/fd241744634d44a9a7342df10db91274/users/7d3f418908e841258dc8249e33f4fc1a/roles/74de6794e3b3422b93d26f993d260c35 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:05:38.414249 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261db197-82fc-402f-9c81-52e3660e550b None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:38.414654 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261db197-82fc-402f-9c81-52e3660e550b None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:38.414977 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261db197-82fc-402f-9c81-52e3660e550b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:38.445398 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-261db197-82fc-402f-9c81-52e3660e550b None None] MFA Rules not processed for user `7d3f418908e841258dc8249e33f4fc1a`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:05:38.446622 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-261db197-82fc-402f-9c81-52e3660e550b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:05:38.502283 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:05:38.525713 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1393/2804] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:05:38 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:05:38.530371 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3df1b42-43df-45a5-8077-385327cd545b admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:38.608362 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3df1b42-43df-45a5-8077-385327cd545b admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:38.615269 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed50762-b047-489d-9bd5-ad179f4c680a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:38.616218 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed50762-b047-489d-9bd5-ad179f4c680a admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:38.616693 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed50762-b047-489d-9bd5-ad179f4c680a admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:38.617226 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed50762-b047-489d-9bd5-ad179f4c680a admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:38.617906 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed50762-b047-489d-9bd5-ad179f4c680a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:38.619861 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed50762-b047-489d-9bd5-ad179f4c680a admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:38.652831 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1412/2805] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 15:05:38 2022] POST /identity/v3/projects => generated 353 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:05:38.657214 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261db197-82fc-402f-9c81-52e3660e550b None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:38.668805 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261db197-82fc-402f-9c81-52e3660e550b None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:38.730383 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafb27bd-4c92-498c-9254-d5e8c75b4c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:38.731023 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafb27bd-4c92-498c-9254-d5e8c75b4c53 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:38.731299 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafb27bd-4c92-498c-9254-d5e8c75b4c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:38.731564 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafb27bd-4c92-498c-9254-d5e8c75b4c53 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:38.732186 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafb27bd-4c92-498c-9254-d5e8c75b4c53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:38.734166 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafb27bd-4c92-498c-9254-d5e8c75b4c53 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:38.761977 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1394/2806] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 15:05:38 2022] POST /identity/v3/users => generated 283 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:05:38.763127 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed50762-b047-489d-9bd5-ad179f4c680a admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:38.774401 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed50762-b047-489d-9bd5-ad179f4c680a admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:38.779688 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdface5-06bb-4a18-8c87-1dce5747572e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:38.780247 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdface5-06bb-4a18-8c87-1dce5747572e admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:38.780539 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdface5-06bb-4a18-8c87-1dce5747572e admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:38.780804 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdface5-06bb-4a18-8c87-1dce5747572e admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:38.781478 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdface5-06bb-4a18-8c87-1dce5747572e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:38.783246 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdface5-06bb-4a18-8c87-1dce5747572e admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:38.795891 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1413/2807] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 15:05:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 15:05:38.801025 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafb27bd-4c92-498c-9254-d5e8c75b4c53 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:38.812654 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafb27bd-4c92-498c-9254-d5e8c75b4c53 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:38.818308 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443919c0-391d-4193-9de1-5ad5b928ecf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:38.818954 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443919c0-391d-4193-9de1-5ad5b928ecf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:38.819227 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443919c0-391d-4193-9de1-5ad5b928ecf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:38.819499 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443919c0-391d-4193-9de1-5ad5b928ecf6 admin admin] PATH_INFO: `/v3/projects/7248c9ea8a824f38ab90c2bb7161c91a/users/d37e63097d044409995aaddc27d27237/roles/019bde1756cb40de8ce06cef6b261f79` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:38.840246 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443919c0-391d-4193-9de1-5ad5b928ecf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7248c9ea8a824f38ab90c2bb7161c91a, user_id=d37e63097d044409995aaddc27d27237, role_id=019bde1756cb40de8ce06cef6b261f79)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:38.844774 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443919c0-391d-4193-9de1-5ad5b928ecf6 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:38.863970 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1395/2808] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 15:05:38 2022] PUT /identity/v3/projects/7248c9ea8a824f38ab90c2bb7161c91a/users/d37e63097d044409995aaddc27d27237/roles/019bde1756cb40de8ce06cef6b261f79 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:05:38.868836 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdface5-06bb-4a18-8c87-1dce5747572e admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:38.883300 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdface5-06bb-4a18-8c87-1dce5747572e admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:38.954873 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc6d86-7cb3-4a16-a45c-223aee79ff1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:38.955476 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc6d86-7cb3-4a16-a45c-223aee79ff1e admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:38.955746 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc6d86-7cb3-4a16-a45c-223aee79ff1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:38.956013 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc6d86-7cb3-4a16-a45c-223aee79ff1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:38.956648 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dc6d86-7cb3-4a16-a45c-223aee79ff1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:38.958341 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dc6d86-7cb3-4a16-a45c-223aee79ff1e admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:38.963409 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:05:38.970413 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1414/2809] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 15:05:38 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:05:38.974190 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443919c0-391d-4193-9de1-5ad5b928ecf6 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:38.984939 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443919c0-391d-4193-9de1-5ad5b928ecf6 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:38.990196 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bb43db-dc77-49d3-af3f-020e90b16e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:38.990856 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb43db-dc77-49d3-af3f-020e90b16e59 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:38.991132 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb43db-dc77-49d3-af3f-020e90b16e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:38.991402 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb43db-dc77-49d3-af3f-020e90b16e59 admin admin] PATH_INFO: `/v3/projects/7248c9ea8a824f38ab90c2bb7161c91a/users/d37e63097d044409995aaddc27d27237/roles/019bde1756cb40de8ce06cef6b261f79` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:38.993433 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bb43db-dc77-49d3-af3f-020e90b16e59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7248c9ea8a824f38ab90c2bb7161c91a, user_id=d37e63097d044409995aaddc27d27237, role_id=019bde1756cb40de8ce06cef6b261f79)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:38.996072 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bb43db-dc77-49d3-af3f-020e90b16e59 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:39.008855 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1396/2810] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 15:05:38 2022] PUT /identity/v3/projects/7248c9ea8a824f38ab90c2bb7161c91a/users/d37e63097d044409995aaddc27d27237/roles/019bde1756cb40de8ce06cef6b261f79 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:05:39.021026 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe062d0-5815-4587-83d8-f93f6bf7a7a8 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:39.021322 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe062d0-5815-4587-83d8-f93f6bf7a7a8 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:39.021588 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe062d0-5815-4587-83d8-f93f6bf7a7a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:39.051002 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-6fe062d0-5815-4587-83d8-f93f6bf7a7a8 None None] MFA Rules not processed for user `d37e63097d044409995aaddc27d27237`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:05:39.052123 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-6fe062d0-5815-4587-83d8-f93f6bf7a7a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:05:39.132482 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1415/2811] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:05:39 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:05:39.144704 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bb43db-dc77-49d3-af3f-020e90b16e59 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:39.147585 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-75bb43db-dc77-49d3-af3f-020e90b16e59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:05:39.224807 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bb43db-dc77-49d3-af3f-020e90b16e59 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:39.229106 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9412828-b1ec-4325-8313-d800395d073d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df648c909ddb41418128b43f925f5ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:39.230190 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9412828-b1ec-4325-8313-d800395d073d service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:39.230467 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9412828-b1ec-4325-8313-d800395d073d service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:39.230732 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9412828-b1ec-4325-8313-d800395d073d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:39.240623 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9412828-b1ec-4325-8313-d800395d073d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:39.242204 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9412828-b1ec-4325-8313-d800395d073d service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:39.253626 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1397/2812] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:05:39 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:05:39.338219 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe062d0-5815-4587-83d8-f93f6bf7a7a8 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:39.339637 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-6fe062d0-5815-4587-83d8-f93f6bf7a7a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:05:39.352580 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe062d0-5815-4587-83d8-f93f6bf7a7a8 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:39.356416 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06caba89-b663-45a3-8c0d-55013de2341a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df648c909ddb41418128b43f925f5ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:39.357026 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06caba89-b663-45a3-8c0d-55013de2341a service cinder] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:39.357375 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06caba89-b663-45a3-8c0d-55013de2341a service cinder] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:39.357568 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06caba89-b663-45a3-8c0d-55013de2341a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:39.427663 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06caba89-b663-45a3-8c0d-55013de2341a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:39.429910 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06caba89-b663-45a3-8c0d-55013de2341a service cinder] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:39.444777 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1416/2813] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:05:39 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:05:40.267853 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d56a8-1c69-41ea-a8c2-c0fdeb46c6d3 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:40.268561 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d56a8-1c69-41ea-a8c2-c0fdeb46c6d3 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:40.268670 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d56a8-1c69-41ea-a8c2-c0fdeb46c6d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:40.290383 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-4e1d56a8-1c69-41ea-a8c2-c0fdeb46c6d3 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:05:40.291611 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-4e1d56a8-1c69-41ea-a8c2-c0fdeb46c6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:05:40.338546 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:05:40.363689 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1398/2814] 10.222.0.67 () {58 vars in 1016 bytes} [Mon Sep 19 15:05:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:05:40.390472 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06caba89-b663-45a3-8c0d-55013de2341a service cinder] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:40.392417 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-06caba89-b663-45a3-8c0d-55013de2341a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:05:40.480966 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06caba89-b663-45a3-8c0d-55013de2341a service cinder] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:40.492078 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0169f072-417e-429d-8ded-e4e614560603 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3017e5d92bef4cc2aeae4f28c78ba233', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:40.492715 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0169f072-417e-429d-8ded-e4e614560603 service nova] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:40.492972 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0169f072-417e-429d-8ded-e4e614560603 service nova] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:40.493274 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0169f072-417e-429d-8ded-e4e614560603 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:40.503484 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0169f072-417e-429d-8ded-e4e614560603 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:40.505561 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0169f072-417e-429d-8ded-e4e614560603 service nova] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:40.517342 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1417/2815] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:05:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:05:43.574562 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cf7a88-d6e4-40c6-ae01-471703d63e67 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:43.575231 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cf7a88-d6e4-40c6-ae01-471703d63e67 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:43.575231 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cf7a88-d6e4-40c6-ae01-471703d63e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:43.597564 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-d1cf7a88-d6e4-40c6-ae01-471703d63e67 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:05:43.598838 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d1cf7a88-d6e4-40c6-ae01-471703d63e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:05:43.609443 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1399/2816] 10.222.0.67 () {58 vars in 1016 bytes} [Mon Sep 19 15:05:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:05:43.623708 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0169f072-417e-429d-8ded-e4e614560603 service nova] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:43.625192 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-0169f072-417e-429d-8ded-e4e614560603 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:05:43.642500 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0169f072-417e-429d-8ded-e4e614560603 service nova] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:43.649790 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d622ee-a773-4f74-aabb-b6ade073102c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3017e5d92bef4cc2aeae4f28c78ba233', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:43.650410 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d622ee-a773-4f74-aabb-b6ade073102c service nova] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:43.650689 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d622ee-a773-4f74-aabb-b6ade073102c service nova] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:43.650961 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d622ee-a773-4f74-aabb-b6ade073102c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:43.658323 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:05:43.660808 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d622ee-a773-4f74-aabb-b6ade073102c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:43.662814 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d622ee-a773-4f74-aabb-b6ade073102c service nova] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:43.672696 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1418/2817] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:05:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 15:05:46.687825 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5044cb-cc9c-4eca-a2ff-5f252d3d9683 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:46.688471 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5044cb-cc9c-4eca-a2ff-5f252d3d9683 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:46.688471 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5044cb-cc9c-4eca-a2ff-5f252d3d9683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:46.717992 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-9d5044cb-cc9c-4eca-a2ff-5f252d3d9683 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:05:46.719669 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-9d5044cb-cc9c-4eca-a2ff-5f252d3d9683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:05:46.729566 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1400/2818] 10.222.0.67 () {58 vars in 1016 bytes} [Mon Sep 19 15:05:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:05:46.745030 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d622ee-a773-4f74-aabb-b6ade073102c service nova] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:46.758192 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d622ee-a773-4f74-aabb-b6ade073102c service nova] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:46.764229 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ce8f30-4ea7-480f-9890-ce3d798f6f55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3017e5d92bef4cc2aeae4f28c78ba233', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:46.764812 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce8f30-4ea7-480f-9890-ce3d798f6f55 service nova] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:46.765290 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce8f30-4ea7-480f-9890-ce3d798f6f55 service nova] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:46.765560 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce8f30-4ea7-480f-9890-ce3d798f6f55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:46.775883 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ce8f30-4ea7-480f-9890-ce3d798f6f55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:46.777766 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ce8f30-4ea7-480f-9890-ce3d798f6f55 service nova] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:46.788484 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1419/2819] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:05:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:05:46.933559 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5044cb-cc9c-4eca-a2ff-5f252d3d9683 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:46.935221 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-9d5044cb-cc9c-4eca-a2ff-5f252d3d9683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:05:47.010003 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5044cb-cc9c-4eca-a2ff-5f252d3d9683 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:47.014201 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13d8439-093e-415e-b8f6-f0906cda9aae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:47.014823 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13d8439-093e-415e-b8f6-f0906cda9aae service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:47.015105 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13d8439-093e-415e-b8f6-f0906cda9aae service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:47.015377 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13d8439-093e-415e-b8f6-f0906cda9aae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:47.017343 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d13d8439-093e-415e-b8f6-f0906cda9aae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:05:47.032024 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13d8439-093e-415e-b8f6-f0906cda9aae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:47.033515 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13d8439-093e-415e-b8f6-f0906cda9aae service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:47.046482 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1401/2820] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:05:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:05:50.902232 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f9b942-36a3-48b0-a85a-3df72dff0427 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:50.902755 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f9b942-36a3-48b0-a85a-3df72dff0427 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:50.902755 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f9b942-36a3-48b0-a85a-3df72dff0427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:50.923741 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-a2f9b942-36a3-48b0-a85a-3df72dff0427 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:05:50.924944 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-a2f9b942-36a3-48b0-a85a-3df72dff0427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:05:50.933007 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1420/2821] 10.222.0.67 () {58 vars in 1016 bytes} [Mon Sep 19 15:05:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:05:50.950460 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13d8439-093e-415e-b8f6-f0906cda9aae service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:50.965480 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13d8439-093e-415e-b8f6-f0906cda9aae service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:50.974830 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6bd03d-d231-4a1b-aacd-9d8c36b66a23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3017e5d92bef4cc2aeae4f28c78ba233', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:50.975459 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6bd03d-d231-4a1b-aacd-9d8c36b66a23 service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:50.975733 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6bd03d-d231-4a1b-aacd-9d8c36b66a23 service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:50.975994 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6bd03d-d231-4a1b-aacd-9d8c36b66a23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:50.984922 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6bd03d-d231-4a1b-aacd-9d8c36b66a23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:50.987061 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6bd03d-d231-4a1b-aacd-9d8c36b66a23 service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:50.998238 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1402/2822] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:05:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:05:54.085808 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b24431-3533-4b53-adec-94022b1da4e3 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:54.086317 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b24431-3533-4b53-adec-94022b1da4e3 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:54.086440 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b24431-3533-4b53-adec-94022b1da4e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:54.108193 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-04b24431-3533-4b53-adec-94022b1da4e3 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:05:54.109464 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-04b24431-3533-4b53-adec-94022b1da4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:05:54.118602 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1421/2823] 10.222.0.67 () {58 vars in 1016 bytes} [Mon Sep 19 15:05:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:05:54.138598 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6bd03d-d231-4a1b-aacd-9d8c36b66a23 service nova] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:54.155698 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6bd03d-d231-4a1b-aacd-9d8c36b66a23 service nova] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:54.164817 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af387ab-3477-4451-913e-2bb60f59c7ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3017e5d92bef4cc2aeae4f28c78ba233', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:54.165454 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af387ab-3477-4451-913e-2bb60f59c7ad service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:54.165730 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af387ab-3477-4451-913e-2bb60f59c7ad service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:54.166001 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af387ab-3477-4451-913e-2bb60f59c7ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:54.175534 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af387ab-3477-4451-913e-2bb60f59c7ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:54.177174 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af387ab-3477-4451-913e-2bb60f59c7ad service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:54.187921 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1403/2824] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:05:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:05:54.974451 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b24431-3533-4b53-adec-94022b1da4e3 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:54.986209 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b24431-3533-4b53-adec-94022b1da4e3 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:54.992159 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d70824-2e78-4279-a60c-f8fa047ae1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:54.992912 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d70824-2e78-4279-a60c-f8fa047ae1e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:54.993368 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d70824-2e78-4279-a60c-f8fa047ae1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:54.993647 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d70824-2e78-4279-a60c-f8fa047ae1e8 admin admin] PATH_INFO: `/v3/users/7d3f418908e841258dc8249e33f4fc1a` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:54.994862 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d70824-2e78-4279-a60c-f8fa047ae1e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d3f418908e841258dc8249e33f4fc1a)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:54.996971 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d70824-2e78-4279-a60c-f8fa047ae1e8 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:55.050903 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-17d70824-2e78-4279-a60c-f8fa047ae1e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d3f418908e841258dc8249e33f4fc1a'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:55.060038 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-17d70824-2e78-4279-a60c-f8fa047ae1e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d3f418908e841258dc8249e33f4fc1a'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:55.060842 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-17d70824-2e78-4279-a60c-f8fa047ae1e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d3f418908e841258dc8249e33f4fc1a'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:55.061608 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-17d70824-2e78-4279-a60c-f8fa047ae1e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d3f418908e841258dc8249e33f4fc1a'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:55.077973 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-17d70824-2e78-4279-a60c-f8fa047ae1e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d3f418908e841258dc8249e33f4fc1a'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:55.092427 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1422/2825] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 15:05:54 2022] DELETE /identity/v3/users/7d3f418908e841258dc8249e33f4fc1a => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:05:55.097225 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd98c20-fd4a-4336-8dc3-000d5bfe8b09 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:55.097833 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd98c20-fd4a-4336-8dc3-000d5bfe8b09 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:55.098198 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd98c20-fd4a-4336-8dc3-000d5bfe8b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:55.123500 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-cbd98c20-fd4a-4336-8dc3-000d5bfe8b09 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:05:55.124701 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-cbd98c20-fd4a-4336-8dc3-000d5bfe8b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:05:55.193583 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1404/2826] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:05:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:05:55.204541 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d70824-2e78-4279-a60c-f8fa047ae1e8 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:55.206131 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-17d70824-2e78-4279-a60c-f8fa047ae1e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:05:55.272559 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d70824-2e78-4279-a60c-f8fa047ae1e8 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:55.277551 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757ee9d2-23a0-40cf-82eb-29d277cc898e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:55.277971 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757ee9d2-23a0-40cf-82eb-29d277cc898e service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:55.278250 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757ee9d2-23a0-40cf-82eb-29d277cc898e service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:55.278546 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757ee9d2-23a0-40cf-82eb-29d277cc898e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:55.289250 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757ee9d2-23a0-40cf-82eb-29d277cc898e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:55.290910 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757ee9d2-23a0-40cf-82eb-29d277cc898e service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:55.303123 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1423/2827] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:05:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:05:55.682480 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd98c20-fd4a-4336-8dc3-000d5bfe8b09 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:55.684476 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-cbd98c20-fd4a-4336-8dc3-000d5bfe8b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:05:55.699743 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd98c20-fd4a-4336-8dc3-000d5bfe8b09 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:55.706661 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfde945-e2fe-4292-a553-1a062ad99198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:55.707371 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfde945-e2fe-4292-a553-1a062ad99198 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:55.707657 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfde945-e2fe-4292-a553-1a062ad99198 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:55.707923 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfde945-e2fe-4292-a553-1a062ad99198 admin admin] PATH_INFO: `/v3/projects/fd241744634d44a9a7342df10db91274` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:55.709174 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfde945-e2fe-4292-a553-1a062ad99198 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd241744634d44a9a7342df10db91274)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:55.711801 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfde945-e2fe-4292-a553-1a062ad99198 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:55.781402 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:05:55.787213 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-7dfde945-e2fe-4292-a553-1a062ad99198 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd241744634d44a9a7342df10db91274', 'request_id': 'req-7dfde945-e2fe-4292-a553-1a062ad99198'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:55.795280 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-7dfde945-e2fe-4292-a553-1a062ad99198 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd241744634d44a9a7342df10db91274', 'request_id': 'req-7dfde945-e2fe-4292-a553-1a062ad99198'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:55.804771 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-7dfde945-e2fe-4292-a553-1a062ad99198 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd241744634d44a9a7342df10db91274', 'request_id': 'req-7dfde945-e2fe-4292-a553-1a062ad99198'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:55.817573 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-7dfde945-e2fe-4292-a553-1a062ad99198 admin admin] The token cache is being invalidate because project fd241744634d44a9a7342df10db91274 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:05:55.817995 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-7dfde945-e2fe-4292-a553-1a062ad99198 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:55.818759 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-7dfde945-e2fe-4292-a553-1a062ad99198 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:55.820431 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1405/2828] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 15:05:55 2022] DELETE /identity/v3/projects/fd241744634d44a9a7342df10db91274 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:05:55.824637 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757ee9d2-23a0-40cf-82eb-29d277cc898e service neutron] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:55.835469 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757ee9d2-23a0-40cf-82eb-29d277cc898e service neutron] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:55.878789 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:05:55.897742 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54efe2aa-54b8-4465-b58f-69d52e3ffe5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:55.898557 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54efe2aa-54b8-4465-b58f-69d52e3ffe5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:55.898908 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54efe2aa-54b8-4465-b58f-69d52e3ffe5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:55.899187 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54efe2aa-54b8-4465-b58f-69d52e3ffe5a admin admin] PATH_INFO: `/v3/users/d37e63097d044409995aaddc27d27237` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:55.900391 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54efe2aa-54b8-4465-b58f-69d52e3ffe5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d37e63097d044409995aaddc27d27237)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:55.902382 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54efe2aa-54b8-4465-b58f-69d52e3ffe5a admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:55.955670 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-54efe2aa-54b8-4465-b58f-69d52e3ffe5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd37e63097d044409995aaddc27d27237'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:55.966930 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-54efe2aa-54b8-4465-b58f-69d52e3ffe5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd37e63097d044409995aaddc27d27237'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:55.967493 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-54efe2aa-54b8-4465-b58f-69d52e3ffe5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd37e63097d044409995aaddc27d27237'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:55.968274 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-54efe2aa-54b8-4465-b58f-69d52e3ffe5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd37e63097d044409995aaddc27d27237'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:55.984704 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-54efe2aa-54b8-4465-b58f-69d52e3ffe5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd37e63097d044409995aaddc27d27237'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:56.000250 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1424/2829] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 15:05:55 2022] DELETE /identity/v3/users/d37e63097d044409995aaddc27d27237 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:05:56.323622 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfde945-e2fe-4292-a553-1a062ad99198 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:56.325395 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-7dfde945-e2fe-4292-a553-1a062ad99198 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:05:56.344194 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfde945-e2fe-4292-a553-1a062ad99198 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:56.419145 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2327e9-7ac2-4cf8-ac77-283ae2ff971c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:56.419796 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2327e9-7ac2-4cf8-ac77-283ae2ff971c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:56.420069 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2327e9-7ac2-4cf8-ac77-283ae2ff971c admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:56.420456 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2327e9-7ac2-4cf8-ac77-283ae2ff971c admin admin] PATH_INFO: `/v3/projects/7248c9ea8a824f38ab90c2bb7161c91a` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:56.421804 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2327e9-7ac2-4cf8-ac77-283ae2ff971c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7248c9ea8a824f38ab90c2bb7161c91a)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:56.424299 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2327e9-7ac2-4cf8-ac77-283ae2ff971c admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:56.485284 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-8a2327e9-7ac2-4cf8-ac77-283ae2ff971c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7248c9ea8a824f38ab90c2bb7161c91a', 'request_id': 'req-8a2327e9-7ac2-4cf8-ac77-283ae2ff971c'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:56.491581 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-8a2327e9-7ac2-4cf8-ac77-283ae2ff971c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7248c9ea8a824f38ab90c2bb7161c91a', 'request_id': 'req-8a2327e9-7ac2-4cf8-ac77-283ae2ff971c'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:56.502810 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-8a2327e9-7ac2-4cf8-ac77-283ae2ff971c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7248c9ea8a824f38ab90c2bb7161c91a', 'request_id': 'req-8a2327e9-7ac2-4cf8-ac77-283ae2ff971c'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:56.517435 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-8a2327e9-7ac2-4cf8-ac77-283ae2ff971c admin admin] The token cache is being invalidate because project 7248c9ea8a824f38ab90c2bb7161c91a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:05:56.517857 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-8a2327e9-7ac2-4cf8-ac77-283ae2ff971c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:56.518841 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-8a2327e9-7ac2-4cf8-ac77-283ae2ff971c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:56.520778 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1406/2830] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 15:05:56 2022] DELETE /identity/v3/projects/7248c9ea8a824f38ab90c2bb7161c91a => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:05:56.527419 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d75065-65e5-49bd-8b0f-db9bce098f21 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:56.527967 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d75065-65e5-49bd-8b0f-db9bce098f21 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:56.527967 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d75065-65e5-49bd-8b0f-db9bce098f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:56.549082 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-78d75065-65e5-49bd-8b0f-db9bce098f21 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:05:56.550310 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-78d75065-65e5-49bd-8b0f-db9bce098f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:05:56.617189 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1425/2831] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:05:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:05:56.626456 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c1486-5384-4173-b95a-9767167cfac1 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:56.626733 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c1486-5384-4173-b95a-9767167cfac1 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:56.627002 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c1486-5384-4173-b95a-9767167cfac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:56.655383 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-005c1486-5384-4173-b95a-9767167cfac1 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:05:56.657645 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-005c1486-5384-4173-b95a-9767167cfac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:05:56.672044 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1407/2832] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:05:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:05:56.676984 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d75065-65e5-49bd-8b0f-db9bce098f21 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:56.688103 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d75065-65e5-49bd-8b0f-db9bce098f21 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:56.695837 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67ca68a-bf6e-4971-bd07-cfdbb0746688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:56.696800 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ca68a-bf6e-4971-bd07-cfdbb0746688 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:56.697360 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ca68a-bf6e-4971-bd07-cfdbb0746688 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:56.698064 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ca68a-bf6e-4971-bd07-cfdbb0746688 admin admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:56.699213 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67ca68a-bf6e-4971-bd07-cfdbb0746688 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:05:56.699903 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67ca68a-bf6e-4971-bd07-cfdbb0746688 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:56.703731 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67ca68a-bf6e-4971-bd07-cfdbb0746688 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:56.719752 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1426/2833] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 19 15:05:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:05:56.725080 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c1486-5384-4173-b95a-9767167cfac1 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:56.739342 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c1486-5384-4173-b95a-9767167cfac1 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:56.747104 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af30865-276e-4e21-a620-d90cb2eb8996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:56.747976 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af30865-276e-4e21-a620-d90cb2eb8996 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:56.748349 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af30865-276e-4e21-a620-d90cb2eb8996 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:56.748672 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af30865-276e-4e21-a620-d90cb2eb8996 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:56.749673 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af30865-276e-4e21-a620-d90cb2eb8996 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:56.752342 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af30865-276e-4e21-a620-d90cb2eb8996 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:56.794818 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1408/2834] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 15:05:56 2022] POST /identity/v3/projects => generated 387 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:05:56.799502 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67ca68a-bf6e-4971-bd07-cfdbb0746688 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:56.811425 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67ca68a-bf6e-4971-bd07-cfdbb0746688 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:56.871478 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:05:56.888036 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054c5001-fb7a-4885-bd94-e745c6a9210b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:56.888661 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c5001-fb7a-4885-bd94-e745c6a9210b admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:56.888940 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c5001-fb7a-4885-bd94-e745c6a9210b admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:56.889243 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c5001-fb7a-4885-bd94-e745c6a9210b admin admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:56.890537 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054c5001-fb7a-4885-bd94-e745c6a9210b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:56.891871 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054c5001-fb7a-4885-bd94-e745c6a9210b admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:56.921557 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1427/2835] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 15:05:56 2022] POST /identity/v3/users => generated 294 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:05:56.922891 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af30865-276e-4e21-a620-d90cb2eb8996 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:56.933777 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af30865-276e-4e21-a620-d90cb2eb8996 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:56.938766 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32df079e-7a0d-432b-ba15-671bb3b3db0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:56.939381 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df079e-7a0d-432b-ba15-671bb3b3db0b admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:56.939656 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df079e-7a0d-432b-ba15-671bb3b3db0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:56.939932 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df079e-7a0d-432b-ba15-671bb3b3db0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:56.940556 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32df079e-7a0d-432b-ba15-671bb3b3db0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:56.942228 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32df079e-7a0d-432b-ba15-671bb3b3db0b admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:56.958390 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1409/2836] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 15:05:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:05:56.959796 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054c5001-fb7a-4885-bd94-e745c6a9210b admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:56.970541 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054c5001-fb7a-4885-bd94-e745c6a9210b admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:56.976415 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caaedb4-2e9f-4b27-b9e7-10b57e553eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:56.977314 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caaedb4-2e9f-4b27-b9e7-10b57e553eed admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:56.977603 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caaedb4-2e9f-4b27-b9e7-10b57e553eed admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:56.978133 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caaedb4-2e9f-4b27-b9e7-10b57e553eed admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:56.978828 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caaedb4-2e9f-4b27-b9e7-10b57e553eed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:56.980199 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caaedb4-2e9f-4b27-b9e7-10b57e553eed admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:56.995565 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1428/2837] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 15:05:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 15:05:57.002958 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32df079e-7a0d-432b-ba15-671bb3b3db0b admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:57.015310 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32df079e-7a0d-432b-ba15-671bb3b3db0b admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:57.020920 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849c2da1-a9d6-450f-a3e8-1d4e6a7a20e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:57.021623 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c2da1-a9d6-450f-a3e8-1d4e6a7a20e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:57.022084 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c2da1-a9d6-450f-a3e8-1d4e6a7a20e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:57.022279 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c2da1-a9d6-450f-a3e8-1d4e6a7a20e5 admin admin] PATH_INFO: `/v3/projects/1524d57df0984bba9d777f85632b7f57/users/a33fdd8538a742dd8adca75cf8efbfab/roles/74de6794e3b3422b93d26f993d260c35` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:57.040864 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849c2da1-a9d6-450f-a3e8-1d4e6a7a20e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1524d57df0984bba9d777f85632b7f57, user_id=a33fdd8538a742dd8adca75cf8efbfab, role_id=74de6794e3b3422b93d26f993d260c35)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:57.043557 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849c2da1-a9d6-450f-a3e8-1d4e6a7a20e5 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:57.053611 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:05:57.061031 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1410/2838] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 15:05:57 2022] PUT /identity/v3/projects/1524d57df0984bba9d777f85632b7f57/users/a33fdd8538a742dd8adca75cf8efbfab/roles/74de6794e3b3422b93d26f993d260c35 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:05:57.074013 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfba7f6f-a3e7-4df7-a1f0-490b26c1e4e1 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:57.074274 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfba7f6f-a3e7-4df7-a1f0-490b26c1e4e1 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:57.074547 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfba7f6f-a3e7-4df7-a1f0-490b26c1e4e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:57.107255 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-cfba7f6f-a3e7-4df7-a1f0-490b26c1e4e1 None None] MFA Rules not processed for user `a33fdd8538a742dd8adca75cf8efbfab`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:05:57.108501 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-cfba7f6f-a3e7-4df7-a1f0-490b26c1e4e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:05:57.198846 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1429/2839] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:05:57 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:05:57.204761 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849c2da1-a9d6-450f-a3e8-1d4e6a7a20e5 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:57.277945 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849c2da1-a9d6-450f-a3e8-1d4e6a7a20e5 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:57.283060 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6917d8-0311-46ec-88c9-ca6164bb287e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:57.283663 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6917d8-0311-46ec-88c9-ca6164bb287e admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:57.283940 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6917d8-0311-46ec-88c9-ca6164bb287e admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:57.284207 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6917d8-0311-46ec-88c9-ca6164bb287e admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:57.284842 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6917d8-0311-46ec-88c9-ca6164bb287e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:57.286807 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6917d8-0311-46ec-88c9-ca6164bb287e admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:57.318639 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1411/2840] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 15:05:57 2022] POST /identity/v3/projects => generated 385 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:05:57.323302 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfba7f6f-a3e7-4df7-a1f0-490b26c1e4e1 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:57.336247 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfba7f6f-a3e7-4df7-a1f0-490b26c1e4e1 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:57.409630 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f103868c-23e6-44be-a7b8-c70a4ab4de5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:57.410336 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f103868c-23e6-44be-a7b8-c70a4ab4de5b admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:57.410635 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f103868c-23e6-44be-a7b8-c70a4ab4de5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:57.410955 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f103868c-23e6-44be-a7b8-c70a4ab4de5b admin admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:57.413218 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f103868c-23e6-44be-a7b8-c70a4ab4de5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:57.413826 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f103868c-23e6-44be-a7b8-c70a4ab4de5b admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:57.442271 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1430/2841] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 15:05:57 2022] POST /identity/v3/users => generated 299 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:05:57.446666 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6917d8-0311-46ec-88c9-ca6164bb287e admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:57.468921 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6917d8-0311-46ec-88c9-ca6164bb287e admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:57.496488 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37040ada-09bc-4776-abab-23824c5b5d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:57.497457 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37040ada-09bc-4776-abab-23824c5b5d7b admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:57.497733 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37040ada-09bc-4776-abab-23824c5b5d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:57.498003 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37040ada-09bc-4776-abab-23824c5b5d7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:57.498734 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37040ada-09bc-4776-abab-23824c5b5d7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:57.502818 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37040ada-09bc-4776-abab-23824c5b5d7b admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:57.516476 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1412/2842] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 15:05:57 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:05:57.520975 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f103868c-23e6-44be-a7b8-c70a4ab4de5b admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:57.532300 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f103868c-23e6-44be-a7b8-c70a4ab4de5b admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:57.537697 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bc3d02-355e-42f2-aba1-3e360c825471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:57.538439 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc3d02-355e-42f2-aba1-3e360c825471 admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:57.538721 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc3d02-355e-42f2-aba1-3e360c825471 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:57.538996 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc3d02-355e-42f2-aba1-3e360c825471 admin admin] PATH_INFO: `/v3/projects/76034d9653734276a19be306e7683669/users/a66f588652d448dd9218b8e4b8016644/roles/019bde1756cb40de8ce06cef6b261f79` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:57.557675 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bc3d02-355e-42f2-aba1-3e360c825471 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76034d9653734276a19be306e7683669, user_id=a66f588652d448dd9218b8e4b8016644, role_id=019bde1756cb40de8ce06cef6b261f79)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:57.560517 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bc3d02-355e-42f2-aba1-3e360c825471 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:57.576973 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1431/2843] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 15:05:57 2022] PUT /identity/v3/projects/76034d9653734276a19be306e7683669/users/a66f588652d448dd9218b8e4b8016644/roles/019bde1756cb40de8ce06cef6b261f79 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:05:57.581718 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37040ada-09bc-4776-abab-23824c5b5d7b admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:57.592126 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37040ada-09bc-4776-abab-23824c5b5d7b admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:57.660351 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b9432c-39b4-4a70-9f16-85c606fc0830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:57.660967 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b9432c-39b4-4a70-9f16-85c606fc0830 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:57.661301 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b9432c-39b4-4a70-9f16-85c606fc0830 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:57.661524 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b9432c-39b4-4a70-9f16-85c606fc0830 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:57.662195 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b9432c-39b4-4a70-9f16-85c606fc0830 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:57.664493 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b9432c-39b4-4a70-9f16-85c606fc0830 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:57.675024 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1413/2844] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 15:05:57 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:05:57.680439 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bc3d02-355e-42f2-aba1-3e360c825471 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:57.691098 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bc3d02-355e-42f2-aba1-3e360c825471 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:57.698894 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0c9cb7-a31d-46ca-81d2-c973e673fb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:57.699633 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c9cb7-a31d-46ca-81d2-c973e673fb88 admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:57.699911 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c9cb7-a31d-46ca-81d2-c973e673fb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:57.700181 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c9cb7-a31d-46ca-81d2-c973e673fb88 admin admin] PATH_INFO: `/v3/projects/76034d9653734276a19be306e7683669/users/a66f588652d448dd9218b8e4b8016644/roles/019bde1756cb40de8ce06cef6b261f79` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:57.703646 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0c9cb7-a31d-46ca-81d2-c973e673fb88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76034d9653734276a19be306e7683669, user_id=a66f588652d448dd9218b8e4b8016644, role_id=019bde1756cb40de8ce06cef6b261f79)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:57.706968 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0c9cb7-a31d-46ca-81d2-c973e673fb88 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:57.719515 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1432/2845] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 15:05:57 2022] PUT /identity/v3/projects/76034d9653734276a19be306e7683669/users/a66f588652d448dd9218b8e4b8016644/roles/019bde1756cb40de8ce06cef6b261f79 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:05:57.740278 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e9ccd-900c-4324-8a12-5e8999e7d269 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:57.740278 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e9ccd-900c-4324-8a12-5e8999e7d269 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:57.740278 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e9ccd-900c-4324-8a12-5e8999e7d269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:57.769494 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-980e9ccd-900c-4324-8a12-5e8999e7d269 None None] MFA Rules not processed for user `a66f588652d448dd9218b8e4b8016644`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:05:57.770772 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-980e9ccd-900c-4324-8a12-5e8999e7d269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:05:57.837459 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:05:57.849542 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1414/2846] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:05:57 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:05:57.863987 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0c9cb7-a31d-46ca-81d2-c973e673fb88 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:57.865931 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-1e0c9cb7-a31d-46ca-81d2-c973e673fb88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:05:57.881515 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:05:57.934479 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0c9cb7-a31d-46ca-81d2-c973e673fb88 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:57.938419 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d58ed4-8169-488d-a09b-106fbf958bed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df648c909ddb41418128b43f925f5ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:57.939020 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d58ed4-8169-488d-a09b-106fbf958bed service cinder] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:57.939294 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d58ed4-8169-488d-a09b-106fbf958bed service cinder] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:57.939560 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d58ed4-8169-488d-a09b-106fbf958bed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:57.949309 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d58ed4-8169-488d-a09b-106fbf958bed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:57.952014 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d58ed4-8169-488d-a09b-106fbf958bed service cinder] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:57.966948 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1433/2847] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:05:57 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:05:58.010951 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980e9ccd-900c-4324-8a12-5e8999e7d269 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:58.082022 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980e9ccd-900c-4324-8a12-5e8999e7d269 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:58.087270 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e91102-20e3-45f3-9020-8863386c8723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:58.087938 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e91102-20e3-45f3-9020-8863386c8723 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:58.088245 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e91102-20e3-45f3-9020-8863386c8723 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:58.088461 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e91102-20e3-45f3-9020-8863386c8723 admin admin] PATH_INFO: `/v3/users/a33fdd8538a742dd8adca75cf8efbfab` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:58.090174 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e91102-20e3-45f3-9020-8863386c8723 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a33fdd8538a742dd8adca75cf8efbfab)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:58.092459 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e91102-20e3-45f3-9020-8863386c8723 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:58.165784 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b0e91102-20e3-45f3-9020-8863386c8723 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a33fdd8538a742dd8adca75cf8efbfab'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:58.174847 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b0e91102-20e3-45f3-9020-8863386c8723 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a33fdd8538a742dd8adca75cf8efbfab'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:58.175542 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b0e91102-20e3-45f3-9020-8863386c8723 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a33fdd8538a742dd8adca75cf8efbfab'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:58.176165 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b0e91102-20e3-45f3-9020-8863386c8723 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a33fdd8538a742dd8adca75cf8efbfab'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:58.185254 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b0e91102-20e3-45f3-9020-8863386c8723 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a33fdd8538a742dd8adca75cf8efbfab'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:58.212298 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1415/2848] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 15:05:58 2022] DELETE /identity/v3/users/a33fdd8538a742dd8adca75cf8efbfab => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:05:58.218913 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990fb7c5-fb2b-4f51-a160-2c485c26c326 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:58.219380 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990fb7c5-fb2b-4f51-a160-2c485c26c326 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:58.220088 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990fb7c5-fb2b-4f51-a160-2c485c26c326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:58.248211 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-990fb7c5-fb2b-4f51-a160-2c485c26c326 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:05:58.249489 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-990fb7c5-fb2b-4f51-a160-2c485c26c326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:05:58.316553 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1434/2849] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:05:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:05:58.327753 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e91102-20e3-45f3-9020-8863386c8723 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:58.329281 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b0e91102-20e3-45f3-9020-8863386c8723 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:05:58.391247 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e91102-20e3-45f3-9020-8863386c8723 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:58.395382 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db30d0f9-c671-4db1-b281-f1dd2c3356d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:58.396039 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db30d0f9-c671-4db1-b281-f1dd2c3356d8 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:58.396319 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db30d0f9-c671-4db1-b281-f1dd2c3356d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:58.396610 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db30d0f9-c671-4db1-b281-f1dd2c3356d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:58.407253 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db30d0f9-c671-4db1-b281-f1dd2c3356d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:58.408855 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db30d0f9-c671-4db1-b281-f1dd2c3356d8 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:58.419473 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1416/2850] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:05:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:05:58.732119 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990fb7c5-fb2b-4f51-a160-2c485c26c326 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:58.733640 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-990fb7c5-fb2b-4f51-a160-2c485c26c326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:05:58.752064 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990fb7c5-fb2b-4f51-a160-2c485c26c326 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:58.756707 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eaeec0-60b8-46d5-87ce-1c5dec7bd32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:58.758407 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eaeec0-60b8-46d5-87ce-1c5dec7bd32f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:58.758690 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eaeec0-60b8-46d5-87ce-1c5dec7bd32f admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:58.758964 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eaeec0-60b8-46d5-87ce-1c5dec7bd32f admin admin] PATH_INFO: `/v3/projects/1524d57df0984bba9d777f85632b7f57` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:58.760207 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eaeec0-60b8-46d5-87ce-1c5dec7bd32f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1524d57df0984bba9d777f85632b7f57)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:58.762214 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eaeec0-60b8-46d5-87ce-1c5dec7bd32f admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:58.818701 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-20eaeec0-60b8-46d5-87ce-1c5dec7bd32f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1524d57df0984bba9d777f85632b7f57', 'request_id': 'req-20eaeec0-60b8-46d5-87ce-1c5dec7bd32f'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:58.827281 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-20eaeec0-60b8-46d5-87ce-1c5dec7bd32f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1524d57df0984bba9d777f85632b7f57', 'request_id': 'req-20eaeec0-60b8-46d5-87ce-1c5dec7bd32f'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:58.838936 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-20eaeec0-60b8-46d5-87ce-1c5dec7bd32f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1524d57df0984bba9d777f85632b7f57', 'request_id': 'req-20eaeec0-60b8-46d5-87ce-1c5dec7bd32f'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:58.852208 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-20eaeec0-60b8-46d5-87ce-1c5dec7bd32f admin admin] The token cache is being invalidate because project 1524d57df0984bba9d777f85632b7f57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:05:58.852504 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-20eaeec0-60b8-46d5-87ce-1c5dec7bd32f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:58.853399 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-20eaeec0-60b8-46d5-87ce-1c5dec7bd32f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:58.855115 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1435/2851] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 15:05:58 2022] DELETE /identity/v3/projects/1524d57df0984bba9d777f85632b7f57 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:05:58.859497 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db30d0f9-c671-4db1-b281-f1dd2c3356d8 service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:58.870076 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db30d0f9-c671-4db1-b281-f1dd2c3356d8 service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:58.886605 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:05:58.947053 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc83eb1-3e41-4d4a-9ca8-99edf0ce8c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:58.947684 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc83eb1-3e41-4d4a-9ca8-99edf0ce8c71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:58.947966 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc83eb1-3e41-4d4a-9ca8-99edf0ce8c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:58.948260 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc83eb1-3e41-4d4a-9ca8-99edf0ce8c71 admin admin] PATH_INFO: `/v3/users/a66f588652d448dd9218b8e4b8016644` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:58.949444 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc83eb1-3e41-4d4a-9ca8-99edf0ce8c71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a66f588652d448dd9218b8e4b8016644)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:58.951709 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc83eb1-3e41-4d4a-9ca8-99edf0ce8c71 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:59.007445 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-6dc83eb1-3e41-4d4a-9ca8-99edf0ce8c71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a66f588652d448dd9218b8e4b8016644'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:59.019254 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-6dc83eb1-3e41-4d4a-9ca8-99edf0ce8c71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a66f588652d448dd9218b8e4b8016644'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:59.020118 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-6dc83eb1-3e41-4d4a-9ca8-99edf0ce8c71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a66f588652d448dd9218b8e4b8016644'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:59.020881 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-6dc83eb1-3e41-4d4a-9ca8-99edf0ce8c71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a66f588652d448dd9218b8e4b8016644'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:59.029007 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-6dc83eb1-3e41-4d4a-9ca8-99edf0ce8c71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a66f588652d448dd9218b8e4b8016644'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:59.047749 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1417/2852] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 15:05:58 2022] DELETE /identity/v3/users/a66f588652d448dd9218b8e4b8016644 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:05:59.371246 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eaeec0-60b8-46d5-87ce-1c5dec7bd32f admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:59.373404 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-20eaeec0-60b8-46d5-87ce-1c5dec7bd32f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:05:59.395909 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eaeec0-60b8-46d5-87ce-1c5dec7bd32f admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:59.449490 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:05:59.483087 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecb4275-3e74-4d30-96f5-65f726a40aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:59.483729 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb4275-3e74-4d30-96f5-65f726a40aed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:59.484001 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb4275-3e74-4d30-96f5-65f726a40aed admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:59.484269 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb4275-3e74-4d30-96f5-65f726a40aed admin admin] PATH_INFO: `/v3/projects/76034d9653734276a19be306e7683669` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:59.485428 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecb4275-3e74-4d30-96f5-65f726a40aed admin admin] RBAC: Authorizing `identity:delete_project(project_id=76034d9653734276a19be306e7683669)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:59.487341 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecb4275-3e74-4d30-96f5-65f726a40aed admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:59.543579 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-9ecb4275-3e74-4d30-96f5-65f726a40aed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76034d9653734276a19be306e7683669', 'request_id': 'req-9ecb4275-3e74-4d30-96f5-65f726a40aed'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:59.550735 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-9ecb4275-3e74-4d30-96f5-65f726a40aed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76034d9653734276a19be306e7683669', 'request_id': 'req-9ecb4275-3e74-4d30-96f5-65f726a40aed'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:59.560836 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-9ecb4275-3e74-4d30-96f5-65f726a40aed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76034d9653734276a19be306e7683669', 'request_id': 'req-9ecb4275-3e74-4d30-96f5-65f726a40aed'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:59.573128 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-9ecb4275-3e74-4d30-96f5-65f726a40aed admin admin] The token cache is being invalidate because project 76034d9653734276a19be306e7683669 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:05:59.573414 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-9ecb4275-3e74-4d30-96f5-65f726a40aed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:59.574330 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-9ecb4275-3e74-4d30-96f5-65f726a40aed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:05:59.575908 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1436/2853] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 15:05:59 2022] DELETE /identity/v3/projects/76034d9653734276a19be306e7683669 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:05:59.581833 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6baa5-92c5-457d-93ec-2cacdd979fda None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:59.582115 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6baa5-92c5-457d-93ec-2cacdd979fda None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:59.582386 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6baa5-92c5-457d-93ec-2cacdd979fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:59.604504 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-78a6baa5-92c5-457d-93ec-2cacdd979fda None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:05:59.605646 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-78a6baa5-92c5-457d-93ec-2cacdd979fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:05:59.675428 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1418/2854] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:05:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:05:59.684002 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc240f7-7c4b-4973-a77a-425ee875e0bf None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:59.684289 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc240f7-7c4b-4973-a77a-425ee875e0bf None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:59.684584 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc240f7-7c4b-4973-a77a-425ee875e0bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:59.712925 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-ddc240f7-7c4b-4973-a77a-425ee875e0bf None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:05:59.715639 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-ddc240f7-7c4b-4973-a77a-425ee875e0bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:05:59.725512 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1437/2855] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:05:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:05:59.730528 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a6baa5-92c5-457d-93ec-2cacdd979fda None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:59.741325 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a6baa5-92c5-457d-93ec-2cacdd979fda None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:59.748730 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688cb52b-e0e1-48e8-8db9-79f394a5a633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:59.749404 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688cb52b-e0e1-48e8-8db9-79f394a5a633 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:59.749676 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688cb52b-e0e1-48e8-8db9-79f394a5a633 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:59.749937 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688cb52b-e0e1-48e8-8db9-79f394a5a633 admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:59.750582 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688cb52b-e0e1-48e8-8db9-79f394a5a633 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:05:59.750879 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688cb52b-e0e1-48e8-8db9-79f394a5a633 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:59.752469 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688cb52b-e0e1-48e8-8db9-79f394a5a633 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:59.767782 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1419/2856] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 19 15:05:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:05:59.773278 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc240f7-7c4b-4973-a77a-425ee875e0bf None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:59.783542 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc240f7-7c4b-4973-a77a-425ee875e0bf None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:59.788673 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb7889b-25a5-4c98-a9b2-d99107e896fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:59.789551 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb7889b-25a5-4c98-a9b2-d99107e896fc admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:59.789551 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb7889b-25a5-4c98-a9b2-d99107e896fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:59.789956 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb7889b-25a5-4c98-a9b2-d99107e896fc admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:59.790481 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb7889b-25a5-4c98-a9b2-d99107e896fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:59.792404 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb7889b-25a5-4c98-a9b2-d99107e896fc admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:59.824574 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1438/2857] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 15:05:59 2022] POST /identity/v3/projects => generated 379 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:05:59.829192 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688cb52b-e0e1-48e8-8db9-79f394a5a633 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:59.839904 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688cb52b-e0e1-48e8-8db9-79f394a5a633 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:59.859160 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:05:59.902507 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6771f9f9-6d74-4f2f-b1f0-d1cda71e9cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:59.903188 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6771f9f9-6d74-4f2f-b1f0-d1cda71e9cba admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:59.903340 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6771f9f9-6d74-4f2f-b1f0-d1cda71e9cba admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:59.903656 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6771f9f9-6d74-4f2f-b1f0-d1cda71e9cba admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:59.904323 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6771f9f9-6d74-4f2f-b1f0-d1cda71e9cba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:59.906827 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6771f9f9-6d74-4f2f-b1f0-d1cda71e9cba admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:59.934012 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1420/2858] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 15:05:59 2022] POST /identity/v3/users => generated 290 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:05:59.938230 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb7889b-25a5-4c98-a9b2-d99107e896fc admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:59.949324 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb7889b-25a5-4c98-a9b2-d99107e896fc admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:05:59.955375 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd4aad5-fcbf-404c-90b3-c0865499b1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:05:59.955991 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd4aad5-fcbf-404c-90b3-c0865499b1f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:05:59.956428 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd4aad5-fcbf-404c-90b3-c0865499b1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:05:59.956702 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd4aad5-fcbf-404c-90b3-c0865499b1f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:05:59.957425 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd4aad5-fcbf-404c-90b3-c0865499b1f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:05:59.959037 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd4aad5-fcbf-404c-90b3-c0865499b1f4 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:05:59.970501 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1439/2859] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 15:05:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:05:59.975080 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6771f9f9-6d74-4f2f-b1f0-d1cda71e9cba admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:05:59.998762 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6771f9f9-6d74-4f2f-b1f0-d1cda71e9cba admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:00.004343 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099c070a-9048-4b6e-bdcd-f89287a6d0d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:00.004972 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099c070a-9048-4b6e-bdcd-f89287a6d0d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:00.005297 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099c070a-9048-4b6e-bdcd-f89287a6d0d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:00.005562 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099c070a-9048-4b6e-bdcd-f89287a6d0d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:00.006205 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099c070a-9048-4b6e-bdcd-f89287a6d0d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:00.008279 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099c070a-9048-4b6e-bdcd-f89287a6d0d8 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:00.019637 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1421/2860] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 15:05:59 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:06:00.025259 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd4aad5-fcbf-404c-90b3-c0865499b1f4 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:00.037725 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd4aad5-fcbf-404c-90b3-c0865499b1f4 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:00.044011 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5fc20c-a886-4768-aa9c-21cd3fc02dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:00.044883 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5fc20c-a886-4768-aa9c-21cd3fc02dfb admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:00.045309 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5fc20c-a886-4768-aa9c-21cd3fc02dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:00.045638 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5fc20c-a886-4768-aa9c-21cd3fc02dfb admin admin] PATH_INFO: `/v3/projects/b105326e4c3342fcb295c6d469e4bcdb/users/481bd7db86214aa9a319c5a3bc97fc65/roles/74de6794e3b3422b93d26f993d260c35` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:00.063242 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5fc20c-a886-4768-aa9c-21cd3fc02dfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b105326e4c3342fcb295c6d469e4bcdb, user_id=481bd7db86214aa9a319c5a3bc97fc65, role_id=74de6794e3b3422b93d26f993d260c35)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:00.066025 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5fc20c-a886-4768-aa9c-21cd3fc02dfb admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:00.082112 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1440/2861] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 15:06:00 2022] PUT /identity/v3/projects/b105326e4c3342fcb295c6d469e4bcdb/users/481bd7db86214aa9a319c5a3bc97fc65/roles/74de6794e3b3422b93d26f993d260c35 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:06:00.094576 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf4f30e-aba3-4a1e-90fe-0c7af90322d9 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:00.094956 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf4f30e-aba3-4a1e-90fe-0c7af90322d9 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:00.095342 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf4f30e-aba3-4a1e-90fe-0c7af90322d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:00.125218 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-ebf4f30e-aba3-4a1e-90fe-0c7af90322d9 None None] MFA Rules not processed for user `481bd7db86214aa9a319c5a3bc97fc65`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:06:00.126355 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ebf4f30e-aba3-4a1e-90fe-0c7af90322d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:06:00.193390 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1422/2862] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:06:00 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:06:00.198749 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5fc20c-a886-4768-aa9c-21cd3fc02dfb admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:00.270360 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5fc20c-a886-4768-aa9c-21cd3fc02dfb admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:00.275438 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f316708-23bb-4c15-8334-3fe40a3930cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:00.276059 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f316708-23bb-4c15-8334-3fe40a3930cb admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:00.276338 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f316708-23bb-4c15-8334-3fe40a3930cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:00.276613 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f316708-23bb-4c15-8334-3fe40a3930cb admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:00.277312 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f316708-23bb-4c15-8334-3fe40a3930cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:00.279266 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f316708-23bb-4c15-8334-3fe40a3930cb admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:00.290105 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:06:00.312863 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1441/2863] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 15:06:00 2022] POST /identity/v3/projects => generated 379 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:06:00.318001 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf4f30e-aba3-4a1e-90fe-0c7af90322d9 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:00.330984 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf4f30e-aba3-4a1e-90fe-0c7af90322d9 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:00.398109 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabe1f2f-cbc8-414c-a2bf-f7579e2b0782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:00.398895 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabe1f2f-cbc8-414c-a2bf-f7579e2b0782 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:00.399173 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabe1f2f-cbc8-414c-a2bf-f7579e2b0782 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:00.399439 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabe1f2f-cbc8-414c-a2bf-f7579e2b0782 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:00.400075 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabe1f2f-cbc8-414c-a2bf-f7579e2b0782 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:00.402056 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabe1f2f-cbc8-414c-a2bf-f7579e2b0782 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:00.426186 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1423/2864] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 15:06:00 2022] POST /identity/v3/users => generated 296 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:06:00.430822 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f316708-23bb-4c15-8334-3fe40a3930cb admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:00.441789 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f316708-23bb-4c15-8334-3fe40a3930cb admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:00.447842 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103f920e-c9da-4b86-8511-7748d097e027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:00.448466 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f920e-c9da-4b86-8511-7748d097e027 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:00.448729 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f920e-c9da-4b86-8511-7748d097e027 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:00.449010 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f920e-c9da-4b86-8511-7748d097e027 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:00.449678 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103f920e-c9da-4b86-8511-7748d097e027 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:00.451631 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103f920e-c9da-4b86-8511-7748d097e027 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:00.462974 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1442/2865] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 15:06:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 15:06:00.467557 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabe1f2f-cbc8-414c-a2bf-f7579e2b0782 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:00.478588 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabe1f2f-cbc8-414c-a2bf-f7579e2b0782 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:00.483986 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6404e551-f56c-47f5-a178-129479949106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:00.484528 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6404e551-f56c-47f5-a178-129479949106 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:00.484904 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6404e551-f56c-47f5-a178-129479949106 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:00.485202 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6404e551-f56c-47f5-a178-129479949106 admin admin] PATH_INFO: `/v3/projects/8ff7e92130234a65867c8e23a28bddce/users/dced799f03004074ac4125f0c3d648ba/roles/019bde1756cb40de8ce06cef6b261f79` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:00.503494 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6404e551-f56c-47f5-a178-129479949106 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ff7e92130234a65867c8e23a28bddce, user_id=dced799f03004074ac4125f0c3d648ba, role_id=019bde1756cb40de8ce06cef6b261f79)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:00.506758 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6404e551-f56c-47f5-a178-129479949106 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:00.510665 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:06:00.524779 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1424/2866] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 15:06:00 2022] PUT /identity/v3/projects/8ff7e92130234a65867c8e23a28bddce/users/dced799f03004074ac4125f0c3d648ba/roles/019bde1756cb40de8ce06cef6b261f79 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:06:00.529097 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103f920e-c9da-4b86-8511-7748d097e027 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:00.541008 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103f920e-c9da-4b86-8511-7748d097e027 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:00.611704 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d9cb47-eefb-4d85-8de2-4bfce737e385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:00.612311 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9cb47-eefb-4d85-8de2-4bfce737e385 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:00.612589 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9cb47-eefb-4d85-8de2-4bfce737e385 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:00.612858 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9cb47-eefb-4d85-8de2-4bfce737e385 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:00.613606 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d9cb47-eefb-4d85-8de2-4bfce737e385 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:00.615320 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d9cb47-eefb-4d85-8de2-4bfce737e385 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:00.631239 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1443/2867] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 15:06:00 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:06:00.632778 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6404e551-f56c-47f5-a178-129479949106 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:00.644610 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6404e551-f56c-47f5-a178-129479949106 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:00.650930 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98059692-24f5-4de4-9798-01cd6dbaf4a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:00.651630 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98059692-24f5-4de4-9798-01cd6dbaf4a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:00.651980 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98059692-24f5-4de4-9798-01cd6dbaf4a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:00.652318 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98059692-24f5-4de4-9798-01cd6dbaf4a1 admin admin] PATH_INFO: `/v3/projects/8ff7e92130234a65867c8e23a28bddce/users/dced799f03004074ac4125f0c3d648ba/roles/019bde1756cb40de8ce06cef6b261f79` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:00.654657 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98059692-24f5-4de4-9798-01cd6dbaf4a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ff7e92130234a65867c8e23a28bddce, user_id=dced799f03004074ac4125f0c3d648ba, role_id=019bde1756cb40de8ce06cef6b261f79)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:00.657688 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98059692-24f5-4de4-9798-01cd6dbaf4a1 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:00.669378 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1425/2868] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 15:06:00 2022] PUT /identity/v3/projects/8ff7e92130234a65867c8e23a28bddce/users/dced799f03004074ac4125f0c3d648ba/roles/019bde1756cb40de8ce06cef6b261f79 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:06:00.680308 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27202677-76fc-4435-8df8-2075b240dc1f None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:00.680676 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27202677-76fc-4435-8df8-2075b240dc1f None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:00.681174 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27202677-76fc-4435-8df8-2075b240dc1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:00.713174 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-27202677-76fc-4435-8df8-2075b240dc1f None None] MFA Rules not processed for user `dced799f03004074ac4125f0c3d648ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:06:00.714403 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-27202677-76fc-4435-8df8-2075b240dc1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:06:00.785879 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1444/2869] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:06:00 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:06:00.801422 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98059692-24f5-4de4-9798-01cd6dbaf4a1 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:00.803944 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-98059692-24f5-4de4-9798-01cd6dbaf4a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:06:00.873421 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98059692-24f5-4de4-9798-01cd6dbaf4a1 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:00.878009 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443ceee9-302d-4d95-9b54-f300f3197949 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df648c909ddb41418128b43f925f5ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:00.878615 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443ceee9-302d-4d95-9b54-f300f3197949 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:00.878890 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443ceee9-302d-4d95-9b54-f300f3197949 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:00.879150 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443ceee9-302d-4d95-9b54-f300f3197949 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:00.890113 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443ceee9-302d-4d95-9b54-f300f3197949 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:00.891564 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443ceee9-302d-4d95-9b54-f300f3197949 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:00.911480 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1426/2870] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:06:00 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:06:01.301005 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27202677-76fc-4435-8df8-2075b240dc1f None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:01.310647 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27202677-76fc-4435-8df8-2075b240dc1f None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:01.315451 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ba5c6c-3944-4551-b867-89cbb945285f tempest-VolumeQuotaClassesTest-590883245 tempest-VolumeQuotaClassesTest-590883245-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dced799f03004074ac4125f0c3d648ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff7e92130234a65867c8e23a28bddce', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:01.316072 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba5c6c-3944-4551-b867-89cbb945285f tempest-VolumeQuotaClassesTest-590883245 tempest-VolumeQuotaClassesTest-590883245-project-admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:01.316462 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba5c6c-3944-4551-b867-89cbb945285f tempest-VolumeQuotaClassesTest-590883245 tempest-VolumeQuotaClassesTest-590883245-project-admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:01.316609 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba5c6c-3944-4551-b867-89cbb945285f tempest-VolumeQuotaClassesTest-590883245 tempest-VolumeQuotaClassesTest-590883245-project-admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:01.317293 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ba5c6c-3944-4551-b867-89cbb945285f tempest-VolumeQuotaClassesTest-590883245 tempest-VolumeQuotaClassesTest-590883245-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:06:01.317594 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ba5c6c-3944-4551-b867-89cbb945285f tempest-VolumeQuotaClassesTest-590883245 tempest-VolumeQuotaClassesTest-590883245-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:01.319198 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ba5c6c-3944-4551-b867-89cbb945285f tempest-VolumeQuotaClassesTest-590883245 tempest-VolumeQuotaClassesTest-590883245-project-admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:01.334553 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1445/2871] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 19 15:06:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:06:01.339117 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443ceee9-302d-4d95-9b54-f300f3197949 service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:01.348386 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443ceee9-302d-4d95-9b54-f300f3197949 service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:01.354807 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e6cd44-d8c3-4f07-8a04-f3eb3797abd9 tempest-VolumeQuotaClassesTest-590883245 tempest-VolumeQuotaClassesTest-590883245-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dced799f03004074ac4125f0c3d648ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff7e92130234a65867c8e23a28bddce', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:01.355444 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e6cd44-d8c3-4f07-8a04-f3eb3797abd9 tempest-VolumeQuotaClassesTest-590883245 tempest-VolumeQuotaClassesTest-590883245-project-admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:01.355720 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e6cd44-d8c3-4f07-8a04-f3eb3797abd9 tempest-VolumeQuotaClassesTest-590883245 tempest-VolumeQuotaClassesTest-590883245-project-admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:01.355981 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e6cd44-d8c3-4f07-8a04-f3eb3797abd9 tempest-VolumeQuotaClassesTest-590883245 tempest-VolumeQuotaClassesTest-590883245-project-admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:01.356615 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e6cd44-d8c3-4f07-8a04-f3eb3797abd9 tempest-VolumeQuotaClassesTest-590883245 tempest-VolumeQuotaClassesTest-590883245-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:01.358561 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e6cd44-d8c3-4f07-8a04-f3eb3797abd9 tempest-VolumeQuotaClassesTest-590883245 tempest-VolumeQuotaClassesTest-590883245-project-admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:01.394253 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1427/2872] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 15:06:01 2022] POST /identity/v3/projects => generated 354 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:06:01.399344 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ba5c6c-3944-4551-b867-89cbb945285f tempest-VolumeQuotaClassesTest-590883245 tempest-VolumeQuotaClassesTest-590883245-project-admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:01.411023 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ba5c6c-3944-4551-b867-89cbb945285f tempest-VolumeQuotaClassesTest-590883245 tempest-VolumeQuotaClassesTest-590883245-project-admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:01.459590 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:06:01.475504 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d657b6-4c2e-4bbf-8b85-23e226f09cb0 tempest-VolumeQuotaClassesTest-590883245 tempest-VolumeQuotaClassesTest-590883245-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dced799f03004074ac4125f0c3d648ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff7e92130234a65867c8e23a28bddce', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:01.476707 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d657b6-4c2e-4bbf-8b85-23e226f09cb0 tempest-VolumeQuotaClassesTest-590883245 tempest-VolumeQuotaClassesTest-590883245-project-admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:01.476897 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d657b6-4c2e-4bbf-8b85-23e226f09cb0 tempest-VolumeQuotaClassesTest-590883245 tempest-VolumeQuotaClassesTest-590883245-project-admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:01.477213 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d657b6-4c2e-4bbf-8b85-23e226f09cb0 tempest-VolumeQuotaClassesTest-590883245 tempest-VolumeQuotaClassesTest-590883245-project-admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:01.477906 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d657b6-4c2e-4bbf-8b85-23e226f09cb0 tempest-VolumeQuotaClassesTest-590883245 tempest-VolumeQuotaClassesTest-590883245-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:06:01.478213 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d657b6-4c2e-4bbf-8b85-23e226f09cb0 tempest-VolumeQuotaClassesTest-590883245 tempest-VolumeQuotaClassesTest-590883245-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:01.479829 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d657b6-4c2e-4bbf-8b85-23e226f09cb0 tempest-VolumeQuotaClassesTest-590883245 tempest-VolumeQuotaClassesTest-590883245-project-admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:01.492497 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1446/2873] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 19 15:06:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:06:01.531236 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e6cd44-d8c3-4f07-8a04-f3eb3797abd9 tempest-VolumeQuotaClassesTest-590883245 tempest-VolumeQuotaClassesTest-590883245-project-admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:01.544427 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e6cd44-d8c3-4f07-8a04-f3eb3797abd9 tempest-VolumeQuotaClassesTest-590883245 tempest-VolumeQuotaClassesTest-590883245-project-admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:01.550116 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5283e6-8217-48fc-bae1-73357c8529c5 tempest-VolumeQuotaClassesTest-590883245 tempest-VolumeQuotaClassesTest-590883245-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dced799f03004074ac4125f0c3d648ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ff7e92130234a65867c8e23a28bddce', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:01.550759 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5283e6-8217-48fc-bae1-73357c8529c5 tempest-VolumeQuotaClassesTest-590883245 tempest-VolumeQuotaClassesTest-590883245-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:01.551064 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5283e6-8217-48fc-bae1-73357c8529c5 tempest-VolumeQuotaClassesTest-590883245 tempest-VolumeQuotaClassesTest-590883245-project-admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:01.551444 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5283e6-8217-48fc-bae1-73357c8529c5 tempest-VolumeQuotaClassesTest-590883245 tempest-VolumeQuotaClassesTest-590883245-project-admin] PATH_INFO: `/v3/projects/7fc8cb93783242be8bd45a6c6df47022` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:01.552782 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5283e6-8217-48fc-bae1-73357c8529c5 tempest-VolumeQuotaClassesTest-590883245 tempest-VolumeQuotaClassesTest-590883245-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7fc8cb93783242be8bd45a6c6df47022)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:01.554787 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5283e6-8217-48fc-bae1-73357c8529c5 tempest-VolumeQuotaClassesTest-590883245 tempest-VolumeQuotaClassesTest-590883245-project-admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:01.620945 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0e5283e6-8217-48fc-bae1-73357c8529c5 tempest-VolumeQuotaClassesTest-590883245 tempest-VolumeQuotaClassesTest-590883245-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fc8cb93783242be8bd45a6c6df47022', 'request_id': 'req-0e5283e6-8217-48fc-bae1-73357c8529c5'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:01.631798 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0e5283e6-8217-48fc-bae1-73357c8529c5 tempest-VolumeQuotaClassesTest-590883245 tempest-VolumeQuotaClassesTest-590883245-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fc8cb93783242be8bd45a6c6df47022', 'request_id': 'req-0e5283e6-8217-48fc-bae1-73357c8529c5'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:01.643538 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0e5283e6-8217-48fc-bae1-73357c8529c5 tempest-VolumeQuotaClassesTest-590883245 tempest-VolumeQuotaClassesTest-590883245-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fc8cb93783242be8bd45a6c6df47022', 'request_id': 'req-0e5283e6-8217-48fc-bae1-73357c8529c5'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:01.661395 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0e5283e6-8217-48fc-bae1-73357c8529c5 tempest-VolumeQuotaClassesTest-590883245 tempest-VolumeQuotaClassesTest-590883245-project-admin] The token cache is being invalidate because project 7fc8cb93783242be8bd45a6c6df47022 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:06:01.661954 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0e5283e6-8217-48fc-bae1-73357c8529c5 tempest-VolumeQuotaClassesTest-590883245 tempest-VolumeQuotaClassesTest-590883245-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:01.663151 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0e5283e6-8217-48fc-bae1-73357c8529c5 tempest-VolumeQuotaClassesTest-590883245 tempest-VolumeQuotaClassesTest-590883245-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:01.665282 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1428/2874] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 15:06:01 2022] DELETE /identity/v3/projects/7fc8cb93783242be8bd45a6c6df47022 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:06:01.911389 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d657b6-4c2e-4bbf-8b85-23e226f09cb0 tempest-VolumeQuotaClassesTest-590883245 tempest-VolumeQuotaClassesTest-590883245-project-admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:01.913210 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-63d657b6-4c2e-4bbf-8b85-23e226f09cb0 tempest-VolumeQuotaClassesTest-590883245 tempest-VolumeQuotaClassesTest-590883245-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:06:01.983086 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d657b6-4c2e-4bbf-8b85-23e226f09cb0 tempest-VolumeQuotaClassesTest-590883245 tempest-VolumeQuotaClassesTest-590883245-project-admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:02.050441 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac6f079-ad8b-4db3-aa76-315ab2f6fc98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:02.050998 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac6f079-ad8b-4db3-aa76-315ab2f6fc98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:02.051274 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac6f079-ad8b-4db3-aa76-315ab2f6fc98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:02.051550 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac6f079-ad8b-4db3-aa76-315ab2f6fc98 admin admin] PATH_INFO: `/v3/users/481bd7db86214aa9a319c5a3bc97fc65` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:02.052885 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac6f079-ad8b-4db3-aa76-315ab2f6fc98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=481bd7db86214aa9a319c5a3bc97fc65)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:02.054920 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac6f079-ad8b-4db3-aa76-315ab2f6fc98 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:02.106851 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-5ac6f079-ad8b-4db3-aa76-315ab2f6fc98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '481bd7db86214aa9a319c5a3bc97fc65'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:02.117523 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-5ac6f079-ad8b-4db3-aa76-315ab2f6fc98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '481bd7db86214aa9a319c5a3bc97fc65'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:02.118539 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-5ac6f079-ad8b-4db3-aa76-315ab2f6fc98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '481bd7db86214aa9a319c5a3bc97fc65'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:02.119528 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-5ac6f079-ad8b-4db3-aa76-315ab2f6fc98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '481bd7db86214aa9a319c5a3bc97fc65'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:02.137638 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-5ac6f079-ad8b-4db3-aa76-315ab2f6fc98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '481bd7db86214aa9a319c5a3bc97fc65'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:02.152322 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1447/2875] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 15:06:01 2022] DELETE /identity/v3/users/481bd7db86214aa9a319c5a3bc97fc65 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:06:02.159322 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf631c-5a64-40cb-b0c7-3553ca05894e None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:02.159943 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf631c-5a64-40cb-b0c7-3553ca05894e None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:02.159943 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf631c-5a64-40cb-b0c7-3553ca05894e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:02.180424 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-09cf631c-5a64-40cb-b0c7-3553ca05894e None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:06:02.181673 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-09cf631c-5a64-40cb-b0c7-3553ca05894e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:06:02.229956 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:06:02.253589 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1429/2876] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:06:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:06:02.265510 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac6f079-ad8b-4db3-aa76-315ab2f6fc98 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:02.267139 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-5ac6f079-ad8b-4db3-aa76-315ab2f6fc98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:06:02.279421 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:06:02.334894 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac6f079-ad8b-4db3-aa76-315ab2f6fc98 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:02.339312 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa12ac51-b109-4363-993d-4a5040f4805e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:02.339925 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa12ac51-b109-4363-993d-4a5040f4805e service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:02.340202 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa12ac51-b109-4363-993d-4a5040f4805e service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:02.340473 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa12ac51-b109-4363-993d-4a5040f4805e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:02.353330 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa12ac51-b109-4363-993d-4a5040f4805e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:02.354797 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa12ac51-b109-4363-993d-4a5040f4805e service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:02.366979 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1448/2877] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:06:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:06:02.752680 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cf631c-5a64-40cb-b0c7-3553ca05894e None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:02.754269 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-09cf631c-5a64-40cb-b0c7-3553ca05894e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:06:02.774528 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cf631c-5a64-40cb-b0c7-3553ca05894e None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:02.780352 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0346fbf2-cb72-44d4-8e96-c0fba4cab59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:02.781237 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0346fbf2-cb72-44d4-8e96-c0fba4cab59d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:02.781867 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0346fbf2-cb72-44d4-8e96-c0fba4cab59d admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:02.781867 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0346fbf2-cb72-44d4-8e96-c0fba4cab59d admin admin] PATH_INFO: `/v3/projects/b105326e4c3342fcb295c6d469e4bcdb` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:02.783136 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0346fbf2-cb72-44d4-8e96-c0fba4cab59d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b105326e4c3342fcb295c6d469e4bcdb)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:02.785239 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0346fbf2-cb72-44d4-8e96-c0fba4cab59d admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:02.841123 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0346fbf2-cb72-44d4-8e96-c0fba4cab59d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b105326e4c3342fcb295c6d469e4bcdb', 'request_id': 'req-0346fbf2-cb72-44d4-8e96-c0fba4cab59d'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:02.847662 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0346fbf2-cb72-44d4-8e96-c0fba4cab59d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b105326e4c3342fcb295c6d469e4bcdb', 'request_id': 'req-0346fbf2-cb72-44d4-8e96-c0fba4cab59d'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:02.857427 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0346fbf2-cb72-44d4-8e96-c0fba4cab59d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b105326e4c3342fcb295c6d469e4bcdb', 'request_id': 'req-0346fbf2-cb72-44d4-8e96-c0fba4cab59d'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:02.868815 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0346fbf2-cb72-44d4-8e96-c0fba4cab59d admin admin] The token cache is being invalidate because project b105326e4c3342fcb295c6d469e4bcdb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:06:02.869040 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0346fbf2-cb72-44d4-8e96-c0fba4cab59d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:02.869688 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0346fbf2-cb72-44d4-8e96-c0fba4cab59d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:02.871197 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1430/2878] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 15:06:02 2022] DELETE /identity/v3/projects/b105326e4c3342fcb295c6d469e4bcdb => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:06:02.875800 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa12ac51-b109-4363-993d-4a5040f4805e service neutron] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:02.887782 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa12ac51-b109-4363-993d-4a5040f4805e service neutron] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:02.954902 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8210b36-616d-4fb3-adb3-9cba14a313b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:02.955989 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8210b36-616d-4fb3-adb3-9cba14a313b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:02.955989 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8210b36-616d-4fb3-adb3-9cba14a313b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:02.956325 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8210b36-616d-4fb3-adb3-9cba14a313b7 admin admin] PATH_INFO: `/v3/users/dced799f03004074ac4125f0c3d648ba` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:02.957534 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8210b36-616d-4fb3-adb3-9cba14a313b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dced799f03004074ac4125f0c3d648ba)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:02.959569 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8210b36-616d-4fb3-adb3-9cba14a313b7 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:03.022743 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-a8210b36-616d-4fb3-adb3-9cba14a313b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dced799f03004074ac4125f0c3d648ba'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:03.032616 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-a8210b36-616d-4fb3-adb3-9cba14a313b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dced799f03004074ac4125f0c3d648ba'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:03.033295 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-a8210b36-616d-4fb3-adb3-9cba14a313b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dced799f03004074ac4125f0c3d648ba'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:03.034942 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-a8210b36-616d-4fb3-adb3-9cba14a313b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dced799f03004074ac4125f0c3d648ba'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:03.056584 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-a8210b36-616d-4fb3-adb3-9cba14a313b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dced799f03004074ac4125f0c3d648ba'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:03.082129 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1449/2879] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 15:06:02 2022] DELETE /identity/v3/users/dced799f03004074ac4125f0c3d648ba => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:06:03.398597 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0346fbf2-cb72-44d4-8e96-c0fba4cab59d admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:03.400251 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-0346fbf2-cb72-44d4-8e96-c0fba4cab59d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:06:03.418857 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0346fbf2-cb72-44d4-8e96-c0fba4cab59d admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:03.495665 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186cbfbe-e44f-407d-a94f-58258440f096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:03.496319 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186cbfbe-e44f-407d-a94f-58258440f096 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:03.496592 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186cbfbe-e44f-407d-a94f-58258440f096 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:03.496860 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186cbfbe-e44f-407d-a94f-58258440f096 admin admin] PATH_INFO: `/v3/projects/8ff7e92130234a65867c8e23a28bddce` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:03.498032 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186cbfbe-e44f-407d-a94f-58258440f096 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ff7e92130234a65867c8e23a28bddce)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:03.499962 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186cbfbe-e44f-407d-a94f-58258440f096 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:03.565767 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-186cbfbe-e44f-407d-a94f-58258440f096 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ff7e92130234a65867c8e23a28bddce', 'request_id': 'req-186cbfbe-e44f-407d-a94f-58258440f096'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:03.572858 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-186cbfbe-e44f-407d-a94f-58258440f096 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ff7e92130234a65867c8e23a28bddce', 'request_id': 'req-186cbfbe-e44f-407d-a94f-58258440f096'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:03.582773 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-186cbfbe-e44f-407d-a94f-58258440f096 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ff7e92130234a65867c8e23a28bddce', 'request_id': 'req-186cbfbe-e44f-407d-a94f-58258440f096'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:03.592732 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:06:03.597026 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-186cbfbe-e44f-407d-a94f-58258440f096 admin admin] The token cache is being invalidate because project 8ff7e92130234a65867c8e23a28bddce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:06:03.597311 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-186cbfbe-e44f-407d-a94f-58258440f096 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:03.597982 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-186cbfbe-e44f-407d-a94f-58258440f096 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:03.599827 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1431/2880] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 15:06:03 2022] DELETE /identity/v3/projects/8ff7e92130234a65867c8e23a28bddce => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:06:03.606605 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b8383d-f307-4944-a2dd-8c8e3e5355e3 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:03.607329 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b8383d-f307-4944-a2dd-8c8e3e5355e3 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:03.607559 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b8383d-f307-4944-a2dd-8c8e3e5355e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:03.632791 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-01b8383d-f307-4944-a2dd-8c8e3e5355e3 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:06:03.634115 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-01b8383d-f307-4944-a2dd-8c8e3e5355e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:06:03.662602 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:06:03.709901 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1450/2881] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:06:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:06:03.718767 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c92349-b238-4a00-85c4-570d5224fe7d None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:03.719115 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c92349-b238-4a00-85c4-570d5224fe7d None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:03.719460 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c92349-b238-4a00-85c4-570d5224fe7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:03.742615 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-f1c92349-b238-4a00-85c4-570d5224fe7d None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:06:03.743798 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f1c92349-b238-4a00-85c4-570d5224fe7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:06:03.755482 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1432/2882] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:06:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:06:03.760776 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b8383d-f307-4944-a2dd-8c8e3e5355e3 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:03.771556 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b8383d-f307-4944-a2dd-8c8e3e5355e3 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:03.777073 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea838a4-a7b5-4ad7-8199-ca417976d067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:03.777696 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea838a4-a7b5-4ad7-8199-ca417976d067 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:03.777973 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea838a4-a7b5-4ad7-8199-ca417976d067 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:03.778244 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea838a4-a7b5-4ad7-8199-ca417976d067 admin admin] PATH_INFO: `/v3/domains` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:03.778898 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea838a4-a7b5-4ad7-8199-ca417976d067 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81471) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:06:03.779269 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea838a4-a7b5-4ad7-8199-ca417976d067 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:03.780886 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea838a4-a7b5-4ad7-8199-ca417976d067 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:03.794306 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1451/2883] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 19 15:06:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:06:03.799134 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c92349-b238-4a00-85c4-570d5224fe7d None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:03.809832 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c92349-b238-4a00-85c4-570d5224fe7d None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:03.815289 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da491e1b-65df-45c8-82ca-4e8de128449d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:03.815903 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da491e1b-65df-45c8-82ca-4e8de128449d admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:03.816175 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da491e1b-65df-45c8-82ca-4e8de128449d admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:03.816438 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da491e1b-65df-45c8-82ca-4e8de128449d admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:03.817117 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da491e1b-65df-45c8-82ca-4e8de128449d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:03.819080 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da491e1b-65df-45c8-82ca-4e8de128449d admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:03.857271 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1433/2884] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 15:06:03 2022] POST /identity/v3/projects => generated 377 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:06:03.859429 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea838a4-a7b5-4ad7-8199-ca417976d067 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:03.891478 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea838a4-a7b5-4ad7-8199-ca417976d067 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:03.965331 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba3ed69-709d-420e-9dd0-49bdfdd48734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:03.965988 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba3ed69-709d-420e-9dd0-49bdfdd48734 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:03.967052 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba3ed69-709d-420e-9dd0-49bdfdd48734 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:03.967338 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba3ed69-709d-420e-9dd0-49bdfdd48734 admin admin] PATH_INFO: `/v3/users` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:03.967995 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba3ed69-709d-420e-9dd0-49bdfdd48734 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:03.970058 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba3ed69-709d-420e-9dd0-49bdfdd48734 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:04.003625 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1452/2885] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 15:06:03 2022] POST /identity/v3/users => generated 289 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:06:04.009102 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da491e1b-65df-45c8-82ca-4e8de128449d admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:04.020122 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da491e1b-65df-45c8-82ca-4e8de128449d admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:04.025888 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c182ac64-8d11-4cc8-9d91-2d66adb09b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:04.026577 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182ac64-8d11-4cc8-9d91-2d66adb09b40 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:04.026838 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182ac64-8d11-4cc8-9d91-2d66adb09b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:04.027116 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182ac64-8d11-4cc8-9d91-2d66adb09b40 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:04.027770 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c182ac64-8d11-4cc8-9d91-2d66adb09b40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:04.029453 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c182ac64-8d11-4cc8-9d91-2d66adb09b40 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:04.042060 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1434/2886] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 15:06:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:06:04.046624 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba3ed69-709d-420e-9dd0-49bdfdd48734 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:04.058441 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba3ed69-709d-420e-9dd0-49bdfdd48734 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:04.065669 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae332e0-48dc-40f5-bdc0-7bb85c2e7ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:04.066313 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae332e0-48dc-40f5-bdc0-7bb85c2e7ab3 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:04.066593 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae332e0-48dc-40f5-bdc0-7bb85c2e7ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:04.066968 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae332e0-48dc-40f5-bdc0-7bb85c2e7ab3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:04.067905 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae332e0-48dc-40f5-bdc0-7bb85c2e7ab3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:04.069612 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae332e0-48dc-40f5-bdc0-7bb85c2e7ab3 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:04.086855 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1453/2887] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 15:06:04 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:06:04.091584 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c182ac64-8d11-4cc8-9d91-2d66adb09b40 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:04.102728 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c182ac64-8d11-4cc8-9d91-2d66adb09b40 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:04.107792 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b759b277-6162-4d15-b2a4-e2ccad2c037a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:04.108474 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b759b277-6162-4d15-b2a4-e2ccad2c037a admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:04.108728 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b759b277-6162-4d15-b2a4-e2ccad2c037a admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:04.109064 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b759b277-6162-4d15-b2a4-e2ccad2c037a admin admin] PATH_INFO: `/v3/projects/ce45de7e41b14999b17effe74f2ce607/users/d897c45d0dbc4de79e292a53166301af/roles/74de6794e3b3422b93d26f993d260c35` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:04.128776 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b759b277-6162-4d15-b2a4-e2ccad2c037a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce45de7e41b14999b17effe74f2ce607, user_id=d897c45d0dbc4de79e292a53166301af, role_id=74de6794e3b3422b93d26f993d260c35)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:04.131505 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b759b277-6162-4d15-b2a4-e2ccad2c037a admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:04.152955 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1435/2888] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 15:06:04 2022] PUT /identity/v3/projects/ce45de7e41b14999b17effe74f2ce607/users/d897c45d0dbc4de79e292a53166301af/roles/74de6794e3b3422b93d26f993d260c35 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:06:04.166334 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd91cd9-8cb2-4bc9-bff0-fe0609628735 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:04.166966 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd91cd9-8cb2-4bc9-bff0-fe0609628735 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:04.167456 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd91cd9-8cb2-4bc9-bff0-fe0609628735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:04.206499 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-ffd91cd9-8cb2-4bc9-bff0-fe0609628735 None None] MFA Rules not processed for user `d897c45d0dbc4de79e292a53166301af`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:06:04.207937 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-ffd91cd9-8cb2-4bc9-bff0-fe0609628735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:06:04.284011 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1454/2889] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:06:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:06:04.296176 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b759b277-6162-4d15-b2a4-e2ccad2c037a admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:04.298163 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b759b277-6162-4d15-b2a4-e2ccad2c037a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:06:04.374900 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b759b277-6162-4d15-b2a4-e2ccad2c037a admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:04.379250 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df38a774-cd8e-4e76-b20b-e7be6a7d525f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5d4e9c3da83402dbe7938aaf2dcbb8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:04.379980 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df38a774-cd8e-4e76-b20b-e7be6a7d525f service glance] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:04.380324 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df38a774-cd8e-4e76-b20b-e7be6a7d525f service glance] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:04.380672 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df38a774-cd8e-4e76-b20b-e7be6a7d525f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:04.391938 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df38a774-cd8e-4e76-b20b-e7be6a7d525f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:04.393442 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df38a774-cd8e-4e76-b20b-e7be6a7d525f service glance] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:04.404188 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1436/2890] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:06:04 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:06:09.684560 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d44346-447d-490d-a05f-ebf1818ba9ef None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:09.685144 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d44346-447d-490d-a05f-ebf1818ba9ef None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:09.685144 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d44346-447d-490d-a05f-ebf1818ba9ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:09.716264 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-97d44346-447d-490d-a05f-ebf1818ba9ef None None] MFA Rules not processed for user `0a75c02eaed1429e875df112c175671c`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:06:09.717572 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-97d44346-447d-490d-a05f-ebf1818ba9ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:06:09.740118 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:06:09.781869 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1455/2891] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:06:09 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:06:10.055712 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df38a774-cd8e-4e76-b20b-e7be6a7d525f service glance] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:10.058296 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-df38a774-cd8e-4e76-b20b-e7be6a7d525f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:06:10.140204 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df38a774-cd8e-4e76-b20b-e7be6a7d525f service glance] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:10.144136 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669fe46e-8858-4ecb-a0fc-4da5c7b40128 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:10.144756 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669fe46e-8858-4ecb-a0fc-4da5c7b40128 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:10.145109 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669fe46e-8858-4ecb-a0fc-4da5c7b40128 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:10.145381 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669fe46e-8858-4ecb-a0fc-4da5c7b40128 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:10.147291 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-669fe46e-8858-4ecb-a0fc-4da5c7b40128 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:06:10.158320 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669fe46e-8858-4ecb-a0fc-4da5c7b40128 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:10.160098 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669fe46e-8858-4ecb-a0fc-4da5c7b40128 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:10.171791 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1437/2892] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:06:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:06:10.557359 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d44346-447d-490d-a05f-ebf1818ba9ef None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:10.558928 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-97d44346-447d-490d-a05f-ebf1818ba9ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:06:10.638884 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d44346-447d-490d-a05f-ebf1818ba9ef None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:10.644286 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261d4703-3cfa-4539-acea-f77e1615a6a7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da0a58c526f34afda909e4ede2b1e1c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:10.644896 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d4703-3cfa-4539-acea-f77e1615a6a7 service placement] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:10.645228 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d4703-3cfa-4539-acea-f77e1615a6a7 service placement] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:10.645501 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d4703-3cfa-4539-acea-f77e1615a6a7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:10.647255 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-261d4703-3cfa-4539-acea-f77e1615a6a7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:06:10.659999 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261d4703-3cfa-4539-acea-f77e1615a6a7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:10.661620 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261d4703-3cfa-4539-acea-f77e1615a6a7 service placement] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:10.672786 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1456/2893] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:06:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:06:12.672849 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669fe46e-8858-4ecb-a0fc-4da5c7b40128 service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:12.682332 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669fe46e-8858-4ecb-a0fc-4da5c7b40128 service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:12.686631 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac91ce-2277-4d6d-8d6a-7c989acac1be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:12.687244 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac91ce-2277-4d6d-8d6a-7c989acac1be service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:12.687521 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac91ce-2277-4d6d-8d6a-7c989acac1be service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:12.687786 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac91ce-2277-4d6d-8d6a-7c989acac1be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:12.689953 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-02ac91ce-2277-4d6d-8d6a-7c989acac1be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:06:12.706220 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ac91ce-2277-4d6d-8d6a-7c989acac1be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:12.708068 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ac91ce-2277-4d6d-8d6a-7c989acac1be service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:12.717906 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1438/2894] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:06:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:06:20.136308 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261d4703-3cfa-4539-acea-f77e1615a6a7 service placement] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:20.137939 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-261d4703-3cfa-4539-acea-f77e1615a6a7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:06:20.217952 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261d4703-3cfa-4539-acea-f77e1615a6a7 service placement] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:20.223915 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94461f52-329b-4973-9819-0e41dd57f46d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3017e5d92bef4cc2aeae4f28c78ba233', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:20.224569 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94461f52-329b-4973-9819-0e41dd57f46d service nova] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:20.224847 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94461f52-329b-4973-9819-0e41dd57f46d service nova] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:20.225158 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94461f52-329b-4973-9819-0e41dd57f46d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:20.226957 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-94461f52-329b-4973-9819-0e41dd57f46d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:06:20.239941 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94461f52-329b-4973-9819-0e41dd57f46d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:20.241588 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94461f52-329b-4973-9819-0e41dd57f46d service nova] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:20.253398 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1457/2895] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:06:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:06:22.311424 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac91ce-2277-4d6d-8d6a-7c989acac1be service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:22.345422 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:06:22.389558 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac91ce-2277-4d6d-8d6a-7c989acac1be service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:22.394989 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad1a224-7878-4ff4-9ec6-b03733634b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:22.395621 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad1a224-7878-4ff4-9ec6-b03733634b78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:22.395901 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad1a224-7878-4ff4-9ec6-b03733634b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:22.396174 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad1a224-7878-4ff4-9ec6-b03733634b78 admin admin] PATH_INFO: `/v3/users/d897c45d0dbc4de79e292a53166301af` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:22.397403 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad1a224-7878-4ff4-9ec6-b03733634b78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d897c45d0dbc4de79e292a53166301af)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:22.399358 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad1a224-7878-4ff4-9ec6-b03733634b78 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:22.461348 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-aad1a224-7878-4ff4-9ec6-b03733634b78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd897c45d0dbc4de79e292a53166301af'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:22.470230 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-aad1a224-7878-4ff4-9ec6-b03733634b78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd897c45d0dbc4de79e292a53166301af'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:22.471174 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-aad1a224-7878-4ff4-9ec6-b03733634b78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd897c45d0dbc4de79e292a53166301af'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:22.471784 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-aad1a224-7878-4ff4-9ec6-b03733634b78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd897c45d0dbc4de79e292a53166301af'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:22.480665 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-aad1a224-7878-4ff4-9ec6-b03733634b78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd897c45d0dbc4de79e292a53166301af'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:22.513860 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1439/2896] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 15:06:22 2022] DELETE /identity/v3/users/d897c45d0dbc4de79e292a53166301af => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:06:22.519447 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b59265d-3bd9-4e19-bf84-1ba8576d25fe None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:22.519957 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b59265d-3bd9-4e19-bf84-1ba8576d25fe None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:22.520888 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b59265d-3bd9-4e19-bf84-1ba8576d25fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:22.544436 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-0b59265d-3bd9-4e19-bf84-1ba8576d25fe None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:06:22.546003 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-0b59265d-3bd9-4e19-bf84-1ba8576d25fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:06:22.602423 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=100 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:06:22.627869 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1458/2897] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:06:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:06:22.640228 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad1a224-7878-4ff4-9ec6-b03733634b78 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:22.641955 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-aad1a224-7878-4ff4-9ec6-b03733634b78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:06:22.709581 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad1a224-7878-4ff4-9ec6-b03733634b78 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:22.713458 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e6fe6c-b3a1-440a-bc89-24c6fa693093 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:22.714100 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e6fe6c-b3a1-440a-bc89-24c6fa693093 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:22.714385 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e6fe6c-b3a1-440a-bc89-24c6fa693093 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:22.714627 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e6fe6c-b3a1-440a-bc89-24c6fa693093 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:22.725977 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e6fe6c-b3a1-440a-bc89-24c6fa693093 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:22.727440 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e6fe6c-b3a1-440a-bc89-24c6fa693093 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:22.737713 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1440/2898] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:06:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:06:23.042255 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b59265d-3bd9-4e19-bf84-1ba8576d25fe None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:23.044049 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-0b59265d-3bd9-4e19-bf84-1ba8576d25fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:06:23.058902 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b59265d-3bd9-4e19-bf84-1ba8576d25fe None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:23.063835 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82c7552-222c-401e-b15d-e9971880c173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:23.064475 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82c7552-222c-401e-b15d-e9971880c173 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:23.064759 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82c7552-222c-401e-b15d-e9971880c173 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:23.065057 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82c7552-222c-401e-b15d-e9971880c173 admin admin] PATH_INFO: `/v3/projects/ce45de7e41b14999b17effe74f2ce607` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:23.066210 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82c7552-222c-401e-b15d-e9971880c173 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce45de7e41b14999b17effe74f2ce607)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:23.068247 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82c7552-222c-401e-b15d-e9971880c173 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:23.121032 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-a82c7552-222c-401e-b15d-e9971880c173 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce45de7e41b14999b17effe74f2ce607', 'request_id': 'req-a82c7552-222c-401e-b15d-e9971880c173'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:23.127994 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-a82c7552-222c-401e-b15d-e9971880c173 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce45de7e41b14999b17effe74f2ce607', 'request_id': 'req-a82c7552-222c-401e-b15d-e9971880c173'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:23.136696 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-a82c7552-222c-401e-b15d-e9971880c173 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce45de7e41b14999b17effe74f2ce607', 'request_id': 'req-a82c7552-222c-401e-b15d-e9971880c173'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:23.150362 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-a82c7552-222c-401e-b15d-e9971880c173 admin admin] The token cache is being invalidate because project ce45de7e41b14999b17effe74f2ce607 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81471) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:06:23.150675 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-a82c7552-222c-401e-b15d-e9971880c173 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:23.151567 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-a82c7552-222c-401e-b15d-e9971880c173 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:23.153260 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1459/2899] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 15:06:23 2022] DELETE /identity/v3/projects/ce45de7e41b14999b17effe74f2ce607 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:06:23.158470 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1027470-be45-4a5d-8126-d26f2a278773 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:23.158757 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1027470-be45-4a5d-8126-d26f2a278773 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:23.159039 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1027470-be45-4a5d-8126-d26f2a278773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:23.181827 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-d1027470-be45-4a5d-8126-d26f2a278773 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:06:23.183064 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d1027470-be45-4a5d-8126-d26f2a278773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:06:23.235999 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:06:23.256869 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1441/2900] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:06:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:06:23.265920 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b31fd38-5837-4b4c-b48c-7b1d6d0ba15c None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:23.266321 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b31fd38-5837-4b4c-b48c-7b1d6d0ba15c None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:23.266698 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b31fd38-5837-4b4c-b48c-7b1d6d0ba15c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:23.287795 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-9b31fd38-5837-4b4c-b48c-7b1d6d0ba15c None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:06:23.289056 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-9b31fd38-5837-4b4c-b48c-7b1d6d0ba15c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:06:23.298195 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1460/2901] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:06:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:06:23.302640 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1027470-be45-4a5d-8126-d26f2a278773 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:23.312911 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1027470-be45-4a5d-8126-d26f2a278773 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:23.317813 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b79bc5-7ed7-444e-9751-3bbbff40ff5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:23.318413 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b79bc5-7ed7-444e-9751-3bbbff40ff5f admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:23.318689 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b79bc5-7ed7-444e-9751-3bbbff40ff5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:23.318962 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b79bc5-7ed7-444e-9751-3bbbff40ff5f admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:23.319604 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b79bc5-7ed7-444e-9751-3bbbff40ff5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 15:06:23.319899 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b79bc5-7ed7-444e-9751-3bbbff40ff5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:23.321531 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b79bc5-7ed7-444e-9751-3bbbff40ff5f admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:23.338769 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1442/2902] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Sep 19 15:06:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 15:06:23.343116 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b31fd38-5837-4b4c-b48c-7b1d6d0ba15c None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:23.353051 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b31fd38-5837-4b4c-b48c-7b1d6d0ba15c None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:23.358823 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6304b2eb-b492-435b-87a1-ad6c3602e513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:23.359426 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6304b2eb-b492-435b-87a1-ad6c3602e513 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:23.359703 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6304b2eb-b492-435b-87a1-ad6c3602e513 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:23.359967 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6304b2eb-b492-435b-87a1-ad6c3602e513 admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:23.360593 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6304b2eb-b492-435b-87a1-ad6c3602e513 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:23.362531 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6304b2eb-b492-435b-87a1-ad6c3602e513 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:23.392192 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1461/2903] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 15:06:23 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:06:23.396546 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b79bc5-7ed7-444e-9751-3bbbff40ff5f admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:23.407386 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b79bc5-7ed7-444e-9751-3bbbff40ff5f admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:23.469452 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f3c5d0-18c7-4ce7-9a87-28b0267fa134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:23.470066 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f3c5d0-18c7-4ce7-9a87-28b0267fa134 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:23.470340 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f3c5d0-18c7-4ce7-9a87-28b0267fa134 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:23.470605 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f3c5d0-18c7-4ce7-9a87-28b0267fa134 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:23.471225 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f3c5d0-18c7-4ce7-9a87-28b0267fa134 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:23.473187 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f3c5d0-18c7-4ce7-9a87-28b0267fa134 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:23.494810 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1443/2904] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 15:06:23 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:06:23.500934 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6304b2eb-b492-435b-87a1-ad6c3602e513 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:23.515148 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6304b2eb-b492-435b-87a1-ad6c3602e513 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:23.520186 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573ef293-da48-41a1-8f1f-511b05a06358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:23.520797 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ef293-da48-41a1-8f1f-511b05a06358 admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:23.521093 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ef293-da48-41a1-8f1f-511b05a06358 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:23.521364 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ef293-da48-41a1-8f1f-511b05a06358 admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:23.522045 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573ef293-da48-41a1-8f1f-511b05a06358 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:23.524102 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573ef293-da48-41a1-8f1f-511b05a06358 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:23.535394 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1462/2905] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 15:06:23 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 15:06:23.541471 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f3c5d0-18c7-4ce7-9a87-28b0267fa134 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:23.552307 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f3c5d0-18c7-4ce7-9a87-28b0267fa134 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:23.556839 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3920578e-c026-43fe-aa01-85b9206a17f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:23.557451 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3920578e-c026-43fe-aa01-85b9206a17f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:23.557729 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3920578e-c026-43fe-aa01-85b9206a17f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:23.557998 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3920578e-c026-43fe-aa01-85b9206a17f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:23.559016 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3920578e-c026-43fe-aa01-85b9206a17f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:23.561425 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3920578e-c026-43fe-aa01-85b9206a17f3 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:23.574778 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1444/2906] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 15:06:23 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:06:23.580189 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573ef293-da48-41a1-8f1f-511b05a06358 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:23.598288 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573ef293-da48-41a1-8f1f-511b05a06358 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:23.605454 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0ea61f-3f52-47ef-88f5-57729155e93f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:23.606113 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0ea61f-3f52-47ef-88f5-57729155e93f admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:23.606388 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0ea61f-3f52-47ef-88f5-57729155e93f admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:23.606663 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0ea61f-3f52-47ef-88f5-57729155e93f admin admin] PATH_INFO: `/v3/projects/3566f2109f6c40c29d84acddad0a3a91/users/30debc96af8341dab4706bfb4bddf3c5/roles/74de6794e3b3422b93d26f993d260c35` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:23.624550 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0ea61f-3f52-47ef-88f5-57729155e93f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3566f2109f6c40c29d84acddad0a3a91, user_id=30debc96af8341dab4706bfb4bddf3c5, role_id=74de6794e3b3422b93d26f993d260c35)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:23.628026 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0ea61f-3f52-47ef-88f5-57729155e93f admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:23.649493 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1463/2907] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 15:06:23 2022] PUT /identity/v3/projects/3566f2109f6c40c29d84acddad0a3a91/users/30debc96af8341dab4706bfb4bddf3c5/roles/74de6794e3b3422b93d26f993d260c35 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:06:23.663522 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979f35ba-736f-499f-b852-787959414711 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:23.663838 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979f35ba-736f-499f-b852-787959414711 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:23.664058 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979f35ba-736f-499f-b852-787959414711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:23.706160 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-979f35ba-736f-499f-b852-787959414711 None None] MFA Rules not processed for user `30debc96af8341dab4706bfb4bddf3c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:06:23.708386 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-979f35ba-736f-499f-b852-787959414711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:06:23.789894 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1445/2908] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:06:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:06:23.794646 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0ea61f-3f52-47ef-88f5-57729155e93f admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:23.865587 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0ea61f-3f52-47ef-88f5-57729155e93f admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:23.874333 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd983aaf-5bc5-4c14-9346-6191daa09316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:23.874333 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd983aaf-5bc5-4c14-9346-6191daa09316 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:23.874333 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd983aaf-5bc5-4c14-9346-6191daa09316 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:23.874333 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd983aaf-5bc5-4c14-9346-6191daa09316 admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:23.875959 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd983aaf-5bc5-4c14-9346-6191daa09316 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:23.876921 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd983aaf-5bc5-4c14-9346-6191daa09316 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:23.888529 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:06:23.911933 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1464/2909] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 15:06:23 2022] POST /identity/v3/projects => generated 385 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:06:23.918022 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979f35ba-736f-499f-b852-787959414711 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:23.932564 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979f35ba-736f-499f-b852-787959414711 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:23.992745 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:06:24.009239 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36821108-f7fa-459e-974f-fbe4ac19495a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:24.009778 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36821108-f7fa-459e-974f-fbe4ac19495a admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:24.010055 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36821108-f7fa-459e-974f-fbe4ac19495a admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:24.010323 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36821108-f7fa-459e-974f-fbe4ac19495a admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:24.011602 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36821108-f7fa-459e-974f-fbe4ac19495a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:24.013558 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36821108-f7fa-459e-974f-fbe4ac19495a admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:24.037049 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1446/2910] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 15:06:23 2022] POST /identity/v3/users => generated 293 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 15:06:24.041418 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd983aaf-5bc5-4c14-9346-6191daa09316 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:24.052676 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd983aaf-5bc5-4c14-9346-6191daa09316 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:24.059028 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15275eb5-3bbc-4cf3-ae2a-6d403ec52f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:24.059643 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15275eb5-3bbc-4cf3-ae2a-6d403ec52f6e admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:24.059921 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15275eb5-3bbc-4cf3-ae2a-6d403ec52f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:24.060217 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15275eb5-3bbc-4cf3-ae2a-6d403ec52f6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:24.060842 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15275eb5-3bbc-4cf3-ae2a-6d403ec52f6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:24.062509 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15275eb5-3bbc-4cf3-ae2a-6d403ec52f6e admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:24.081044 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1465/2911] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 15:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:06:24.082790 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36821108-f7fa-459e-974f-fbe4ac19495a admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:24.094632 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36821108-f7fa-459e-974f-fbe4ac19495a admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:24.099615 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f479c9cf-40a0-467b-a5ff-748d22db6539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:24.100270 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f479c9cf-40a0-467b-a5ff-748d22db6539 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:24.100618 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f479c9cf-40a0-467b-a5ff-748d22db6539 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:24.100920 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f479c9cf-40a0-467b-a5ff-748d22db6539 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:24.102206 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f479c9cf-40a0-467b-a5ff-748d22db6539 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:24.106149 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f479c9cf-40a0-467b-a5ff-748d22db6539 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:24.114783 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1447/2912] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 15:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:06:24.119169 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15275eb5-3bbc-4cf3-ae2a-6d403ec52f6e admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:24.129944 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15275eb5-3bbc-4cf3-ae2a-6d403ec52f6e admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:24.135403 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1313b19c-9d3e-4c85-a472-88cff397b95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:24.136581 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1313b19c-9d3e-4c85-a472-88cff397b95f admin admin] REQUEST_METHOD: `PUT` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:24.136808 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1313b19c-9d3e-4c85-a472-88cff397b95f admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:24.137089 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1313b19c-9d3e-4c85-a472-88cff397b95f admin admin] PATH_INFO: `/v3/projects/5b2392a37b194b99b52707b1a11a7e56/users/f80636a511a9473baa38464ef3c1fc92/roles/74de6794e3b3422b93d26f993d260c35` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:24.156894 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1313b19c-9d3e-4c85-a472-88cff397b95f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b2392a37b194b99b52707b1a11a7e56, user_id=f80636a511a9473baa38464ef3c1fc92, role_id=74de6794e3b3422b93d26f993d260c35)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:24.162840 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1313b19c-9d3e-4c85-a472-88cff397b95f admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:24.180791 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1466/2913] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 15:06:24 2022] PUT /identity/v3/projects/5b2392a37b194b99b52707b1a11a7e56/users/f80636a511a9473baa38464ef3c1fc92/roles/74de6794e3b3422b93d26f993d260c35 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:06:24.192665 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7427dbe8-141d-4d29-964b-2de69c982e30 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:24.193184 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7427dbe8-141d-4d29-964b-2de69c982e30 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:24.193692 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7427dbe8-141d-4d29-964b-2de69c982e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:24.236317 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-7427dbe8-141d-4d29-964b-2de69c982e30 None None] MFA Rules not processed for user `f80636a511a9473baa38464ef3c1fc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:06:24.237918 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-7427dbe8-141d-4d29-964b-2de69c982e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:06:24.317149 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1448/2914] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:06:24 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:06:24.322422 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1313b19c-9d3e-4c85-a472-88cff397b95f admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:24.391077 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1313b19c-9d3e-4c85-a472-88cff397b95f admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:24.396747 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793ba255-d116-4e53-b971-1e34d0bd5298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:24.397520 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ba255-d116-4e53-b971-1e34d0bd5298 admin admin] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:24.397775 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ba255-d116-4e53-b971-1e34d0bd5298 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:24.398045 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ba255-d116-4e53-b971-1e34d0bd5298 admin admin] PATH_INFO: `/v3/projects` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:24.398706 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793ba255-d116-4e53-b971-1e34d0bd5298 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:24.400653 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793ba255-d116-4e53-b971-1e34d0bd5298 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:24.434898 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1467/2915] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Sep 19 15:06:24 2022] POST /identity/v3/projects => generated 385 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:06:24.439417 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7427dbe8-141d-4d29-964b-2de69c982e30 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:24.451970 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7427dbe8-141d-4d29-964b-2de69c982e30 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:24.513870 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a733fbcd-b8bb-4c74-9fda-23a1ecd200e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:24.514480 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a733fbcd-b8bb-4c74-9fda-23a1ecd200e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:24.514752 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a733fbcd-b8bb-4c74-9fda-23a1ecd200e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:24.515017 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a733fbcd-b8bb-4c74-9fda-23a1ecd200e3 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:24.515647 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a733fbcd-b8bb-4c74-9fda-23a1ecd200e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:24.517704 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a733fbcd-b8bb-4c74-9fda-23a1ecd200e3 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:24.543211 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1449/2916] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Sep 19 15:06:24 2022] POST /identity/v3/users => generated 299 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 15:06:24.547766 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793ba255-d116-4e53-b971-1e34d0bd5298 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:24.559297 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793ba255-d116-4e53-b971-1e34d0bd5298 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:24.564069 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd700681-6612-4dc5-aaeb-8b8a0ab5262d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:24.564673 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd700681-6612-4dc5-aaeb-8b8a0ab5262d admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:24.564944 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd700681-6612-4dc5-aaeb-8b8a0ab5262d admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:24.565243 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd700681-6612-4dc5-aaeb-8b8a0ab5262d admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:24.565889 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd700681-6612-4dc5-aaeb-8b8a0ab5262d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:24.567477 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd700681-6612-4dc5-aaeb-8b8a0ab5262d admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:24.580170 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1468/2917] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 15:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:06:24.585028 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a733fbcd-b8bb-4c74-9fda-23a1ecd200e3 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:24.597261 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a733fbcd-b8bb-4c74-9fda-23a1ecd200e3 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:24.602560 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcffcc02-6800-4a10-8362-24c96e47d216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:24.603224 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcffcc02-6800-4a10-8362-24c96e47d216 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:24.603501 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcffcc02-6800-4a10-8362-24c96e47d216 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:24.603771 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcffcc02-6800-4a10-8362-24c96e47d216 admin admin] PATH_INFO: `/v3/projects/1f8986b7d5d8459e918386b0b879b524/users/603220cbf7a2416c87a878efea428efa/roles/019bde1756cb40de8ce06cef6b261f79` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:24.621690 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcffcc02-6800-4a10-8362-24c96e47d216 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f8986b7d5d8459e918386b0b879b524, user_id=603220cbf7a2416c87a878efea428efa, role_id=019bde1756cb40de8ce06cef6b261f79)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:24.624416 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcffcc02-6800-4a10-8362-24c96e47d216 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:24.639809 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1450/2918] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 15:06:24 2022] PUT /identity/v3/projects/1f8986b7d5d8459e918386b0b879b524/users/603220cbf7a2416c87a878efea428efa/roles/019bde1756cb40de8ce06cef6b261f79 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:06:24.644332 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd700681-6612-4dc5-aaeb-8b8a0ab5262d admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:24.656120 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd700681-6612-4dc5-aaeb-8b8a0ab5262d admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:24.719551 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53bdbf5-acdd-4a7e-83f0-2fec293af94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:24.720091 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53bdbf5-acdd-4a7e-83f0-2fec293af94f admin admin] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:24.720380 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53bdbf5-acdd-4a7e-83f0-2fec293af94f admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:24.720650 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53bdbf5-acdd-4a7e-83f0-2fec293af94f admin admin] PATH_INFO: `/v3/roles` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:24.721385 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53bdbf5-acdd-4a7e-83f0-2fec293af94f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:24.723071 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53bdbf5-acdd-4a7e-83f0-2fec293af94f admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:24.735020 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1469/2919] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Sep 19 15:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 15:06:24.739702 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcffcc02-6800-4a10-8362-24c96e47d216 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:24.751657 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcffcc02-6800-4a10-8362-24c96e47d216 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:24.756457 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b01224-42f7-4abc-a7cd-0788acdc9f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:24.757154 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b01224-42f7-4abc-a7cd-0788acdc9f4f admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:24.757427 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b01224-42f7-4abc-a7cd-0788acdc9f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:24.757694 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b01224-42f7-4abc-a7cd-0788acdc9f4f admin admin] PATH_INFO: `/v3/projects/1f8986b7d5d8459e918386b0b879b524/users/603220cbf7a2416c87a878efea428efa/roles/019bde1756cb40de8ce06cef6b261f79` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:24.759588 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b01224-42f7-4abc-a7cd-0788acdc9f4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f8986b7d5d8459e918386b0b879b524, user_id=603220cbf7a2416c87a878efea428efa, role_id=019bde1756cb40de8ce06cef6b261f79)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:24.762302 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b01224-42f7-4abc-a7cd-0788acdc9f4f admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:24.773530 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1451/2920] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Sep 19 15:06:24 2022] PUT /identity/v3/projects/1f8986b7d5d8459e918386b0b879b524/users/603220cbf7a2416c87a878efea428efa/roles/019bde1756cb40de8ce06cef6b261f79 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:06:24.784458 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5705a3-81d6-422a-95d1-96af6242a16e None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:24.785026 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5705a3-81d6-422a-95d1-96af6242a16e None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:24.785194 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5705a3-81d6-422a-95d1-96af6242a16e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:24.815619 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-7a5705a3-81d6-422a-95d1-96af6242a16e None None] MFA Rules not processed for user `603220cbf7a2416c87a878efea428efa`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:06:24.816831 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-7a5705a3-81d6-422a-95d1-96af6242a16e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:06:24.830073 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:06:24.892581 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1470/2921] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:06:24 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:06:24.904528 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b01224-42f7-4abc-a7cd-0788acdc9f4f admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:24.906408 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d4b01224-42f7-4abc-a7cd-0788acdc9f4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:06:24.916931 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:06:24.971008 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b01224-42f7-4abc-a7cd-0788acdc9f4f admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:24.975288 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610a44de-7cf6-4dc0-9946-368e27dee1dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df648c909ddb41418128b43f925f5ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:24.975933 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a44de-7cf6-4dc0-9946-368e27dee1dc service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:24.976208 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a44de-7cf6-4dc0-9946-368e27dee1dc service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:24.976472 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a44de-7cf6-4dc0-9946-368e27dee1dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:25.055436 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610a44de-7cf6-4dc0-9946-368e27dee1dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:25.056921 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610a44de-7cf6-4dc0-9946-368e27dee1dc service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:25.067855 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1452/2922] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:06:24 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:06:25.377134 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228d060-80cc-4538-b46d-f01bceb267a6 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:25.377134 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228d060-80cc-4538-b46d-f01bceb267a6 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:25.377134 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228d060-80cc-4538-b46d-f01bceb267a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:25.398439 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-0228d060-80cc-4538-b46d-f01bceb267a6 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:06:25.399726 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-0228d060-80cc-4538-b46d-f01bceb267a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:06:25.472401 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1471/2923] 10.222.0.67 () {58 vars in 1016 bytes} [Mon Sep 19 15:06:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:06:25.487531 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610a44de-7cf6-4dc0-9946-368e27dee1dc service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:25.489324 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-610a44de-7cf6-4dc0-9946-368e27dee1dc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:06:25.567220 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610a44de-7cf6-4dc0-9946-368e27dee1dc service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:25.573729 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a60b83-9e99-41ef-9387-b4bb5f879c7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3017e5d92bef4cc2aeae4f28c78ba233', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:25.574356 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a60b83-9e99-41ef-9387-b4bb5f879c7d service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:25.574633 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a60b83-9e99-41ef-9387-b4bb5f879c7d service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:25.574930 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a60b83-9e99-41ef-9387-b4bb5f879c7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:25.584792 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a60b83-9e99-41ef-9387-b4bb5f879c7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:25.586443 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a60b83-9e99-41ef-9387-b4bb5f879c7d service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:25.597685 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1453/2924] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:06:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:06:26.680006 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0228d060-80cc-4538-b46d-f01bceb267a6 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:26.691639 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0228d060-80cc-4538-b46d-f01bceb267a6 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:26.696063 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76a800e-ac93-490f-9ae3-6630d7806ed6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df648c909ddb41418128b43f925f5ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:26.696710 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a800e-ac93-490f-9ae3-6630d7806ed6 service cinder] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:26.697027 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a800e-ac93-490f-9ae3-6630d7806ed6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:26.697291 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a800e-ac93-490f-9ae3-6630d7806ed6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:26.764962 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76a800e-ac93-490f-9ae3-6630d7806ed6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:26.766419 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76a800e-ac93-490f-9ae3-6630d7806ed6 service cinder] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:26.775887 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1472/2925] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:06:26 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:06:27.405292 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a60b83-9e99-41ef-9387-b4bb5f879c7d service nova] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:27.416222 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a60b83-9e99-41ef-9387-b4bb5f879c7d service nova] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:27.420375 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb0554b-4b8c-4661-820f-c655a6ebfac1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df648c909ddb41418128b43f925f5ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:27.420964 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb0554b-4b8c-4661-820f-c655a6ebfac1 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:27.421314 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb0554b-4b8c-4661-820f-c655a6ebfac1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:27.421607 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb0554b-4b8c-4661-820f-c655a6ebfac1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:27.432928 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb0554b-4b8c-4661-820f-c655a6ebfac1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:27.435237 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb0554b-4b8c-4661-820f-c655a6ebfac1 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:27.444609 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1454/2926] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:06:27 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:06:28.672717 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ea1678-dcf1-4efb-a4fb-c3681bae95a9 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:28.673236 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ea1678-dcf1-4efb-a4fb-c3681bae95a9 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:28.673351 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ea1678-dcf1-4efb-a4fb-c3681bae95a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:28.694709 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-67ea1678-dcf1-4efb-a4fb-c3681bae95a9 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:06:28.695963 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-67ea1678-dcf1-4efb-a4fb-c3681bae95a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:06:28.706986 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1473/2927] 10.222.0.67 () {58 vars in 1016 bytes} [Mon Sep 19 15:06:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 15:06:28.721445 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb0554b-4b8c-4661-820f-c655a6ebfac1 service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:28.723071 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-6eb0554b-4b8c-4661-820f-c655a6ebfac1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:06:28.739587 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb0554b-4b8c-4661-820f-c655a6ebfac1 service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:28.745786 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1c40a7-9c32-44b1-a4fe-76cd9a1e27a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3017e5d92bef4cc2aeae4f28c78ba233', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:28.746406 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c40a7-9c32-44b1-a4fe-76cd9a1e27a6 service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:28.746681 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c40a7-9c32-44b1-a4fe-76cd9a1e27a6 service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:28.746946 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c40a7-9c32-44b1-a4fe-76cd9a1e27a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:28.756070 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1c40a7-9c32-44b1-a4fe-76cd9a1e27a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:28.757771 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1c40a7-9c32-44b1-a4fe-76cd9a1e27a6 service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:28.768398 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1455/2928] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:06:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:06:31.446521 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ea1678-dcf1-4efb-a4fb-c3681bae95a9 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:31.458838 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ea1678-dcf1-4efb-a4fb-c3681bae95a9 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:31.464713 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8445ea2a-59cf-4c5e-914d-166b1d1c095d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:31.465408 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8445ea2a-59cf-4c5e-914d-166b1d1c095d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:31.465685 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8445ea2a-59cf-4c5e-914d-166b1d1c095d admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:31.465951 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8445ea2a-59cf-4c5e-914d-166b1d1c095d admin admin] PATH_INFO: `/v3/users/30debc96af8341dab4706bfb4bddf3c5` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:31.469206 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8445ea2a-59cf-4c5e-914d-166b1d1c095d admin admin] RBAC: Authorizing `identity:delete_user(user_id=30debc96af8341dab4706bfb4bddf3c5)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:31.469206 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8445ea2a-59cf-4c5e-914d-166b1d1c095d admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:31.520083 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:06:31.538324 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-8445ea2a-59cf-4c5e-914d-166b1d1c095d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30debc96af8341dab4706bfb4bddf3c5'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:31.547871 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-8445ea2a-59cf-4c5e-914d-166b1d1c095d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30debc96af8341dab4706bfb4bddf3c5'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:31.548878 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-8445ea2a-59cf-4c5e-914d-166b1d1c095d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30debc96af8341dab4706bfb4bddf3c5'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:31.549795 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-8445ea2a-59cf-4c5e-914d-166b1d1c095d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30debc96af8341dab4706bfb4bddf3c5'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:31.565796 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-8445ea2a-59cf-4c5e-914d-166b1d1c095d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30debc96af8341dab4706bfb4bddf3c5'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:31.585519 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1474/2929] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 15:06:31 2022] DELETE /identity/v3/users/30debc96af8341dab4706bfb4bddf3c5 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:06:31.590222 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac202ba-480d-4320-a1a1-8c242afe8a7e None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:31.590712 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac202ba-480d-4320-a1a1-8c242afe8a7e None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:31.590813 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac202ba-480d-4320-a1a1-8c242afe8a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:31.616693 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-9ac202ba-480d-4320-a1a1-8c242afe8a7e None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:06:31.618016 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-9ac202ba-480d-4320-a1a1-8c242afe8a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:06:31.632599 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:06:31.689612 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1456/2930] 10.222.0.26 () {58 vars in 958 bytes} [Mon Sep 19 15:06:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:06:31.706781 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8445ea2a-59cf-4c5e-914d-166b1d1c095d admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:31.708477 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-8445ea2a-59cf-4c5e-914d-166b1d1c095d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:06:31.783603 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bcc89d-5b3e-44a2-a4fc-9a2fdc10be4f None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:31.783927 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8445ea2a-59cf-4c5e-914d-166b1d1c095d admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:31.784080 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bcc89d-5b3e-44a2-a4fc-9a2fdc10be4f None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:31.784315 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bcc89d-5b3e-44a2-a4fc-9a2fdc10be4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:31.789832 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5de58b-e7c2-4cc6-938c-ad51877d75e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd20a0d24e7034b6db447ba842ac986dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:31.790786 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5de58b-e7c2-4cc6-938c-ad51877d75e5 service neutron] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:31.791246 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5de58b-e7c2-4cc6-938c-ad51877d75e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:31.791680 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5de58b-e7c2-4cc6-938c-ad51877d75e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:31.805003 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5de58b-e7c2-4cc6-938c-ad51877d75e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:31.806481 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5de58b-e7c2-4cc6-938c-ad51877d75e5 service neutron] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:31.810541 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-58bcc89d-5b3e-44a2-a4fc-9a2fdc10be4f None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:06:31.811799 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-58bcc89d-5b3e-44a2-a4fc-9a2fdc10be4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:06:31.818252 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1475/2931] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:06:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:06:31.821823 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1457/2932] 10.222.0.67 () {58 vars in 1016 bytes} [Mon Sep 19 15:06:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:06:31.837629 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5de58b-e7c2-4cc6-938c-ad51877d75e5 service neutron] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:31.839223 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-3d5de58b-e7c2-4cc6-938c-ad51877d75e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:06:31.943033 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5de58b-e7c2-4cc6-938c-ad51877d75e5 service neutron] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:31.949559 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5b85fd-8ef3-47ad-80b3-84ff153459f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3017e5d92bef4cc2aeae4f28c78ba233', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:31.950193 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b85fd-8ef3-47ad-80b3-84ff153459f2 service nova] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:31.950444 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b85fd-8ef3-47ad-80b3-84ff153459f2 service nova] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:31.950711 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b85fd-8ef3-47ad-80b3-84ff153459f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:31.960884 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5b85fd-8ef3-47ad-80b3-84ff153459f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:31.962607 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5b85fd-8ef3-47ad-80b3-84ff153459f2 service nova] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:31.974461 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1476/2933] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:06:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 15:06:32.171683 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bcc89d-5b3e-44a2-a4fc-9a2fdc10be4f None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:32.173309 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-58bcc89d-5b3e-44a2-a4fc-9a2fdc10be4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:06:32.188221 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bcc89d-5b3e-44a2-a4fc-9a2fdc10be4f None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:32.194017 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd25641a-0d5d-4bf0-944d-be5b9547a974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:32.194657 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd25641a-0d5d-4bf0-944d-be5b9547a974 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:32.194929 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd25641a-0d5d-4bf0-944d-be5b9547a974 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:32.195190 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd25641a-0d5d-4bf0-944d-be5b9547a974 admin admin] PATH_INFO: `/v3/projects/3566f2109f6c40c29d84acddad0a3a91` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:32.197269 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd25641a-0d5d-4bf0-944d-be5b9547a974 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3566f2109f6c40c29d84acddad0a3a91)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:32.199302 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd25641a-0d5d-4bf0-944d-be5b9547a974 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:32.248858 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-fd25641a-0d5d-4bf0-944d-be5b9547a974 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3566f2109f6c40c29d84acddad0a3a91', 'request_id': 'req-fd25641a-0d5d-4bf0-944d-be5b9547a974'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:32.255321 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-fd25641a-0d5d-4bf0-944d-be5b9547a974 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3566f2109f6c40c29d84acddad0a3a91', 'request_id': 'req-fd25641a-0d5d-4bf0-944d-be5b9547a974'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:32.262797 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-fd25641a-0d5d-4bf0-944d-be5b9547a974 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3566f2109f6c40c29d84acddad0a3a91', 'request_id': 'req-fd25641a-0d5d-4bf0-944d-be5b9547a974'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:32.274169 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-fd25641a-0d5d-4bf0-944d-be5b9547a974 admin admin] The token cache is being invalidate because project 3566f2109f6c40c29d84acddad0a3a91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:06:32.274452 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-fd25641a-0d5d-4bf0-944d-be5b9547a974 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:32.275167 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-fd25641a-0d5d-4bf0-944d-be5b9547a974 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:32.276972 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1458/2934] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 15:06:32 2022] DELETE /identity/v3/projects/3566f2109f6c40c29d84acddad0a3a91 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:06:32.281164 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5b85fd-8ef3-47ad-80b3-84ff153459f2 service nova] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:32.291069 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5b85fd-8ef3-47ad-80b3-84ff153459f2 service nova] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:32.333226 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:06:32.351431 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f4660c-e56a-44b7-bc97-2bd7430ea89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:32.352072 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4660c-e56a-44b7-bc97-2bd7430ea89b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:32.352343 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4660c-e56a-44b7-bc97-2bd7430ea89b admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:32.352608 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4660c-e56a-44b7-bc97-2bd7430ea89b admin admin] PATH_INFO: `/v3/users/f80636a511a9473baa38464ef3c1fc92` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:32.353765 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f4660c-e56a-44b7-bc97-2bd7430ea89b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f80636a511a9473baa38464ef3c1fc92)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:32.355834 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f4660c-e56a-44b7-bc97-2bd7430ea89b admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:32.412104 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-50f4660c-e56a-44b7-bc97-2bd7430ea89b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f80636a511a9473baa38464ef3c1fc92'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:32.421395 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-50f4660c-e56a-44b7-bc97-2bd7430ea89b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f80636a511a9473baa38464ef3c1fc92'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:32.422123 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-50f4660c-e56a-44b7-bc97-2bd7430ea89b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f80636a511a9473baa38464ef3c1fc92'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:32.422748 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-50f4660c-e56a-44b7-bc97-2bd7430ea89b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f80636a511a9473baa38464ef3c1fc92'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:32.436676 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-50f4660c-e56a-44b7-bc97-2bd7430ea89b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f80636a511a9473baa38464ef3c1fc92'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:32.450122 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1477/2935] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 15:06:32 2022] DELETE /identity/v3/users/f80636a511a9473baa38464ef3c1fc92 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:06:32.748858 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd25641a-0d5d-4bf0-944d-be5b9547a974 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:32.750793 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-fd25641a-0d5d-4bf0-944d-be5b9547a974 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:06:32.769378 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd25641a-0d5d-4bf0-944d-be5b9547a974 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:32.841656 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831e7b57-e45e-4d01-86fa-ca3a84cc92ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:32.842286 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831e7b57-e45e-4d01-86fa-ca3a84cc92ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:32.842559 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831e7b57-e45e-4d01-86fa-ca3a84cc92ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:32.842856 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831e7b57-e45e-4d01-86fa-ca3a84cc92ac admin admin] PATH_INFO: `/v3/projects/5b2392a37b194b99b52707b1a11a7e56` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:32.844016 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831e7b57-e45e-4d01-86fa-ca3a84cc92ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b2392a37b194b99b52707b1a11a7e56)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:32.846149 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831e7b57-e45e-4d01-86fa-ca3a84cc92ac admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:32.891126 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:06:32.910301 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-831e7b57-e45e-4d01-86fa-ca3a84cc92ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b2392a37b194b99b52707b1a11a7e56', 'request_id': 'req-831e7b57-e45e-4d01-86fa-ca3a84cc92ac'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:32.917353 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-831e7b57-e45e-4d01-86fa-ca3a84cc92ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b2392a37b194b99b52707b1a11a7e56', 'request_id': 'req-831e7b57-e45e-4d01-86fa-ca3a84cc92ac'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:32.927991 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-831e7b57-e45e-4d01-86fa-ca3a84cc92ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b2392a37b194b99b52707b1a11a7e56', 'request_id': 'req-831e7b57-e45e-4d01-86fa-ca3a84cc92ac'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:32.943269 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-831e7b57-e45e-4d01-86fa-ca3a84cc92ac admin admin] The token cache is being invalidate because project 5b2392a37b194b99b52707b1a11a7e56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:06:32.943573 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-831e7b57-e45e-4d01-86fa-ca3a84cc92ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:32.944218 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-831e7b57-e45e-4d01-86fa-ca3a84cc92ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:32.945813 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1459/2936] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 15:06:32 2022] DELETE /identity/v3/projects/5b2392a37b194b99b52707b1a11a7e56 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:06:32.949952 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f4660c-e56a-44b7-bc97-2bd7430ea89b admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:32.951515 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-50f4660c-e56a-44b7-bc97-2bd7430ea89b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:06:32.966923 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f4660c-e56a-44b7-bc97-2bd7430ea89b admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:33.042808 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fc0291-2f96-400f-abe2-e18c12fe25ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:33.043912 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fc0291-2f96-400f-abe2-e18c12fe25ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:33.044203 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fc0291-2f96-400f-abe2-e18c12fe25ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:33.044473 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fc0291-2f96-400f-abe2-e18c12fe25ec admin admin] PATH_INFO: `/v3/users/603220cbf7a2416c87a878efea428efa` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:33.046368 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fc0291-2f96-400f-abe2-e18c12fe25ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=603220cbf7a2416c87a878efea428efa)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:33.048060 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fc0291-2f96-400f-abe2-e18c12fe25ec admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:33.117495 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-c2fc0291-2f96-400f-abe2-e18c12fe25ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '603220cbf7a2416c87a878efea428efa'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:33.126994 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-c2fc0291-2f96-400f-abe2-e18c12fe25ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '603220cbf7a2416c87a878efea428efa'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:33.127619 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-c2fc0291-2f96-400f-abe2-e18c12fe25ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '603220cbf7a2416c87a878efea428efa'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:33.128219 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-c2fc0291-2f96-400f-abe2-e18c12fe25ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '603220cbf7a2416c87a878efea428efa'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:33.136157 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:06:33.144429 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-c2fc0291-2f96-400f-abe2-e18c12fe25ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '603220cbf7a2416c87a878efea428efa'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:33.158073 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1478/2937] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 15:06:32 2022] DELETE /identity/v3/users/603220cbf7a2416c87a878efea428efa => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 15:06:33.458240 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831e7b57-e45e-4d01-86fa-ca3a84cc92ac admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:33.460014 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-831e7b57-e45e-4d01-86fa-ca3a84cc92ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:06:33.476193 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831e7b57-e45e-4d01-86fa-ca3a84cc92ac admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:33.554301 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c76d659-6e53-49a4-8099-968f89928b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:33.554953 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c76d659-6e53-49a4-8099-968f89928b45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:33.555235 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c76d659-6e53-49a4-8099-968f89928b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:33.555509 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c76d659-6e53-49a4-8099-968f89928b45 admin admin] PATH_INFO: `/v3/projects/1f8986b7d5d8459e918386b0b879b524` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:33.556664 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c76d659-6e53-49a4-8099-968f89928b45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f8986b7d5d8459e918386b0b879b524)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:33.558763 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c76d659-6e53-49a4-8099-968f89928b45 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:33.616199 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-8c76d659-6e53-49a4-8099-968f89928b45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f8986b7d5d8459e918386b0b879b524', 'request_id': 'req-8c76d659-6e53-49a4-8099-968f89928b45'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:33.623967 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-8c76d659-6e53-49a4-8099-968f89928b45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f8986b7d5d8459e918386b0b879b524', 'request_id': 'req-8c76d659-6e53-49a4-8099-968f89928b45'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:33.633906 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-8c76d659-6e53-49a4-8099-968f89928b45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f8986b7d5d8459e918386b0b879b524', 'request_id': 'req-8c76d659-6e53-49a4-8099-968f89928b45'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:33.646729 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-8c76d659-6e53-49a4-8099-968f89928b45 admin admin] The token cache is being invalidate because project 1f8986b7d5d8459e918386b0b879b524 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:06:33.647019 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-8c76d659-6e53-49a4-8099-968f89928b45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:33.647680 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-8c76d659-6e53-49a4-8099-968f89928b45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:06:33.649283 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1460/2938] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 15:06:33 2022] DELETE /identity/v3/projects/1f8986b7d5d8459e918386b0b879b524 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:06:34.987130 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2519b1d-750d-4536-81a2-1cb32539ced0 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:34.987623 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2519b1d-750d-4536-81a2-1cb32539ced0 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:34.987803 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2519b1d-750d-4536-81a2-1cb32539ced0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:35.009705 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-d2519b1d-750d-4536-81a2-1cb32539ced0 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:06:35.011472 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-d2519b1d-750d-4536-81a2-1cb32539ced0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:06:35.079816 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1479/2939] 10.222.0.67 () {58 vars in 1016 bytes} [Mon Sep 19 15:06:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:06:35.124504 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c76d659-6e53-49a4-8099-968f89928b45 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:35.127866 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-8c76d659-6e53-49a4-8099-968f89928b45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:06:35.190989 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:06:35.220550 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c76d659-6e53-49a4-8099-968f89928b45 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:35.227577 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b2a956-fdff-4fac-af98-9ce1966fdac3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3017e5d92bef4cc2aeae4f28c78ba233', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:35.228178 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b2a956-fdff-4fac-af98-9ce1966fdac3 service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:35.228467 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b2a956-fdff-4fac-af98-9ce1966fdac3 service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:35.228734 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b2a956-fdff-4fac-af98-9ce1966fdac3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:35.238006 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b2a956-fdff-4fac-af98-9ce1966fdac3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:35.239614 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b2a956-fdff-4fac-af98-9ce1966fdac3 service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:35.250237 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1461/2940] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:06:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:06:38.180011 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3aa313-635d-4409-8cd5-28074f6e2676 None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:38.180620 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3aa313-635d-4409-8cd5-28074f6e2676 None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:38.180620 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3aa313-635d-4409-8cd5-28074f6e2676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:38.203159 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-bc3aa313-635d-4409-8cd5-28074f6e2676 None None] MFA Rules not processed for user `cc650418ff744a178289e14fefc617d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:06:38.204408 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-bc3aa313-635d-4409-8cd5-28074f6e2676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:06:38.213822 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1480/2941] 10.222.0.67 () {58 vars in 1016 bytes} [Mon Sep 19 15:06:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:06:38.233337 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b2a956-fdff-4fac-af98-9ce1966fdac3 service nova] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:38.235281 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-68b2a956-fdff-4fac-af98-9ce1966fdac3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:06:38.252162 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b2a956-fdff-4fac-af98-9ce1966fdac3 service nova] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:38.259120 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e577aa-aee2-448d-ba12-ea6fda6e945a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3017e5d92bef4cc2aeae4f28c78ba233', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:38.259728 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e577aa-aee2-448d-ba12-ea6fda6e945a service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:38.260006 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e577aa-aee2-448d-ba12-ea6fda6e945a service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:38.260263 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e577aa-aee2-448d-ba12-ea6fda6e945a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:38.271207 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e577aa-aee2-448d-ba12-ea6fda6e945a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:38.272905 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e577aa-aee2-448d-ba12-ea6fda6e945a service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:38.284028 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1462/2942] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:06:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 15:06:47.821583 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3aa313-635d-4409-8cd5-28074f6e2676 None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:06:47.837726 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3aa313-635d-4409-8cd5-28074f6e2676 None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:06:47.851999 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033bac8b-bb46-413e-85b3-4db4fc31be69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3017e5d92bef4cc2aeae4f28c78ba233', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:06:47.852627 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033bac8b-bb46-413e-85b3-4db4fc31be69 service nova] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:06:47.852905 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033bac8b-bb46-413e-85b3-4db4fc31be69 service nova] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:06:47.853204 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033bac8b-bb46-413e-85b3-4db4fc31be69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:06:47.855711 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-033bac8b-bb46-413e-85b3-4db4fc31be69 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:06:47.869818 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033bac8b-bb46-413e-85b3-4db4fc31be69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:06:47.871649 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033bac8b-bb46-413e-85b3-4db4fc31be69 service nova] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:06:47.884481 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1481/2943] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:06:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:06:48.278966 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=14 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:06:57.878749 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=44,keystone:DELETE=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:07:03.696219 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e577aa-aee2-448d-ba12-ea6fda6e945a service nova] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:07:03.715559 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e577aa-aee2-448d-ba12-ea6fda6e945a service nova] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:07:03.725828 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ddbb7f-c749-4b44-9575-6d3e76b431df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3017e5d92bef4cc2aeae4f28c78ba233', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:07:03.726995 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ddbb7f-c749-4b44-9575-6d3e76b431df service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:03.727524 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ddbb7f-c749-4b44-9575-6d3e76b431df service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:03.727992 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ddbb7f-c749-4b44-9575-6d3e76b431df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:03.730619 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d3ddbb7f-c749-4b44-9575-6d3e76b431df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:07:03.749400 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ddbb7f-c749-4b44-9575-6d3e76b431df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:07:03.751609 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ddbb7f-c749-4b44-9575-6d3e76b431df service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:07:03.765796 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1463/2944] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:07:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:07:08.371284 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033bac8b-bb46-413e-85b3-4db4fc31be69 service nova] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:07:08.372867 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-033bac8b-bb46-413e-85b3-4db4fc31be69 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:07:08.388423 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033bac8b-bb46-413e-85b3-4db4fc31be69 service nova] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:07:08.393536 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c73729-4626-4728-95e6-c894957cc651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:07:08.394195 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c73729-4626-4728-95e6-c894957cc651 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:08.394444 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c73729-4626-4728-95e6-c894957cc651 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:08.394938 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c73729-4626-4728-95e6-c894957cc651 admin admin] PATH_INFO: `/v3/users/0a75c02eaed1429e875df112c175671c` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:08.395831 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c73729-4626-4728-95e6-c894957cc651 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a75c02eaed1429e875df112c175671c)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:07:08.397778 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c73729-4626-4728-95e6-c894957cc651 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:07:08.457348 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-c8c73729-4626-4728-95e6-c894957cc651 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a75c02eaed1429e875df112c175671c'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:07:08.468085 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-c8c73729-4626-4728-95e6-c894957cc651 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a75c02eaed1429e875df112c175671c'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:07:08.468855 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-c8c73729-4626-4728-95e6-c894957cc651 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a75c02eaed1429e875df112c175671c'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:07:08.469623 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-c8c73729-4626-4728-95e6-c894957cc651 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a75c02eaed1429e875df112c175671c'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:07:08.483444 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-c8c73729-4626-4728-95e6-c894957cc651 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a75c02eaed1429e875df112c175671c'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:07:08.497516 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1482/2945] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 15:07:08 2022] DELETE /identity/v3/users/0a75c02eaed1429e875df112c175671c => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:07:08.700028 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ddbb7f-c749-4b44-9575-6d3e76b431df service nova] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:07:08.713144 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ddbb7f-c749-4b44-9575-6d3e76b431df service nova] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:07:08.780387 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6b3c56-a376-4315-98b6-fb022a67f12c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:07:08.781376 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6b3c56-a376-4315-98b6-fb022a67f12c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:08.781837 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6b3c56-a376-4315-98b6-fb022a67f12c admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:08.782284 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6b3c56-a376-4315-98b6-fb022a67f12c admin admin] PATH_INFO: `/v3/projects/3251e2d5c25048898285a48d16ac4598` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:08.784050 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6b3c56-a376-4315-98b6-fb022a67f12c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3251e2d5c25048898285a48d16ac4598)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:07:08.787462 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6b3c56-a376-4315-98b6-fb022a67f12c admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:07:08.840213 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-4b6b3c56-a376-4315-98b6-fb022a67f12c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3251e2d5c25048898285a48d16ac4598', 'request_id': 'req-4b6b3c56-a376-4315-98b6-fb022a67f12c'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:07:08.847373 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-4b6b3c56-a376-4315-98b6-fb022a67f12c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3251e2d5c25048898285a48d16ac4598', 'request_id': 'req-4b6b3c56-a376-4315-98b6-fb022a67f12c'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:07:08.856922 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-4b6b3c56-a376-4315-98b6-fb022a67f12c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3251e2d5c25048898285a48d16ac4598', 'request_id': 'req-4b6b3c56-a376-4315-98b6-fb022a67f12c'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:07:08.868555 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-4b6b3c56-a376-4315-98b6-fb022a67f12c admin admin] The token cache is being invalidate because project 3251e2d5c25048898285a48d16ac4598 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:07:08.868847 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-4b6b3c56-a376-4315-98b6-fb022a67f12c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:07:08.869632 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-4b6b3c56-a376-4315-98b6-fb022a67f12c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:07:08.871200 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1464/2946] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 15:07:08 2022] DELETE /identity/v3/projects/3251e2d5c25048898285a48d16ac4598 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:07:11.509105 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca322d0-0b10-48d9-a026-60eb207a2fab None None] REQUEST_METHOD: `POST` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:11.509644 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca322d0-0b10-48d9-a026-60eb207a2fab None None] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:11.509644 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca322d0-0b10-48d9-a026-60eb207a2fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:11.585051 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.auth.core [None req-2ca322d0-0b10-48d9-a026-60eb207a2fab None None] MFA Rules not processed for user `2c2b1ac1a17c43d28da8f7e9a199dea4`. Rule list: `[]` (Enabled: `True`). {{(pid=81471) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 15:07:11.586305 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-2ca322d0-0b10-48d9-a026-60eb207a2fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:07:11.671855 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1483/2947] 10.222.0.26 () {58 vars in 967 bytes} [Mon Sep 19 15:07:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 15:07:11.736103 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6b3c56-a376-4315-98b6-fb022a67f12c admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:07:11.738134 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-4b6b3c56-a376-4315-98b6-fb022a67f12c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:07:11.838129 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:07:11.850840 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6b3c56-a376-4315-98b6-fb022a67f12c admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:07:11.860367 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9b52ee-c5b6-4d5b-a253-e31061966739 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76cb60a5e90343e69a38db4356cb3a90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:07:11.861004 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b52ee-c5b6-4d5b-a253-e31061966739 service swift] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:11.861292 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b52ee-c5b6-4d5b-a253-e31061966739 service swift] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:11.861554 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b52ee-c5b6-4d5b-a253-e31061966739 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:11.870464 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9b52ee-c5b6-4d5b-a253-e31061966739 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:07:11.872050 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9b52ee-c5b6-4d5b-a253-e31061966739 service swift] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:07:11.886782 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1465/2948] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Sep 19 15:07:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 15:07:19.324895 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca322d0-0b10-48d9-a026-60eb207a2fab None None] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:07:19.326886 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-2ca322d0-0b10-48d9-a026-60eb207a2fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:07:19.388982 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:07:19.414670 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca322d0-0b10-48d9-a026-60eb207a2fab None None] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:07:19.419652 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71434625-e99b-43aa-a9c9-39c6b99d44c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:07:19.420351 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71434625-e99b-43aa-a9c9-39c6b99d44c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:19.420624 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71434625-e99b-43aa-a9c9-39c6b99d44c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:19.420889 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71434625-e99b-43aa-a9c9-39c6b99d44c1 admin admin] PATH_INFO: `/v3/users/b525dc72432c493ca134b39bd3bc3678` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:19.422095 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71434625-e99b-43aa-a9c9-39c6b99d44c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b525dc72432c493ca134b39bd3bc3678)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:07:19.424007 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71434625-e99b-43aa-a9c9-39c6b99d44c1 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:07:19.476535 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-71434625-e99b-43aa-a9c9-39c6b99d44c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b525dc72432c493ca134b39bd3bc3678'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:07:19.485458 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-71434625-e99b-43aa-a9c9-39c6b99d44c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b525dc72432c493ca134b39bd3bc3678'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:07:19.486085 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-71434625-e99b-43aa-a9c9-39c6b99d44c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b525dc72432c493ca134b39bd3bc3678'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:07:19.486804 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-71434625-e99b-43aa-a9c9-39c6b99d44c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b525dc72432c493ca134b39bd3bc3678'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:07:19.498824 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-71434625-e99b-43aa-a9c9-39c6b99d44c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b525dc72432c493ca134b39bd3bc3678'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:07:19.510907 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1484/2949] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 15:07:19 2022] DELETE /identity/v3/users/b525dc72432c493ca134b39bd3bc3678 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:07:19.703710 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9b52ee-c5b6-4d5b-a253-e31061966739 service swift] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:07:19.725437 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9b52ee-c5b6-4d5b-a253-e31061966739 service swift] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:07:19.792587 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8642e092-4fed-479b-b7d4-1ab8d238ec4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:07:19.793256 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8642e092-4fed-479b-b7d4-1ab8d238ec4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:19.793540 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8642e092-4fed-479b-b7d4-1ab8d238ec4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:19.793804 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8642e092-4fed-479b-b7d4-1ab8d238ec4a admin admin] PATH_INFO: `/v3/projects/613afb1244e2452d9d4e22830fa7ca5a` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:19.795042 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8642e092-4fed-479b-b7d4-1ab8d238ec4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=613afb1244e2452d9d4e22830fa7ca5a)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:07:19.797792 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8642e092-4fed-479b-b7d4-1ab8d238ec4a admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:07:19.854934 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-8642e092-4fed-479b-b7d4-1ab8d238ec4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '613afb1244e2452d9d4e22830fa7ca5a', 'request_id': 'req-8642e092-4fed-479b-b7d4-1ab8d238ec4a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:07:19.864019 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-8642e092-4fed-479b-b7d4-1ab8d238ec4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '613afb1244e2452d9d4e22830fa7ca5a', 'request_id': 'req-8642e092-4fed-479b-b7d4-1ab8d238ec4a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:07:19.875131 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-8642e092-4fed-479b-b7d4-1ab8d238ec4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '613afb1244e2452d9d4e22830fa7ca5a', 'request_id': 'req-8642e092-4fed-479b-b7d4-1ab8d238ec4a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:07:19.887594 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-8642e092-4fed-479b-b7d4-1ab8d238ec4a admin admin] The token cache is being invalidate because project 613afb1244e2452d9d4e22830fa7ca5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:07:19.888155 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-8642e092-4fed-479b-b7d4-1ab8d238ec4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:07:19.888891 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-8642e092-4fed-479b-b7d4-1ab8d238ec4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:07:19.893809 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1466/2950] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 15:07:19 2022] DELETE /identity/v3/projects/613afb1244e2452d9d4e22830fa7ca5a => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:07:19.894935 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71434625-e99b-43aa-a9c9-39c6b99d44c1 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:07:19.896380 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-71434625-e99b-43aa-a9c9-39c6b99d44c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:07:19.910407 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71434625-e99b-43aa-a9c9-39c6b99d44c1 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:07:19.975856 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bacc85-3320-4d17-9d58-4ebd0cdc8f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:07:19.976492 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bacc85-3320-4d17-9d58-4ebd0cdc8f03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:19.976769 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bacc85-3320-4d17-9d58-4ebd0cdc8f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:19.977069 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bacc85-3320-4d17-9d58-4ebd0cdc8f03 admin admin] PATH_INFO: `/v3/users/4a65f455457a42f980c8ec4efec2d203` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:19.978255 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bacc85-3320-4d17-9d58-4ebd0cdc8f03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a65f455457a42f980c8ec4efec2d203)` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:07:19.980280 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bacc85-3320-4d17-9d58-4ebd0cdc8f03 admin admin] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:07:20.033369 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-74bacc85-3320-4d17-9d58-4ebd0cdc8f03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a65f455457a42f980c8ec4efec2d203'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:07:20.042492 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-74bacc85-3320-4d17-9d58-4ebd0cdc8f03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a65f455457a42f980c8ec4efec2d203'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:07:20.043137 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-74bacc85-3320-4d17-9d58-4ebd0cdc8f03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a65f455457a42f980c8ec4efec2d203'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:07:20.043751 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-74bacc85-3320-4d17-9d58-4ebd0cdc8f03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a65f455457a42f980c8ec4efec2d203'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:07:20.052569 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:07:20.058066 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.notifications [None req-74bacc85-3320-4d17-9d58-4ebd0cdc8f03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a65f455457a42f980c8ec4efec2d203'} {{(pid=81471) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:07:20.074344 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1485/2951] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Sep 19 15:07:19 2022] DELETE /identity/v3/users/4a65f455457a42f980c8ec4efec2d203 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:07:20.271763 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8642e092-4fed-479b-b7d4-1ab8d238ec4a admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:07:20.273406 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-8642e092-4fed-479b-b7d4-1ab8d238ec4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:07:20.290326 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8642e092-4fed-479b-b7d4-1ab8d238ec4a admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:07:20.356538 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e9199b-87c6-4147-aaa5-943d819cec7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc650418ff744a178289e14fefc617d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd638629494b04280b2ba0fc11da818cf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:07:20.357214 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e9199b-87c6-4147-aaa5-943d819cec7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:07:20.357489 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e9199b-87c6-4147-aaa5-943d819cec7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:07:20.357929 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e9199b-87c6-4147-aaa5-943d819cec7a admin admin] PATH_INFO: `/v3/projects/bb5d2facca734c24877a6c27a1b81747` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:07:20.359366 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e9199b-87c6-4147-aaa5-943d819cec7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb5d2facca734c24877a6c27a1b81747)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:07:20.361375 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e9199b-87c6-4147-aaa5-943d819cec7a admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:07:20.384244 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:07:20.416321 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-19e9199b-87c6-4147-aaa5-943d819cec7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb5d2facca734c24877a6c27a1b81747', 'request_id': 'req-19e9199b-87c6-4147-aaa5-943d819cec7a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:07:20.423009 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-19e9199b-87c6-4147-aaa5-943d819cec7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb5d2facca734c24877a6c27a1b81747', 'request_id': 'req-19e9199b-87c6-4147-aaa5-943d819cec7a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:07:20.433504 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-19e9199b-87c6-4147-aaa5-943d819cec7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb5d2facca734c24877a6c27a1b81747', 'request_id': 'req-19e9199b-87c6-4147-aaa5-943d819cec7a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:07:20.446800 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-19e9199b-87c6-4147-aaa5-943d819cec7a admin admin] The token cache is being invalidate because project bb5d2facca734c24877a6c27a1b81747 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 15:07:20.447084 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-19e9199b-87c6-4147-aaa5-943d819cec7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:07:20.447746 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-19e9199b-87c6-4147-aaa5-943d819cec7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 15:07:20.449327 dv-cinder-756709-7-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1467/2952] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Sep 19 15:07:20 2022] DELETE /identity/v3/projects/bb5d2facca734c24877a6c27a1b81747 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 15:07:30.068717 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=7,keystone:DELETE=1 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:07:30.443183 dv-cinder-756709-7-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:08:32.844611 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bacc85-3320-4d17-9d58-4ebd0cdc8f03 admin admin] Authenticating user token {{(pid=81471) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 15:08:32.846541 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-74bacc85-3320-4d17-9d58-4ebd0cdc8f03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:08:32.937599 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bacc85-3320-4d17-9d58-4ebd0cdc8f03 admin admin] Validating token access rules against request {{(pid=81471) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 15:08:33.031511 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2651e1b2-9b61-46c3-9ebb-a4387c751094 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da0a58c526f34afda909e4ede2b1e1c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ede5dc59ece4d9282867a99e94c4c41', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81471) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 15:08:33.032050 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2651e1b2-9b61-46c3-9ebb-a4387c751094 service placement] REQUEST_METHOD: `GET` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 15:08:33.032315 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2651e1b2-9b61-46c3-9ebb-a4387c751094 service placement] SCRIPT_NAME: `/identity` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 15:08:33.032616 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2651e1b2-9b61-46c3-9ebb-a4387c751094 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81471) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 15:08:33.034744 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.fernet_utils [None req-2651e1b2-9b61-46c3-9ebb-a4387c751094 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81471) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 15:08:33.054608 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2651e1b2-9b61-46c3-9ebb-a4387c751094 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 15:08:33.056255 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2651e1b2-9b61-46c3-9ebb-a4387c751094 service placement] RBAC: Authorization granted {{(pid=81471) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 15:08:33.069094 dv-cinder-756709-7-smb devstack@keystone.service[81471]: [pid: 81471|app: 0|req: 1486/2953] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Sep 19 15:08:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 15:08:43.064286 dv-cinder-756709-7-smb devstack@keystone.service[81471]: DEBUG dbcounter [-] [81471] Writing DB stats keystone:SELECT=58 {{(pid=81471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}